2023-11-28T19:14:27.783 INFO:root:teuthology version: 0.0.1.dev209+g5ae09a5 2023-11-28T19:14:27.783 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} --verbose --name vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi --owner scheduled_vshankar@teuthology --archive /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469560 -- /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469560/orig.config.yaml 2023-11-28T19:14:27.829 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-11-28T19:14:28.104 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469560 branch: wip-vshankar-testing-20231127.102914 description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}} email: vshankar@redhat.com first_in_suite: false job_id: '7469560' kernel: client: branch: testing flavor: default kdb: true sha1: 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20231127.102914 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 kclient: syntax: v2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20231127.102914 sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 owner: scheduled_vshankar@teuthology priority: 150 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 8377 sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 sleep_before_teardown: 0 subset: 462/1024 suite: fs suite_branch: wip-vshankar-testing-20231127.102914 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi028.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFD0UqFdgaeYHmKtCuxFRFq4UfYsI2HjxUOyex8iH5Ynbnh3HoCRnhnRw4elCuiK6M6V/Y+D9KEoBlCQv+rqAIg= smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDB28tW1sgttDOzf7fivMRb+Fz5baJsZ273ewCM+cLg/NJ75vdEEXt7RFi/gHwstO7eFM5k0P1FKS3bEtDKZFY8= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqiX2kl6JtCwVrIaTnZhuqWwq5odcom7EN36WIz4d4O8kQZrNjq/Se/7RrqHbA9EEuWpcsDA6SRU9zO3zYTn0E= task: null tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end - if not is_kupstream() then reject() end teuthology_branch: main teuthology_sha1: 5ae09a5cc7064ca2bf994df19f3006b79794789a timestamp: 2023-11-28_06:29:14 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-11-28T19:14:28.105 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa; will attempt to use it 2023-11-28T19:14:28.105 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks 2023-11-28T19:14:28.105 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-11-28T19:14:28.107 INFO:teuthology.task.internal:Checking packages... 2023-11-28T19:14:28.132 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '43dd94c190073cf16cff1e711dd7f5a7b1cbc883' 2023-11-28T19:14:28.132 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-11-28T19:14:28.132 INFO:teuthology.packaging:ref: None 2023-11-28T19:14:28.132 INFO:teuthology.packaging:tag: None 2023-11-28T19:14:28.132 INFO:teuthology.packaging:branch: wip-vshankar-testing-20231127.102914 2023-11-28T19:14:28.132 INFO:teuthology.packaging:sha1: 43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T19:14:28.133 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20231127.102914 2023-11-28T19:14:28.275 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:14:28.275 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-11-28T19:14:28.282 INFO:teuthology.task.internal:no buildpackages task found 2023-11-28T19:14:28.282 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-11-28T19:14:28.307 INFO:teuthology.task.internal:Saving configuration 2023-11-28T19:14:28.335 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-11-28T19:14:28.342 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-11-28T19:14:28.366 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi028.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469560', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 19:08:33.373527', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHXOYeZAYz9pb9q2+HxXZ/Mmhtijaz8CDlxbKLY/J/g/'} 2023-11-28T19:14:28.388 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469560', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 19:08:33.374952', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIK5RTa4yw3LXNQYiDlOceqDDMSNg8ns++faE/nDcqbz1'} 2023-11-28T19:14:28.411 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469560', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-11-28 19:08:33.371874', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIL6s1lkdirH8escBqorFt4IA37xS19XJW9H4EJP1LYKA'} 2023-11-28T19:14:28.411 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-11-28T19:14:28.418 INFO:teuthology.task.internal:roles: ubuntu@smithi028.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-11-28T19:14:28.418 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-11-28T19:14:28.418 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['client.0'] 2023-11-28T19:14:28.418 INFO:teuthology.run_tasks:Running task console_log... 2023-11-28T19:14:28.535 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f9b893c4a60>, signals=[15]) 2023-11-28T19:14:28.536 INFO:teuthology.run_tasks:Running task internal.connect... 2023-11-28T19:14:28.543 INFO:teuthology.task.internal:Opening connections... 2023-11-28T19:14:28.543 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi028.front.sepia.ceph.com 2023-11-28T19:14:28.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:14:28.621 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2023-11-28T19:14:28.621 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:14:28.696 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi203.front.sepia.ceph.com 2023-11-28T19:14:28.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:14:28.772 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-11-28T19:14:28.780 DEBUG:teuthology.orchestra.run.smithi028:> uname -m 2023-11-28T19:14:28.786 INFO:teuthology.orchestra.run.smithi028.stdout:x86_64 2023-11-28T19:14:28.786 DEBUG:teuthology.orchestra.run.smithi028:> cat /etc/os-release 2023-11-28T19:14:28.834 INFO:teuthology.orchestra.run.smithi028.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T19:14:28.834 INFO:teuthology.orchestra.run.smithi028.stdout:NAME="Ubuntu" 2023-11-28T19:14:28.834 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_ID="22.04" 2023-11-28T19:14:28.834 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T19:14:28.834 INFO:teuthology.orchestra.run.smithi028.stdout:VERSION_CODENAME=jammy 2023-11-28T19:14:28.835 INFO:teuthology.orchestra.run.smithi028.stdout:ID=ubuntu 2023-11-28T19:14:28.835 INFO:teuthology.orchestra.run.smithi028.stdout:ID_LIKE=debian 2023-11-28T19:14:28.835 INFO:teuthology.orchestra.run.smithi028.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T19:14:28.835 INFO:teuthology.orchestra.run.smithi028.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T19:14:28.835 INFO:teuthology.orchestra.run.smithi028.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T19:14:28.835 INFO:teuthology.orchestra.run.smithi028.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T19:14:28.836 INFO:teuthology.orchestra.run.smithi028.stdout:UBUNTU_CODENAME=jammy 2023-11-28T19:14:28.837 INFO:teuthology.lock.ops:Updating smithi028.front.sepia.ceph.com on lock server 2023-11-28T19:14:28.872 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2023-11-28T19:14:28.878 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2023-11-28T19:14:28.878 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2023-11-28T19:14:28.924 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T19:14:28.924 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="Ubuntu" 2023-11-28T19:14:28.924 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="22.04" 2023-11-28T19:14:28.924 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T19:14:28.924 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_CODENAME=jammy 2023-11-28T19:14:28.924 INFO:teuthology.orchestra.run.smithi131.stdout:ID=ubuntu 2023-11-28T19:14:28.924 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE=debian 2023-11-28T19:14:28.924 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T19:14:28.925 INFO:teuthology.orchestra.run.smithi131.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T19:14:28.925 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T19:14:28.925 INFO:teuthology.orchestra.run.smithi131.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T19:14:28.925 INFO:teuthology.orchestra.run.smithi131.stdout:UBUNTU_CODENAME=jammy 2023-11-28T19:14:28.925 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2023-11-28T19:14:28.955 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2023-11-28T19:14:28.961 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2023-11-28T19:14:28.961 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2023-11-28T19:14:29.006 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-11-28T19:14:29.006 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="Ubuntu" 2023-11-28T19:14:29.007 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="22.04" 2023-11-28T19:14:29.007 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-11-28T19:14:29.007 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_CODENAME=jammy 2023-11-28T19:14:29.007 INFO:teuthology.orchestra.run.smithi203.stdout:ID=ubuntu 2023-11-28T19:14:29.007 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE=debian 2023-11-28T19:14:29.007 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://www.ubuntu.com/" 2023-11-28T19:14:29.007 INFO:teuthology.orchestra.run.smithi203.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-11-28T19:14:29.007 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-11-28T19:14:29.007 INFO:teuthology.orchestra.run.smithi203.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-11-28T19:14:29.007 INFO:teuthology.orchestra.run.smithi203.stdout:UBUNTU_CODENAME=jammy 2023-11-28T19:14:29.008 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2023-11-28T19:14:29.030 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-11-28T19:14:29.040 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-11-28T19:14:29.058 INFO:teuthology.task.internal:Checking for old test directory... 2023-11-28T19:14:29.058 DEBUG:teuthology.orchestra.run.smithi028:> test '!' -e /home/ubuntu/cephtest 2023-11-28T19:14:29.060 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2023-11-28T19:14:29.063 DEBUG:teuthology.orchestra.run.smithi203:> test '!' -e /home/ubuntu/cephtest 2023-11-28T19:14:29.067 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-11-28T19:14:29.082 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-11-28T19:14:29.083 DEBUG:teuthology.orchestra.run.smithi028:> test -z $(ls -A /var/lib/ceph) 2023-11-28T19:14:29.107 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2023-11-28T19:14:29.109 DEBUG:teuthology.orchestra.run.smithi203:> test -z $(ls -A /var/lib/ceph) 2023-11-28T19:14:29.122 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-11-28T19:14:29.201 INFO:teuthology.run_tasks:Running task kernel... 2023-11-28T19:14:29.217 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'} 2023-11-28T19:14:29.217 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-11-28T19:14:29.218 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-11-28T19:14:29.218 DEBUG:teuthology.orchestra.run.smithi203:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T19:14:29.223 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:14:29.223 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-11-28T19:14:29.532 DEBUG:teuthology.task.kernel:sha1 for client.0 is 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:14:29.533 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "8247bbb5b470f7e2a1f3eefcc16e24cf1338f606"... 2023-11-28T19:14:29.533 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2023-11-28T19:14:29.539 INFO:teuthology.orchestra.run.smithi203.stdout:5.15.0-56-generic 2023-11-28T19:14:29.539 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:14:29.540 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-11-28T19:14:29.540 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-11-28T19:14:29.541 DEBUG:teuthology.orchestra.run.smithi203:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-11-28T19:14:29.602 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-11-28T19:14:29.796 INFO:teuthology.orchestra.run.smithi203.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-11-28T19:14:29.797 INFO:teuthology.orchestra.run.smithi203.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-11-28T19:14:29.797 INFO:teuthology.orchestra.run.smithi203.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-11-28T19:14:29.797 INFO:teuthology.orchestra.run.smithi203.stderr:hint: 2023-11-28T19:14:29.797 INFO:teuthology.orchestra.run.smithi203.stderr:hint: git config --global init.defaultBranch 2023-11-28T19:14:29.797 INFO:teuthology.orchestra.run.smithi203.stderr:hint: 2023-11-28T19:14:29.797 INFO:teuthology.orchestra.run.smithi203.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-11-28T19:14:29.797 INFO:teuthology.orchestra.run.smithi203.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-11-28T19:14:29.797 INFO:teuthology.orchestra.run.smithi203.stderr:hint: 2023-11-28T19:14:29.797 INFO:teuthology.orchestra.run.smithi203.stderr:hint: git branch -m 2023-11-28T19:14:29.798 INFO:teuthology.orchestra.run.smithi203.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-11-28T19:14:29.800 DEBUG:teuthology.orchestra.run.smithi203:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-11-28T19:14:29.911 DEBUG:teuthology.orchestra.run.smithi203:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-11-28T19:14:29.925 DEBUG:teuthology.orchestra.run.smithi203:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-11-28T19:15:36.420 INFO:teuthology.orchestra.run.smithi203.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-11-28T19:15:36.420 INFO:teuthology.orchestra.run.smithi203.stderr: * [new branch] main -> origin/main 2023-11-28T19:15:36.444 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20190312 -> 20190312 2023-11-28T19:15:36.444 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20190416 -> 20190416 2023-11-28T19:15:36.444 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20190514 -> 20190514 2023-11-28T19:15:36.444 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20190618 -> 20190618 2023-11-28T19:15:36.444 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20190717 -> 20190717 2023-11-28T19:15:36.444 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20190815 -> 20190815 2023-11-28T19:15:36.444 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20190923 -> 20190923 2023-11-28T19:15:36.446 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20191022 -> 20191022 2023-11-28T19:15:36.446 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20191215 -> 20191215 2023-11-28T19:15:36.446 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200122 -> 20200122 2023-11-28T19:15:36.446 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200316 -> 20200316 2023-11-28T19:15:36.446 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200421 -> 20200421 2023-11-28T19:15:36.447 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200519 -> 20200519 2023-11-28T19:15:36.447 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200619 -> 20200619 2023-11-28T19:15:36.447 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200721 -> 20200721 2023-11-28T19:15:36.447 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200817 -> 20200817 2023-11-28T19:15:36.447 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20200918 -> 20200918 2023-11-28T19:15:36.447 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20201022 -> 20201022 2023-11-28T19:15:36.447 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20201118 -> 20201118 2023-11-28T19:15:36.447 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20201218 -> 20201218 2023-11-28T19:15:36.447 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20210208 -> 20210208 2023-11-28T19:15:36.447 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20210315 -> 20210315 2023-11-28T19:15:36.447 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20210511 -> 20210511 2023-11-28T19:15:36.447 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20210716 -> 20210716 2023-11-28T19:15:36.450 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20210818 -> 20210818 2023-11-28T19:15:36.450 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20210919 -> 20210919 2023-11-28T19:15:36.450 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20211027 -> 20211027 2023-11-28T19:15:36.450 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20211216 -> 20211216 2023-11-28T19:15:36.450 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220209 -> 20220209 2023-11-28T19:15:36.450 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220310 -> 20220310 2023-11-28T19:15:36.450 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220411 -> 20220411 2023-11-28T19:15:36.450 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220509 -> 20220509 2023-11-28T19:15:36.451 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220610 -> 20220610 2023-11-28T19:15:36.451 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220708 -> 20220708 2023-11-28T19:15:36.451 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220815 -> 20220815 2023-11-28T19:15:36.451 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20220913 -> 20220913 2023-11-28T19:15:36.451 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20221012 -> 20221012 2023-11-28T19:15:36.451 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20221109 -> 20221109 2023-11-28T19:15:36.451 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20221214 -> 20221214 2023-11-28T19:15:36.451 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230117 -> 20230117 2023-11-28T19:15:36.451 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230210 -> 20230210 2023-11-28T19:15:36.451 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230310 -> 20230310 2023-11-28T19:15:36.451 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230404 -> 20230404 2023-11-28T19:15:36.451 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230515 -> 20230515 2023-11-28T19:15:36.452 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230625 -> 20230625 2023-11-28T19:15:36.452 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230804 -> 20230804 2023-11-28T19:15:36.452 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20230919 -> 20230919 2023-11-28T19:15:36.452 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20231030 -> 20231030 2023-11-28T19:15:36.452 INFO:teuthology.orchestra.run.smithi203.stderr: * [new tag] 20231111 -> 20231111 2023-11-28T19:15:40.458 INFO:teuthology.orchestra.run.smithi203.stderr:Updating files: 50% (1629/3250) Updating files: 51% (1658/3250) Updating files: 52% (1690/3250) Updating files: 53% (1723/3250) Updating files: 54% (1755/3250) Updating files: 55% (1788/3250) Updating files: 56% (1820/3250) Updating files: 57% (1853/3250) Updating files: 58% (1885/3250) Updating files: 59% (1918/3250) Updating files: 60% (1950/3250) Updating files: 61% (1983/3250) Updating files: 62% (2015/3250) Updating files: 63% (2048/3250) Updating files: 64% (2080/3250) Updating files: 64% (2103/3250) Updating files: 65% (2113/3250) Updating files: 66% (2145/3250) Updating files: 67% (2178/3250) Updating files: 68% (2210/3250) Updating files: 69% (2243/3250) Updating files: 70% (2275/3250) Updating files: 71% (2308/3250) Updating files: 72% (2340/3250) Updating files: 73% (2373/3250) Updating files: 74% (2405/3250) Updating files: 75% (2438/3250) Updating files: 76% (2470/3250) Updating files: 77% (2503/3250) Updating files: 78% (2535/3250) Updating files: 79% (2568/3250) Updating files: 80% (2600/3250) Updating files: 81% (2633/3250) Updating files: 81% (2650/3250) Updating files: 82% (2665/3250) Updating files: 83% (2698/3250) Updating files: 84% (2730/3250) Updating files: 85% (2763/3250) Updating files: 86% (2795/3250) Updating files: 87% (2828/3250) Updating files: 88% (2860/3250) Updating files: 89% (2893/3250) Updating files: 90% (2925/3250) Updating files: 91% (2958/3250) Updating files: 92% (2990/3250) Updating files: 93% (3023/3250) Updating files: 94% (3055/3250) Updating files: 95% (3088/3250) Updating files: 96% (3120/3250) Updating files: 97% (3153/3250) Updating files: 98% (3185/3250) Updating files: 99% (3218/3250) Updating files: 100% (3250/3250) Updating files: 100% (3250/3250), done. 2023-11-28T19:15:40.463 INFO:teuthology.orchestra.run.smithi203.stdout:HEAD is now at aae60524 Merge branch 'make-opts' into 'main' 2023-11-28T19:15:40.484 INFO:teuthology.task.kernel:Downloading kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-28T19:15:40.485 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 2023-11-28T19:15:40.634 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ 2023-11-28T19:15:40.635 DEBUG:teuthology.orchestra.run.smithi203:> rm -f /tmp/linux-image.deb && echo linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/ --input-file=- 2023-11-28T19:15:40.638 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi203.front.sepia.ceph.com to complete... 2023-11-28T19:15:42.223 INFO:teuthology.orchestra.run.smithi203.stderr:2023-11-28 19:15:42 URL:https://3.chacra.ceph.com/r/kernel/testing/8247bbb5b470f7e2a1f3eefcc16e24cf1338f606/ubuntu/jammy/flavors/default/pool/main/l/linux-6.6.0-g8247bbb5b470/linux-image-6.6.0-g8247bbb5b470_6.6.0-g8247bbb5b470-1_amd64.deb [38938726/38938726] -> "/tmp/linux-image.deb" [1] 2023-11-28T19:15:42.224 INFO:teuthology.orchestra.run.smithi203.stderr:FINISHED --2023-11-28 19:15:42-- 2023-11-28T19:15:42.224 INFO:teuthology.orchestra.run.smithi203.stderr:Total wall clock time: 1.5s 2023-11-28T19:15:42.224 INFO:teuthology.orchestra.run.smithi203.stderr:Downloaded: 1 files, 37M in 1.3s (27.5 MB/s) 2023-11-28T19:15:42.227 INFO:teuthology.task.kernel:Installing kernel 8247bbb5b470f7e2a1f3eefcc16e24cf1338f606 on client.0... 2023-11-28T19:15:42.227 DEBUG:teuthology.orchestra.run.smithi203:> sudo dpkg -i /tmp/linux-image.deb 2023-11-28T19:15:42.489 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package linux-image-6.6.0-g8247bbb5b470. 2023-11-28T19:15:44.525 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-11-28T19:15:44.529 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-11-28T19:15:44.645 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T19:15:47.739 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up linux-image-6.6.0-g8247bbb5b470 (6.6.0-g8247bbb5b470-1) ... 2023-11-28T19:15:47.849 INFO:teuthology.orchestra.run.smithi203.stderr:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:16:08.371 INFO:teuthology.orchestra.run.smithi203.stderr:Sourcing file `/etc/default/grub' 2023-11-28T19:16:08.382 INFO:teuthology.orchestra.run.smithi203.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T19:16:08.414 INFO:teuthology.orchestra.run.smithi203.stderr:Generating grub configuration file ... 2023-11-28T19:16:08.716 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:16:08.742 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:16:09.028 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T19:16:09.045 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T19:16:09.112 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T19:16:09.117 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T19:16:09.255 INFO:teuthology.orchestra.run.smithi203.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T19:16:09.255 INFO:teuthology.orchestra.run.smithi203.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T19:16:09.255 INFO:teuthology.orchestra.run.smithi203.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T19:16:09.290 INFO:teuthology.orchestra.run.smithi203.stderr:done 2023-11-28T19:16:09.466 DEBUG:teuthology.orchestra.run.smithi203:> dpkg-deb -c /tmp/linux-image.deb 2023-11-28T19:16:09.473 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./ 2023-11-28T19:16:09.473 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./boot/ 2023-11-28T19:16:09.474 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 4415617 2023-11-23 03:47 ./boot/System.map-6.6.0-g8247bbb5b470 2023-11-28T19:16:09.485 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 169214 2023-11-23 03:47 ./boot/config-6.6.0-g8247bbb5b470 2023-11-28T19:16:09.486 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11352832 2023-11-23 03:47 ./boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:16:09.505 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/ 2023-11-28T19:16:09.505 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/ 2023-11-28T19:16:09.505 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postinst.d/ 2023-11-28T19:16:09.505 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/postrm.d/ 2023-11-28T19:16:09.505 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/preinst.d/ 2023-11-28T19:16:09.505 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./etc/kernel/prerm.d/ 2023-11-28T19:16:09.505 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/ 2023-11-28T19:16:09.505 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/ 2023-11-28T19:16:09.505 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/ 2023-11-28T19:16:09.505 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/ 2023-11-28T19:16:09.506 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/ 2023-11-28T19:16:09.506 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/ 2023-11-28T19:16:09.506 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ 2023-11-28T19:16:09.506 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 490233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/aesni-intel.ko 2023-11-28T19:16:09.508 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-11-28T19:16:09.508 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-11-28T19:16:09.508 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-11-28T19:16:09.508 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 93113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-11-28T19:16:09.509 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 106729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-11-28T19:16:09.509 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 152241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-11-28T19:16:09.509 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-11-28T19:16:09.509 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-11-28T19:16:09.509 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 83889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-11-28T19:16:09.509 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-11-28T19:16:09.509 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-11-28T19:16:09.509 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-avx2.ko 2023-11-28T19:16:09.509 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-11-28T19:16:09.509 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-11-28T19:16:09.509 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-11-28T19:16:09.510 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 58585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-11-28T19:16:09.510 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-11-28T19:16:09.510 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-11-28T19:16:09.510 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-11-28T19:16:09.510 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/ 2023-11-28T19:16:09.510 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/ 2023-11-28T19:16:09.510 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/ 2023-11-28T19:16:09.510 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-11-28T19:16:09.510 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/cpuid.ko 2023-11-28T19:16:09.510 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kernel/msr.ko 2023-11-28T19:16:09.510 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/ 2023-11-28T19:16:09.510 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 354433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-amd.ko 2023-11-28T19:16:09.511 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 881625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm-intel.ko 2023-11-28T19:16:09.511 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 2275865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/arch/x86/kvm/kvm.ko 2023-11-28T19:16:09.523 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ 2023-11-28T19:16:09.523 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/af_alg.ko 2023-11-28T19:16:09.523 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_hash.ko 2023-11-28T19:16:09.523 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/algif_skcipher.ko 2023-11-28T19:16:09.524 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ansi_cprng.ko 2023-11-28T19:16:09.524 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/anubis.ko 2023-11-28T19:16:09.524 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/arc4.ko 2023-11-28T19:16:09.524 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/ 2023-11-28T19:16:09.524 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-11-28T19:16:09.524 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/ 2023-11-28T19:16:09.525 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_memcpy.ko 2023-11-28T19:16:09.525 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_pq.ko 2023-11-28T19:16:09.525 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_raid6_recov.ko 2023-11-28T19:16:09.525 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_tx.ko 2023-11-28T19:16:09.525 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/async_xor.ko 2023-11-28T19:16:09.525 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/async_tx/raid6test.ko 2023-11-28T19:16:09.525 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authenc.ko 2023-11-28T19:16:09.525 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/authencesn.ko 2023-11-28T19:16:09.525 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blake2b_generic.ko 2023-11-28T19:16:09.525 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_common.ko 2023-11-28T19:16:09.526 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/blowfish_generic.ko 2023-11-28T19:16:09.526 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/camellia_generic.ko 2023-11-28T19:16:09.526 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast5_generic.ko 2023-11-28T19:16:09.526 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast6_generic.ko 2023-11-28T19:16:09.526 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cast_common.ko 2023-11-28T19:16:09.526 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/ccm.ko 2023-11-28T19:16:09.526 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cmac.ko 2023-11-28T19:16:09.526 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crc32_generic.ko 2023-11-28T19:16:09.526 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cryptd.ko 2023-11-28T19:16:09.526 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_engine.ko 2023-11-28T19:16:09.527 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_simd.ko 2023-11-28T19:16:09.527 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/crypto_user.ko 2023-11-28T19:16:09.527 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/cts.ko 2023-11-28T19:16:09.527 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/des_generic.ko 2023-11-28T19:16:09.527 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/dh_generic.ko 2023-11-28T19:16:09.527 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/echainiv.ko 2023-11-28T19:16:09.527 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/essiv.ko 2023-11-28T19:16:09.527 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/fcrypt.ko 2023-11-28T19:16:09.527 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/khazad.ko 2023-11-28T19:16:09.527 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lrw.ko 2023-11-28T19:16:09.528 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4.ko 2023-11-28T19:16:09.528 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/lz4hc.ko 2023-11-28T19:16:09.528 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/md4.ko 2023-11-28T19:16:09.528 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/michael_mic.ko 2023-11-28T19:16:09.528 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcbc.ko 2023-11-28T19:16:09.528 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/pcrypt.ko 2023-11-28T19:16:09.528 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/rmd160.ko 2023-11-28T19:16:09.528 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/seed.ko 2023-11-28T19:16:09.528 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/serpent_generic.ko 2023-11-28T19:16:09.528 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 149193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tcrypt.ko 2023-11-28T19:16:09.529 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/tea.ko 2023-11-28T19:16:09.529 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_common.ko 2023-11-28T19:16:09.529 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/twofish_generic.ko 2023-11-28T19:16:09.529 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/vmac.ko 2023-11-28T19:16:09.529 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/wp512.ko 2023-11-28T19:16:09.529 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xcbc.ko 2023-11-28T19:16:09.529 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xor.ko 2023-11-28T19:16:09.529 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xts.ko 2023-11-28T19:16:09.529 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/crypto/xxhash_generic.ko 2023-11-28T19:16:09.529 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ 2023-11-28T19:16:09.530 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ 2023-11-28T19:16:09.530 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_extlog.ko 2023-11-28T19:16:09.530 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_ipmi.ko 2023-11-28T19:16:09.530 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/acpi_pad.ko 2023-11-28T19:16:09.530 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/ 2023-11-28T19:16:09.530 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/apei/einj.ko 2023-11-28T19:16:09.530 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/ec_sys.ko 2023-11-28T19:16:09.530 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/platform_profile.ko 2023-11-28T19:16:09.530 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbs.ko 2023-11-28T19:16:09.530 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/sbshc.ko 2023-11-28T19:16:09.531 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 103025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/acpi/video.ko 2023-11-28T19:16:09.531 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ 2023-11-28T19:16:09.531 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/acard-ahci.ko 2023-11-28T19:16:09.531 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 88865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci.ko 2023-11-28T19:16:09.531 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/ahci_platform.ko 2023-11-28T19:16:09.531 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 88289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci.ko 2023-11-28T19:16:09.531 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/libahci_platform.ko 2023-11-28T19:16:09.531 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_acpi.ko 2023-11-28T19:16:09.531 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ali.ko 2023-11-28T19:16:09.532 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_amd.ko 2023-11-28T19:16:09.532 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_artop.ko 2023-11-28T19:16:09.532 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atiixp.ko 2023-11-28T19:16:09.532 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_atp867x.ko 2023-11-28T19:16:09.532 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd640.ko 2023-11-28T19:16:09.532 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cmd64x.ko 2023-11-28T19:16:09.532 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_cypress.ko 2023-11-28T19:16:09.532 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_efar.ko 2023-11-28T19:16:09.532 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt366.ko 2023-11-28T19:16:09.532 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt37x.ko 2023-11-28T19:16:09.533 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x2n.ko 2023-11-28T19:16:09.533 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_hpt3x3.ko 2023-11-28T19:16:09.533 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it8213.ko 2023-11-28T19:16:09.533 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_it821x.ko 2023-11-28T19:16:09.533 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_jmicron.ko 2023-11-28T19:16:09.533 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_legacy.ko 2023-11-28T19:16:09.533 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_marvell.ko 2023-11-28T19:16:09.533 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_mpiix.ko 2023-11-28T19:16:09.533 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_netcell.ko 2023-11-28T19:16:09.533 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ninja32.ko 2023-11-28T19:16:09.533 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87410.ko 2023-11-28T19:16:09.534 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_ns87415.ko 2023-11-28T19:16:09.534 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_oldpiix.ko 2023-11-28T19:16:09.534 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_opti.ko 2023-11-28T19:16:09.534 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_optidma.ko 2023-11-28T19:16:09.534 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pcmcia.ko 2023-11-28T19:16:09.534 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc2027x.ko 2023-11-28T19:16:09.535 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-11-28T19:16:09.537 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_piccolo.ko 2023-11-28T19:16:09.537 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_radisys.ko 2023-11-28T19:16:09.537 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rdc.ko 2023-11-28T19:16:09.537 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_rz1000.ko 2023-11-28T19:16:09.537 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sch.ko 2023-11-28T19:16:09.537 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_serverworks.ko 2023-11-28T19:16:09.538 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sil680.ko 2023-11-28T19:16:09.538 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_sl82c105.ko 2023-11-28T19:16:09.538 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_triflex.ko 2023-11-28T19:16:09.538 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pata_via.ko 2023-11-28T19:16:09.538 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/pdc_adma.ko 2023-11-28T19:16:09.538 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_inic162x.ko 2023-11-28T19:16:09.538 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 83345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_mv.ko 2023-11-28T19:16:09.538 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_nv.ko 2023-11-28T19:16:09.538 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_promise.ko 2023-11-28T19:16:09.538 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_qstor.ko 2023-11-28T19:16:09.538 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil.ko 2023-11-28T19:16:09.538 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sil24.ko 2023-11-28T19:16:09.539 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sis.ko 2023-11-28T19:16:09.539 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_svw.ko 2023-11-28T19:16:09.539 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_sx4.ko 2023-11-28T19:16:09.539 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_uli.ko 2023-11-28T19:16:09.539 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_via.ko 2023-11-28T19:16:09.539 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ata/sata_vsc.ko 2023-11-28T19:16:09.539 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ 2023-11-28T19:16:09.539 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/auxdisplay/ks0108.ko 2023-11-28T19:16:09.539 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/ 2023-11-28T19:16:09.539 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 124473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/bcma/bcma.ko 2023-11-28T19:16:09.539 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/ 2023-11-28T19:16:09.540 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/ 2023-11-28T19:16:09.540 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 113665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/aoe/aoe.ko 2023-11-28T19:16:09.540 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/ 2023-11-28T19:16:09.540 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 965585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/drbd/drbd.ko 2023-11-28T19:16:09.540 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 173225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/floppy.ko 2023-11-28T19:16:09.540 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/ 2023-11-28T19:16:09.540 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 94297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-11-28T19:16:09.540 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 115793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/nbd.ko 2023-11-28T19:16:09.597 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/ 2023-11-28T19:16:09.597 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 110385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/null_blk/null_blk.ko 2023-11-28T19:16:09.597 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 98193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/pktcdvd.ko 2023-11-28T19:16:09.597 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 263769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/rbd.ko 2023-11-28T19:16:09.597 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/ 2023-11-28T19:16:09.597 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 98145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-11-28T19:16:09.597 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/ 2023-11-28T19:16:09.597 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/block/zram/zram.ko 2023-11-28T19:16:09.598 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ 2023-11-28T19:16:09.598 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/applicom.ko 2023-11-28T19:16:09.598 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hangcheck-timer.ko 2023-11-28T19:16:09.598 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/ 2023-11-28T19:16:09.598 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/amd-rng.ko 2023-11-28T19:16:09.598 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/intel-rng.ko 2023-11-28T19:16:09.598 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-11-28T19:16:09.598 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/via-rng.ko 2023-11-28T19:16:09.598 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/hw_random/virtio-rng.ko 2023-11-28T19:16:09.598 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ 2023-11-28T19:16:09.598 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-11-28T19:16:09.599 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 148601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-11-28T19:16:09.599 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-11-28T19:16:09.599 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 139313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_si.ko 2023-11-28T19:16:09.599 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-11-28T19:16:09.599 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-11-28T19:16:09.599 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/lp.ko 2023-11-28T19:16:09.599 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/ 2023-11-28T19:16:09.599 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 84097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/mwave/mwave.ko 2023-11-28T19:16:09.599 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/nvram.ko 2023-11-28T19:16:09.600 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/ppdev.ko 2023-11-28T19:16:09.600 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tlclk.ko 2023-11-28T19:16:09.600 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/ 2023-11-28T19:16:09.600 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_atmel.ko 2023-11-28T19:16:09.600 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-11-28T19:16:09.600 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-11-28T19:16:09.600 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-11-28T19:16:09.600 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_infineon.ko 2023-11-28T19:16:09.600 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/tpm_nsc.ko 2023-11-28T19:16:09.600 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-11-28T19:16:09.600 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/ 2023-11-28T19:16:09.601 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_class.ko 2023-11-28T19:16:09.601 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_core.ko 2023-11-28T19:16:09.601 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-11-28T19:16:09.601 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/ 2023-11-28T19:16:09.601 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-palmas.ko 2023-11-28T19:16:09.601 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-si5351.ko 2023-11-28T19:16:09.601 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-twl6040.ko 2023-11-28T19:16:09.601 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/clk/clk-wm831x.ko 2023-11-28T19:16:09.601 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/ 2023-11-28T19:16:09.601 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-11-28T19:16:09.601 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/p4-clockmod.ko 2023-11-28T19:16:09.602 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/cpufreq/speedstep-lib.ko 2023-11-28T19:16:09.602 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ 2023-11-28T19:16:09.602 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ 2023-11-28T19:16:09.602 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-11-28T19:16:09.602 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 243025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/ccp/ccp.ko 2023-11-28T19:16:09.602 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/ 2023-11-28T19:16:09.602 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/ 2023-11-28T19:16:09.602 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/ 2023-11-28T19:16:09.602 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 438761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-11-28T19:16:09.602 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2023-11-28T19:16:09.603 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-11-28T19:16:09.603 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-aes.ko 2023-11-28T19:16:09.603 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/padlock-sha.ko 2023-11-28T19:16:09.603 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/ 2023-11-28T19:16:09.603 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-11-28T19:16:09.603 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/ 2023-11-28T19:16:09.603 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dca/dca.ko 2023-11-28T19:16:09.603 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ 2023-11-28T19:16:09.603 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/ 2023-11-28T19:16:09.604 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/dw/dw_dmac.ko 2023-11-28T19:16:09.604 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ 2023-11-28T19:16:09.604 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 122569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/dma/ioat/ioatdma.ko 2023-11-28T19:16:09.604 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ 2023-11-28T19:16:09.604 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 79953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/amd64_edac.ko 2023-11-28T19:16:09.604 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/e752x_edac.ko 2023-11-28T19:16:09.604 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 63617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/edac_mce_amd.ko 2023-11-28T19:16:09.604 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3000_edac.ko 2023-11-28T19:16:09.604 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i3200_edac.ko 2023-11-28T19:16:09.604 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5100_edac.ko 2023-11-28T19:16:09.605 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i5400_edac.ko 2023-11-28T19:16:09.605 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7300_edac.ko 2023-11-28T19:16:09.605 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i7core_edac.ko 2023-11-28T19:16:09.605 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/i82975x_edac.ko 2023-11-28T19:16:09.605 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/ie31200_edac.ko 2023-11-28T19:16:09.605 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 56825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/sb_edac.ko 2023-11-28T19:16:09.606 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/edac/x38_edac.ko 2023-11-28T19:16:09.606 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/ 2023-11-28T19:16:09.606 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-gpio.ko 2023-11-28T19:16:09.606 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max14577.ko 2023-11-28T19:16:09.606 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max77693.ko 2023-11-28T19:16:09.606 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-max8997.ko 2023-11-28T19:16:09.606 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-palmas.ko 2023-11-28T19:16:09.606 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-rt8973a.ko 2023-11-28T19:16:09.606 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/extcon/extcon-sm5502.ko 2023-11-28T19:16:09.606 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/ 2023-11-28T19:16:09.606 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/dmi-sysfs.ko 2023-11-28T19:16:09.606 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/ 2023-11-28T19:16:09.607 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/efi/efi-pstore.ko 2023-11-28T19:16:09.607 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/firmware/iscsi_ibft.ko 2023-11-28T19:16:09.607 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/ 2023-11-28T19:16:09.607 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-adp5520.ko 2023-11-28T19:16:09.607 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-amd8111.ko 2023-11-28T19:16:09.607 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-arizona.ko 2023-11-28T19:16:09.607 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9052.ko 2023-11-28T19:16:09.607 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-da9055.ko 2023-11-28T19:16:09.607 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-dln2.ko 2023-11-28T19:16:09.607 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 77849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-f7188x.ko 2023-11-28T19:16:09.607 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-generic.ko 2023-11-28T19:16:09.607 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ich.ko 2023-11-28T19:16:09.608 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-11-28T19:16:09.608 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-kempld.ko 2023-11-28T19:16:09.608 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-lp3943.ko 2023-11-28T19:16:09.608 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max7300.ko 2023-11-28T19:16:09.608 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max730x.ko 2023-11-28T19:16:09.608 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-max732x.ko 2023-11-28T19:16:09.608 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-11-28T19:16:09.608 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pca953x.ko 2023-11-28T19:16:09.608 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-pcf857x.ko 2023-11-28T19:16:09.609 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-rdc321x.ko 2023-11-28T19:16:09.609 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch.ko 2023-11-28T19:16:09.609 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-sch311x.ko 2023-11-28T19:16:09.609 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-tps65912.ko 2023-11-28T19:16:09.609 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl4030.ko 2023-11-28T19:16:09.609 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-twl6040.ko 2023-11-28T19:16:09.609 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-viperboard.ko 2023-11-28T19:16:09.609 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-vx855.ko 2023-11-28T19:16:09.609 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm831x.ko 2023-11-28T19:16:09.609 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8350.ko 2023-11-28T19:16:09.609 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/gpio/gpio-wm8994.ko 2023-11-28T19:16:09.609 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/ 2023-11-28T19:16:09.610 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-a4tech.ko 2023-11-28T19:16:09.610 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-apple.ko 2023-11-28T19:16:09.610 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-appleir.ko 2023-11-28T19:16:09.610 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-aureal.ko 2023-11-28T19:16:09.610 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-axff.ko 2023-11-28T19:16:09.610 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-belkin.ko 2023-11-28T19:16:09.610 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cherry.ko 2023-11-28T19:16:09.610 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-chicony.ko 2023-11-28T19:16:09.610 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cp2112.ko 2023-11-28T19:16:09.610 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-cypress.ko 2023-11-28T19:16:09.610 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-dr.ko 2023-11-28T19:16:09.611 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elecom.ko 2023-11-28T19:16:09.611 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-elo.ko 2023-11-28T19:16:09.611 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-emsff.ko 2023-11-28T19:16:09.611 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ezkey.ko 2023-11-28T19:16:09.611 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gaff.ko 2023-11-28T19:16:09.611 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-generic.ko 2023-11-28T19:16:09.611 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gt683r.ko 2023-11-28T19:16:09.611 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-gyration.ko 2023-11-28T19:16:09.611 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-kbd.ko 2023-11-28T19:16:09.611 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtek-mouse.ko 2023-11-28T19:16:09.611 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-holtekff.ko 2023-11-28T19:16:09.612 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-hyperv.ko 2023-11-28T19:16:09.612 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-icade.ko 2023-11-28T19:16:09.612 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kensington.ko 2023-11-28T19:16:09.612 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-keytouch.ko 2023-11-28T19:16:09.612 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-kye.ko 2023-11-28T19:16:09.612 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lcpower.ko 2023-11-28T19:16:09.612 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-led.ko 2023-11-28T19:16:09.612 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lenovo.ko 2023-11-28T19:16:09.612 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-lg-g15.ko 2023-11-28T19:16:09.612 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 58185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-dj.ko 2023-11-28T19:16:09.612 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 101481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-11-28T19:16:09.612 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 80993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-logitech.ko 2023-11-28T19:16:09.613 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-magicmouse.ko 2023-11-28T19:16:09.613 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-microsoft.ko 2023-11-28T19:16:09.613 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-monterey.ko 2023-11-28T19:16:09.613 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-multitouch.ko 2023-11-28T19:16:09.613 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ntrig.ko 2023-11-28T19:16:09.613 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-ortek.ko 2023-11-28T19:16:09.613 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-penmount.ko 2023-11-28T19:16:09.613 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-petalynx.ko 2023-11-28T19:16:09.613 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 72937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-picolcd.ko 2023-11-28T19:16:09.613 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-pl.ko 2023-11-28T19:16:09.613 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-plantronics.ko 2023-11-28T19:16:09.613 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-primax.ko 2023-11-28T19:16:09.614 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-rmi.ko 2023-11-28T19:16:09.614 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-arvo.ko 2023-11-28T19:16:09.614 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-common.ko 2023-11-28T19:16:09.614 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-isku.ko 2023-11-28T19:16:09.614 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kone.ko 2023-11-28T19:16:09.614 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-11-28T19:16:09.614 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-konepure.ko 2023-11-28T19:16:09.614 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-11-28T19:16:09.614 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-lua.ko 2023-11-28T19:16:09.614 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-pyra.ko 2023-11-28T19:16:09.614 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-ryos.ko 2023-11-28T19:16:09.615 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat-savu.ko 2023-11-28T19:16:09.615 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-roccat.ko 2023-11-28T19:16:09.615 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-saitek.ko 2023-11-28T19:16:09.615 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-samsung.ko 2023-11-28T19:16:09.615 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sensor-hub.ko 2023-11-28T19:16:09.615 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sjoy.ko 2023-11-28T19:16:09.615 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sony.ko 2023-11-28T19:16:09.615 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-speedlink.ko 2023-11-28T19:16:09.615 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-steelseries.ko 2023-11-28T19:16:09.615 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-sunplus.ko 2023-11-28T19:16:09.615 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-thrustmaster.ko 2023-11-28T19:16:09.615 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tivo.ko 2023-11-28T19:16:09.615 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-tmff.ko 2023-11-28T19:16:09.616 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-topseed.ko 2023-11-28T19:16:09.616 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-twinhan.ko 2023-11-28T19:16:09.616 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 71073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-uclogic.ko 2023-11-28T19:16:09.616 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-waltop.ko 2023-11-28T19:16:09.616 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 143473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-wiimote.ko 2023-11-28T19:16:09.616 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-xinmo.ko 2023-11-28T19:16:09.616 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zpff.ko 2023-11-28T19:16:09.616 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid-zydacron.ko 2023-11-28T19:16:09.617 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 267825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/hid.ko 2023-11-28T19:16:09.617 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/uhid.ko 2023-11-28T19:16:09.617 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/ 2023-11-28T19:16:09.617 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 125721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbhid.ko 2023-11-28T19:16:09.617 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbkbd.ko 2023-11-28T19:16:09.617 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/usbhid/usbmouse.ko 2023-11-28T19:16:09.617 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 217873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hid/wacom.ko 2023-11-28T19:16:09.617 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/ 2023-11-28T19:16:09.617 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 64201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_balloon.ko 2023-11-28T19:16:09.617 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 89625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_utils.ko 2023-11-28T19:16:09.617 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 305465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hv/hv_vmbus.ko 2023-11-28T19:16:09.618 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ 2023-11-28T19:16:09.618 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru.ko 2023-11-28T19:16:09.618 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/abituguru3.ko 2023-11-28T19:16:09.618 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/acpi_power_meter.ko 2023-11-28T19:16:09.618 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7414.ko 2023-11-28T19:16:09.618 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ad7418.ko 2023-11-28T19:16:09.618 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adc128d818.ko 2023-11-28T19:16:09.618 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1025.ko 2023-11-28T19:16:09.618 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 97977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1026.ko 2023-11-28T19:16:09.618 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1029.ko 2023-11-28T19:16:09.618 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm1031.ko 2023-11-28T19:16:09.618 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adm9240.ko 2023-11-28T19:16:09.619 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ads7828.ko 2023-11-28T19:16:09.619 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7410.ko 2023-11-28T19:16:09.619 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7411.ko 2023-11-28T19:16:09.619 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 74433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7462.ko 2023-11-28T19:16:09.619 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7470.ko 2023-11-28T19:16:09.619 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7475.ko 2023-11-28T19:16:09.619 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/adt7x10.ko 2023-11-28T19:16:09.619 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/amc6821.ko 2023-11-28T19:16:09.619 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/applesmc.ko 2023-11-28T19:16:09.619 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asb100.ko 2023-11-28T19:16:09.619 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 58617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asc7621.ko 2023-11-28T19:16:09.619 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/asus_atk0110.ko 2023-11-28T19:16:09.620 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/atxp1.ko 2023-11-28T19:16:09.620 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/coretemp.ko 2023-11-28T19:16:09.620 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9052-hwmon.ko 2023-11-28T19:16:09.620 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/da9055-hwmon.ko 2023-11-28T19:16:09.620 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-11-28T19:16:09.620 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 99601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/dme1737.ko 2023-11-28T19:16:09.620 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds1621.ko 2023-11-28T19:16:09.620 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ds620.ko 2023-11-28T19:16:09.620 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc1403.ko 2023-11-28T19:16:09.620 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc2103.ko 2023-11-28T19:16:09.620 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/emc6w201.ko 2023-11-28T19:16:09.620 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71805f.ko 2023-11-28T19:16:09.621 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 94457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f71882fg.ko 2023-11-28T19:16:09.621 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/f75375s.ko 2023-11-28T19:16:09.621 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fam15h_power.ko 2023-11-28T19:16:09.621 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/fschmd.ko 2023-11-28T19:16:09.621 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g760a.ko 2023-11-28T19:16:09.621 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/g762.ko 2023-11-28T19:16:09.621 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl518sm.ko 2023-11-28T19:16:09.621 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/gl520sm.ko 2023-11-28T19:16:09.621 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hih6130.ko 2023-11-28T19:16:09.621 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/hwmon-vid.ko 2023-11-28T19:16:09.621 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5500_temp.ko 2023-11-28T19:16:09.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/i5k_amb.ko 2023-11-28T19:16:09.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmaem.ko 2023-11-28T19:16:09.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ibmpex.ko 2023-11-28T19:16:09.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina209.ko 2023-11-28T19:16:09.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ina2xx.ko 2023-11-28T19:16:09.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 130449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/it87.ko 2023-11-28T19:16:09.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/jc42.ko 2023-11-28T19:16:09.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k10temp.ko 2023-11-28T19:16:09.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/k8temp.ko 2023-11-28T19:16:09.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lineage-pem.ko 2023-11-28T19:16:09.622 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm63.ko 2023-11-28T19:16:09.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm73.ko 2023-11-28T19:16:09.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm75.ko 2023-11-28T19:16:09.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm77.ko 2023-11-28T19:16:09.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm78.ko 2023-11-28T19:16:09.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm80.ko 2023-11-28T19:16:09.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm83.ko 2023-11-28T19:16:09.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 72833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm85.ko 2023-11-28T19:16:09.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm87.ko 2023-11-28T19:16:09.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm90.ko 2023-11-28T19:16:09.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm92.ko 2023-11-28T19:16:09.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 108841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm93.ko 2023-11-28T19:16:09.623 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95234.ko 2023-11-28T19:16:09.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95241.ko 2023-11-28T19:16:09.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/lm95245.ko 2023-11-28T19:16:09.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc2945.ko 2023-11-28T19:16:09.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4151.ko 2023-11-28T19:16:09.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4215.ko 2023-11-28T19:16:09.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4222.ko 2023-11-28T19:16:09.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4245.ko 2023-11-28T19:16:09.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4260.ko 2023-11-28T19:16:09.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/ltc4261.ko 2023-11-28T19:16:09.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max16065.ko 2023-11-28T19:16:09.624 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1619.ko 2023-11-28T19:16:09.625 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max1668.ko 2023-11-28T19:16:09.625 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max197.ko 2023-11-28T19:16:09.625 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6639.ko 2023-11-28T19:16:09.625 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6650.ko 2023-11-28T19:16:09.625 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/max6697.ko 2023-11-28T19:16:09.625 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mc13783-adc.ko 2023-11-28T19:16:09.625 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/mcp3021.ko 2023-11-28T19:16:09.625 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-11-28T19:16:09.625 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6683.ko 2023-11-28T19:16:09.625 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 119817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775-core.ko 2023-11-28T19:16:09.625 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct6775.ko 2023-11-28T19:16:09.626 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/nct7802.ko 2023-11-28T19:16:09.626 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 82337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87360.ko 2023-11-28T19:16:09.626 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pc87427.ko 2023-11-28T19:16:09.626 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pcf8591.ko 2023-11-28T19:16:09.626 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ 2023-11-28T19:16:09.626 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-11-28T19:16:09.626 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-11-28T19:16:09.626 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-11-28T19:16:09.626 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max16064.ko 2023-11-28T19:16:09.626 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max34440.ko 2023-11-28T19:16:09.626 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/max8688.ko 2023-11-28T19:16:09.626 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-11-28T19:16:09.627 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 82577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-11-28T19:16:09.627 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-11-28T19:16:09.627 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-11-28T19:16:09.627 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-11-28T19:16:09.627 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-11-28T19:16:09.627 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/powr1220.ko 2023-11-28T19:16:09.627 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5627.ko 2023-11-28T19:16:09.627 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch5636.ko 2023-11-28T19:16:09.627 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sch56xx-common.ko 2023-11-28T19:16:09.627 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht15.ko 2023-11-28T19:16:09.627 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sht21.ko 2023-11-28T19:16:09.627 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/shtc1.ko 2023-11-28T19:16:09.627 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/sis5595.ko 2023-11-28T19:16:09.628 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47b397.ko 2023-11-28T19:16:09.628 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m1.ko 2023-11-28T19:16:09.628 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/smsc47m192.ko 2023-11-28T19:16:09.628 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/thmc50.ko 2023-11-28T19:16:09.628 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp102.ko 2023-11-28T19:16:09.628 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp103.ko 2023-11-28T19:16:09.628 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp401.ko 2023-11-28T19:16:09.628 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/tmp421.ko 2023-11-28T19:16:09.628 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via-cputemp.ko 2023-11-28T19:16:09.628 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/via686a.ko 2023-11-28T19:16:09.628 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt1211.ko 2023-11-28T19:16:09.629 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/vt8231.ko 2023-11-28T19:16:09.629 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627ehf.ko 2023-11-28T19:16:09.629 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83627hf.ko 2023-11-28T19:16:09.629 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 71345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83781d.ko 2023-11-28T19:16:09.629 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 63225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83791d.ko 2023-11-28T19:16:09.629 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 71321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83792d.ko 2023-11-28T19:16:09.629 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 101473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83793.ko 2023-11-28T19:16:09.629 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 119505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83795.ko 2023-11-28T19:16:09.629 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l785ts.ko 2023-11-28T19:16:09.629 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/w83l786ng.ko 2023-11-28T19:16:09.630 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-11-28T19:16:09.630 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-11-28T19:16:09.630 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/ 2023-11-28T19:16:09.630 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/ 2023-11-28T19:16:09.630 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-11-28T19:16:09.630 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-11-28T19:16:09.630 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/ 2023-11-28T19:16:09.630 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-11-28T19:16:09.630 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-11-28T19:16:09.630 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-11-28T19:16:09.630 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-11-28T19:16:09.631 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-11-28T19:16:09.631 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-11-28T19:16:09.631 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-11-28T19:16:09.631 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 6929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-11-28T19:16:09.631 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-11-28T19:16:09.631 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-11-28T19:16:09.631 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-11-28T19:16:09.631 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-11-28T19:16:09.631 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-11-28T19:16:09.631 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-11-28T19:16:09.631 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-11-28T19:16:09.631 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-i801.ko 2023-11-28T19:16:09.632 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-isch.ko 2023-11-28T19:16:09.632 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-11-28T19:16:09.632 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-11-28T19:16:09.632 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-11-28T19:16:09.632 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-11-28T19:16:09.632 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-11-28T19:16:09.632 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-parport.ko 2023-11-28T19:16:09.632 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-11-28T19:16:09.632 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-11-28T19:16:09.632 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-11-28T19:16:09.632 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-11-28T19:16:09.633 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-11-28T19:16:09.633 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-11-28T19:16:09.633 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-11-28T19:16:09.633 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-11-28T19:16:09.633 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-11-28T19:16:09.633 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-11-28T19:16:09.633 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-via.ko 2023-11-28T19:16:09.633 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-11-28T19:16:09.633 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-11-28T19:16:09.633 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-11-28T19:16:09.633 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-mux.ko 2023-11-28T19:16:09.633 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-smbus.ko 2023-11-28T19:16:09.634 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/i2c-stub.ko 2023-11-28T19:16:09.634 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/ 2023-11-28T19:16:09.634 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-11-28T19:16:09.634 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-11-28T19:16:09.634 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-11-28T19:16:09.634 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ 2023-11-28T19:16:09.634 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ 2023-11-28T19:16:09.634 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 273609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_cm.ko 2023-11-28T19:16:09.634 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 879969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_core.ko 2023-11-28T19:16:09.634 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 69273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_umad.ko 2023-11-28T19:16:09.634 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 324217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-11-28T19:16:09.635 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 97985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/iw_cm.ko 2023-11-28T19:16:09.635 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 282273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_cm.ko 2023-11-28T19:16:09.635 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-11-28T19:16:09.635 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ 2023-11-28T19:16:09.635 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/ 2023-11-28T19:16:09.635 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 493073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-11-28T19:16:09.635 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/ 2023-11-28T19:16:09.635 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 419737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-11-28T19:16:09.635 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/ 2023-11-28T19:16:09.635 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 739025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-11-28T19:16:09.635 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ 2023-11-28T19:16:09.635 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 296625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-11-28T19:16:09.636 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ 2023-11-28T19:16:09.636 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 153697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-11-28T19:16:09.636 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/ 2023-11-28T19:16:09.636 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 168969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-11-28T19:16:09.636 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ 2023-11-28T19:16:09.636 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ 2023-11-28T19:16:09.636 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 263081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-11-28T19:16:09.636 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ 2023-11-28T19:16:09.636 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 100241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-11-28T19:16:09.636 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ 2023-11-28T19:16:09.636 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 111425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-11-28T19:16:09.637 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ 2023-11-28T19:16:09.637 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 128753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-11-28T19:16:09.637 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ 2023-11-28T19:16:09.637 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 129529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-11-28T19:16:09.637 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ 2023-11-28T19:16:09.637 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/evbug.ko 2023-11-28T19:16:09.637 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/ff-memless.ko 2023-11-28T19:16:09.637 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/ 2023-11-28T19:16:09.637 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-11-28T19:16:09.637 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/fm801-gp.ko 2023-11-28T19:16:09.637 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/gameport/gameport.ko 2023-11-28T19:16:09.637 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/joydev.ko 2023-11-28T19:16:09.638 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/ 2023-11-28T19:16:09.638 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-11-28T19:16:09.638 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-11-28T19:16:09.638 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-11-28T19:16:09.638 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-11-28T19:16:09.638 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys.ko 2023-11-28T19:16:09.638 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-11-28T19:16:09.638 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lkkbd.ko 2023-11-28T19:16:09.638 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8323.ko 2023-11-28T19:16:09.638 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/lm8333.ko 2023-11-28T19:16:09.638 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-11-28T19:16:09.639 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-11-28T19:16:09.639 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-11-28T19:16:09.639 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-11-28T19:16:09.639 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/newtonkbd.ko 2023-11-28T19:16:09.639 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-11-28T19:16:09.639 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt1070.ko 2023-11-28T19:16:09.639 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/qt2160.ko 2023-11-28T19:16:09.639 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-11-28T19:16:09.639 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/stowaway.ko 2023-11-28T19:16:09.639 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/sunkbd.ko 2023-11-28T19:16:09.639 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-11-28T19:16:09.639 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-11-28T19:16:09.640 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-11-28T19:16:09.640 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/keyboard/xtkbd.ko 2023-11-28T19:16:09.640 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/matrix-keymap.ko 2023-11-28T19:16:09.640 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/ 2023-11-28T19:16:09.640 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/appletouch.ko 2023-11-28T19:16:09.640 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/bcm5974.ko 2023-11-28T19:16:09.640 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 123681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/cyapatp.ko 2023-11-28T19:16:09.640 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 89449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/elan_i2c.ko 2023-11-28T19:16:09.640 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/gpio_mouse.ko 2023-11-28T19:16:09.640 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 335929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/psmouse.ko 2023-11-28T19:16:09.640 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/sermouse.ko 2023-11-28T19:16:09.640 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-11-28T19:16:09.641 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/synaptics_usb.ko 2023-11-28T19:16:09.641 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/mouse/vsxxxaa.ko 2023-11-28T19:16:09.641 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/ 2023-11-28T19:16:09.641 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 109873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/rmi4/rmi_core.ko 2023-11-28T19:16:09.641 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ 2023-11-28T19:16:09.641 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/altera_ps2.ko 2023-11-28T19:16:09.641 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/arc_ps2.ko 2023-11-28T19:16:09.641 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ct82c710.ko 2023-11-28T19:16:09.641 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-11-28T19:16:09.641 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/parkbd.ko 2023-11-28T19:16:09.641 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/pcips2.ko 2023-11-28T19:16:09.642 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/ps2mult.ko 2023-11-28T19:16:09.642 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serio_raw.ko 2023-11-28T19:16:09.642 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/serio/serport.ko 2023-11-28T19:16:09.642 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/input/sparse-keymap.ko 2023-11-28T19:16:09.642 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/ 2023-11-28T19:16:09.642 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/ 2023-11-28T19:16:09.642 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/iommu/amd/iommu_v2.ko 2023-11-28T19:16:09.642 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/ 2023-11-28T19:16:09.642 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-88pm860x.ko 2023-11-28T19:16:09.642 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-adp5520.ko 2023-11-28T19:16:09.642 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-bd2802.ko 2023-11-28T19:16:09.642 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-blinkm.ko 2023-11-28T19:16:09.643 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da903x.ko 2023-11-28T19:16:09.643 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-da9052.ko 2023-11-28T19:16:09.643 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-gpio.ko 2023-11-28T19:16:09.643 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3530.ko 2023-11-28T19:16:09.643 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3533.ko 2023-11-28T19:16:09.643 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm355x.ko 2023-11-28T19:16:09.643 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lm3642.ko 2023-11-28T19:16:09.643 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp3944.ko 2023-11-28T19:16:09.643 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-lp8788.ko 2023-11-28T19:16:09.643 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-max8997.ko 2023-11-28T19:16:09.643 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-mc13783.ko 2023-11-28T19:16:09.643 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-menf21bmc.ko 2023-11-28T19:16:09.644 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca9532.ko 2023-11-28T19:16:09.644 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca955x.ko 2023-11-28T19:16:09.644 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-pca963x.ko 2023-11-28T19:16:09.644 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-ss4200.ko 2023-11-28T19:16:09.644 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-tca6507.ko 2023-11-28T19:16:09.644 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm831x-status.ko 2023-11-28T19:16:09.644 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/leds-wm8350.ko 2023-11-28T19:16:09.644 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ 2023-11-28T19:16:09.644 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-11-28T19:16:09.644 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-11-28T19:16:09.644 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-11-28T19:16:09.644 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-11-28T19:16:09.644 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-11-28T19:16:09.645 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-11-28T19:16:09.645 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-11-28T19:16:09.645 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-11-28T19:16:09.645 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/ 2023-11-28T19:16:09.645 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/ 2023-11-28T19:16:09.645 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 654969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/bcache/bcache.ko 2023-11-28T19:16:09.645 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bio-prison.ko 2023-11-28T19:16:09.645 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 89601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-bufio.ko 2023-11-28T19:16:09.645 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache-smq.ko 2023-11-28T19:16:09.645 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 156009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-cache.ko 2023-11-28T19:16:09.645 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 106897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-crypt.ko 2023-11-28T19:16:09.645 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-delay.ko 2023-11-28T19:16:09.646 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-era.ko 2023-11-28T19:16:09.646 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-flakey.ko 2023-11-28T19:16:09.646 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log-userspace.ko 2023-11-28T19:16:09.646 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-log.ko 2023-11-28T19:16:09.646 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-mirror.ko 2023-11-28T19:16:09.646 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-multipath.ko 2023-11-28T19:16:09.646 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-queue-length.ko 2023-11-28T19:16:09.646 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-raid.ko 2023-11-28T19:16:09.646 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-region-hash.ko 2023-11-28T19:16:09.646 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-round-robin.ko 2023-11-28T19:16:09.646 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-service-time.ko 2023-11-28T19:16:09.646 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 109529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-snapshot.ko 2023-11-28T19:16:09.647 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-switch.ko 2023-11-28T19:16:09.647 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 181865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-thin-pool.ko 2023-11-28T19:16:09.647 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-verity.ko 2023-11-28T19:16:09.647 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/dm-zero.ko 2023-11-28T19:16:09.647 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/faulty.ko 2023-11-28T19:16:09.647 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/linear.ko 2023-11-28T19:16:09.647 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/multipath.ko 2023-11-28T19:16:09.647 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/ 2023-11-28T19:16:09.647 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 199937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-11-28T19:16:09.647 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid0.ko 2023-11-28T19:16:09.647 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 113073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid1.ko 2023-11-28T19:16:09.648 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 158681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid10.ko 2023-11-28T19:16:09.648 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 395721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/md/raid456.ko 2023-11-28T19:16:09.648 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/ 2023-11-28T19:16:09.648 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/ 2023-11-28T19:16:09.648 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 178137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptbase.ko 2023-11-28T19:16:09.648 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 63385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptctl.ko 2023-11-28T19:16:09.648 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptfc.ko 2023-11-28T19:16:09.648 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptlan.ko 2023-11-28T19:16:09.648 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 123321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptsas.ko 2023-11-28T19:16:09.648 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 79041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptscsih.ko 2023-11-28T19:16:09.648 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/message/fusion/mptspi.ko 2023-11-28T19:16:09.648 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ 2023-11-28T19:16:09.648 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm800.ko 2023-11-28T19:16:09.649 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm805.ko 2023-11-28T19:16:09.649 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/88pm80x.ko 2023-11-28T19:16:09.649 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona-i2c.ko 2023-11-28T19:16:09.649 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 123721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/arizona.ko 2023-11-28T19:16:09.649 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/bcm590xx.ko 2023-11-28T19:16:09.649 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/cros_ec_dev.ko 2023-11-28T19:16:09.649 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/dln2.ko 2023-11-28T19:16:09.649 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/janz-cmodio.ko 2023-11-28T19:16:09.649 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/kempld-core.ko 2023-11-28T19:16:09.649 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-core.ko 2023-11-28T19:16:09.649 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-11-28T19:16:09.650 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lp3943.ko 2023-11-28T19:16:09.650 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_ich.ko 2023-11-28T19:16:09.650 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/lpc_sch.ko 2023-11-28T19:16:09.650 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/max8907.ko 2023-11-28T19:16:09.650 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-core.ko 2023-11-28T19:16:09.650 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-11-28T19:16:09.650 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/menf21bmc.ko 2023-11-28T19:16:09.650 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-adc.ko 2023-11-28T19:16:09.650 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633-gpio.ko 2023-11-28T19:16:09.650 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/pcf50633.ko 2023-11-28T19:16:09.650 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-11-28T19:16:09.651 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/retu-mfd.ko 2023-11-28T19:16:09.651 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 80425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/si476x-core.ko 2023-11-28T19:16:09.651 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/sm501.ko 2023-11-28T19:16:09.651 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-11-28T19:16:09.651 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps65010.ko 2023-11-28T19:16:09.651 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/tps6507x.ko 2023-11-28T19:16:09.651 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/viperboard.ko 2023-11-28T19:16:09.651 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/vx855.ko 2023-11-28T19:16:09.651 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wl1273-core.ko 2023-11-28T19:16:09.651 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/mfd/wm8994.ko 2023-11-28T19:16:09.651 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ 2023-11-28T19:16:09.651 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-11-28T19:16:09.652 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ad525x_dpot.ko 2023-11-28T19:16:09.652 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/ 2023-11-28T19:16:09.652 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-11-28T19:16:09.652 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds9802als.ko 2023-11-28T19:16:09.652 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/apds990x.ko 2023-11-28T19:16:09.652 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/bh1770glc.ko 2023-11-28T19:16:09.652 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/ 2023-11-28T19:16:09.652 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-11-28T19:16:09.652 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/c2port/core.ko 2023-11-28T19:16:09.652 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/ 2023-11-28T19:16:09.652 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/cb710/cb710.ko 2023-11-28T19:16:09.653 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ds1682.ko 2023-11-28T19:16:09.653 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/dummy-irq.ko 2023-11-28T19:16:09.653 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/ 2023-11-28T19:16:09.653 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/echo/echo.ko 2023-11-28T19:16:09.653 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/ 2023-11-28T19:16:09.653 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/at24.ko 2023-11-28T19:16:09.653 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom.ko 2023-11-28T19:16:09.653 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-11-28T19:16:09.653 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/eeprom/max6875.ko 2023-11-28T19:16:09.653 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/enclosure.ko 2023-11-28T19:16:09.653 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/ 2023-11-28T19:16:09.653 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 152201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-11-28T19:16:09.654 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hmc6352.ko 2023-11-28T19:16:09.654 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/hpilo.ko 2023-11-28T19:16:09.654 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ 2023-11-28T19:16:09.654 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 72129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-11-28T19:16:09.654 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ics932s401.ko 2023-11-28T19:16:09.654 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29003.ko 2023-11-28T19:16:09.654 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/isl29020.ko 2023-11-28T19:16:09.654 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/ 2023-11-28T19:16:09.654 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-11-28T19:16:09.654 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-11-28T19:16:09.654 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/ 2023-11-28T19:16:09.655 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 125209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-me.ko 2023-11-28T19:16:09.655 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 56521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei-txe.ko 2023-11-28T19:16:09.655 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 310113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/mei/mei.ko 2023-11-28T19:16:09.655 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/phantom.ko 2023-11-28T19:16:09.655 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/ 2023-11-28T19:16:09.655 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 74265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/ti-st/st_drv.ko 2023-11-28T19:16:09.655 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_7xx1.ko 2023-11-28T19:16:09.655 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tifm_core.ko 2023-11-28T19:16:09.655 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/tsl2550.ko 2023-11-28T19:16:09.655 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_balloon.ko 2023-11-28T19:16:09.655 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/ 2023-11-28T19:16:09.655 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 183609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-11-28T19:16:09.656 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ 2023-11-28T19:16:09.656 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/ 2023-11-28T19:16:09.656 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 490129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/bonding/bonding.ko 2023-11-28T19:16:09.656 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/ 2023-11-28T19:16:09.656 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/ 2023-11-28T19:16:09.656 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 106033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/b53/b53_common.ko 2023-11-28T19:16:09.656 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/bcm-sf2.ko 2023-11-28T19:16:09.656 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6060.ko 2023-11-28T19:16:09.656 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/ 2023-11-28T19:16:09.656 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 453737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-11-28T19:16:09.656 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/dummy.ko 2023-11-28T19:16:09.657 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/eql.ko 2023-11-28T19:16:09.657 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ 2023-11-28T19:16:09.657 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/ 2023-11-28T19:16:09.657 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-11-28T19:16:09.657 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-11-28T19:16:09.657 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 130553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-11-28T19:16:09.657 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 68849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-11-28T19:16:09.657 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ 2023-11-28T19:16:09.657 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/8390.ko 2023-11-28T19:16:09.657 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-11-28T19:16:09.657 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-11-28T19:16:09.657 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 99049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-11-28T19:16:09.657 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/ 2023-11-28T19:16:09.658 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-11-28T19:16:09.658 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/ 2023-11-28T19:16:09.658 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 69137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/agere/et131x.ko 2023-11-28T19:16:09.658 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/ 2023-11-28T19:16:09.658 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-11-28T19:16:09.658 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/ 2023-11-28T19:16:09.658 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-11-28T19:16:09.658 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/ 2023-11-28T19:16:09.658 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-11-28T19:16:09.658 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-11-28T19:16:09.658 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 87297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-11-28T19:16:09.658 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/ 2023-11-28T19:16:09.659 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/ 2023-11-28T19:16:09.659 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 97337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-11-28T19:16:09.659 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-11-28T19:16:09.659 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 104673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-11-28T19:16:09.659 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-11-28T19:16:09.659 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 90257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-11-28T19:16:09.659 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/ 2023-11-28T19:16:09.659 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 81569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-11-28T19:16:09.659 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 69729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-11-28T19:16:09.659 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/ 2023-11-28T19:16:09.659 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-11-28T19:16:09.659 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 176761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-11-28T19:16:09.660 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-11-28T19:16:09.660 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1421497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-11-28T19:16:09.660 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 128569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-11-28T19:16:09.660 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/ 2023-11-28T19:16:09.660 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 132089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-11-28T19:16:09.660 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 312081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-11-28T19:16:09.660 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/ 2023-11-28T19:16:09.660 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/ 2023-11-28T19:16:09.660 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 323513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-11-28T19:16:09.660 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/ 2023-11-28T19:16:09.660 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-11-28T19:16:09.660 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 193497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-11-28T19:16:09.660 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-11-28T19:16:09.661 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 347417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-11-28T19:16:09.661 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-11-28T19:16:09.661 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1044497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-11-28T19:16:09.661 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-11-28T19:16:09.661 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 166193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-11-28T19:16:09.661 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-11-28T19:16:09.661 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-11-28T19:16:09.661 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/ 2023-11-28T19:16:09.661 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/ 2023-11-28T19:16:09.661 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 204345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-11-28T19:16:09.661 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/ 2023-11-28T19:16:09.661 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/ 2023-11-28T19:16:09.662 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 69449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-11-28T19:16:09.662 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-11-28T19:16:09.662 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 141225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-11-28T19:16:09.662 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-11-28T19:16:09.662 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-11-28T19:16:09.662 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-11-28T19:16:09.662 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/ 2023-11-28T19:16:09.662 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-11-28T19:16:09.662 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-11-28T19:16:09.662 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/dnet.ko 2023-11-28T19:16:09.662 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ec_bhf.ko 2023-11-28T19:16:09.662 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/ 2023-11-28T19:16:09.663 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/ 2023-11-28T19:16:09.663 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 281137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-11-28T19:16:09.663 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ethoc.ko 2023-11-28T19:16:09.663 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fealnx.ko 2023-11-28T19:16:09.663 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/ 2023-11-28T19:16:09.663 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-11-28T19:16:09.663 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ 2023-11-28T19:16:09.663 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 90465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e100.ko 2023-11-28T19:16:09.663 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/ 2023-11-28T19:16:09.663 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 295577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-11-28T19:16:09.663 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/ 2023-11-28T19:16:09.664 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 584497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-11-28T19:16:09.664 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/ 2023-11-28T19:16:09.664 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 246209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-11-28T19:16:09.664 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/ 2023-11-28T19:16:09.664 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 925825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-11-28T19:16:09.736 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/ 2023-11-28T19:16:09.736 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 302937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-11-28T19:16:09.736 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/ 2023-11-28T19:16:09.736 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 514641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-11-28T19:16:09.736 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/ 2023-11-28T19:16:09.736 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 93593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-11-28T19:16:09.736 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-11-28T19:16:09.736 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 734305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-11-28T19:16:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-11-28T19:16:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 151769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-11-28T19:16:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 86921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/jme.ko 2023-11-28T19:16:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/ 2023-11-28T19:16:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-11-28T19:16:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 102289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/skge.ko 2023-11-28T19:16:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 122649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-11-28T19:16:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/ 2023-11-28T19:16:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-11-28T19:16:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 727601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-11-28T19:16:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 278937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-11-28T19:16:09.737 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-11-28T19:16:09.738 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-11-28T19:16:09.738 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1113681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-11-28T19:16:09.738 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ 2023-11-28T19:16:09.738 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-11-28T19:16:09.738 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-11-28T19:16:09.738 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-11-28T19:16:09.738 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 95665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-11-28T19:16:09.738 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/ 2023-11-28T19:16:09.738 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-11-28T19:16:09.738 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 108649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-11-28T19:16:09.738 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ 2023-11-28T19:16:09.739 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 73441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-11-28T19:16:09.739 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-11-28T19:16:09.741 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/ 2023-11-28T19:16:09.741 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 150905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-11-28T19:16:09.741 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/ 2023-11-28T19:16:09.741 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 136721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-11-28T19:16:09.741 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/ 2023-11-28T19:16:09.741 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-11-28T19:16:09.741 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-11-28T19:16:09.742 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/ 2023-11-28T19:16:09.742 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-11-28T19:16:09.742 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 227897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-11-28T19:16:09.742 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 87081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-11-28T19:16:09.742 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-11-28T19:16:09.742 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 672049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-11-28T19:16:09.742 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/ 2023-11-28T19:16:09.742 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-11-28T19:16:09.742 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/ 2023-11-28T19:16:09.742 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-11-28T19:16:09.742 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 83985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-11-28T19:16:09.742 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/atp.ko 2023-11-28T19:16:09.743 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 189801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-11-28T19:16:09.743 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/ 2023-11-28T19:16:09.743 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-11-28T19:16:09.743 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 104241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-11-28T19:16:09.743 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/ 2023-11-28T19:16:09.743 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1052497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-11-28T19:16:09.743 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/ 2023-11-28T19:16:09.743 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-11-28T19:16:09.743 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/ 2023-11-28T19:16:09.743 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis190.ko 2023-11-28T19:16:09.743 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 63337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sis/sis900.ko 2023-11-28T19:16:09.744 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/ 2023-11-28T19:16:09.744 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-11-28T19:16:09.744 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-11-28T19:16:09.744 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 73409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-11-28T19:16:09.744 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 68177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-11-28T19:16:09.744 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/ 2023-11-28T19:16:09.744 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-11-28T19:16:09.744 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-11-28T19:16:09.744 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-11-28T19:16:09.744 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-11-28T19:16:09.744 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 487025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-11-28T19:16:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/ 2023-11-28T19:16:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 103337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/cassini.ko 2023-11-28T19:16:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 166097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/niu.ko 2023-11-28T19:16:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sungem.ko 2023-11-28T19:16:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-11-28T19:16:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/ 2023-11-28T19:16:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-11-28T19:16:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/ 2023-11-28T19:16:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 86529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/ti/tlan.ko 2023-11-28T19:16:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/ 2023-11-28T19:16:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 80273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-11-28T19:16:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 83633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-11-28T19:16:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/ 2023-11-28T19:16:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-11-28T19:16:09.746 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-11-28T19:16:09.746 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/ 2023-11-28T19:16:09.746 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-11-28T19:16:09.746 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/ 2023-11-28T19:16:09.746 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/defxx.ko 2023-11-28T19:16:09.746 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/ 2023-11-28T19:16:09.746 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 216985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/fddi/skfp/skfp.ko 2023-11-28T19:16:09.746 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 77345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/geneve.ko 2023-11-28T19:16:09.746 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/ 2023-11-28T19:16:09.746 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 235521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-11-28T19:16:09.746 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/ 2023-11-28T19:16:09.747 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ieee802154/fakelb.ko 2023-11-28T19:16:09.747 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ifb.ko 2023-11-28T19:16:09.747 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ 2023-11-28T19:16:09.747 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 83769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ipvlan/ipvlan.ko 2023-11-28T19:16:09.747 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvlan.ko 2023-11-28T19:16:09.747 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/macvtap.ko 2023-11-28T19:16:09.747 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/ 2023-11-28T19:16:09.747 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-11-28T19:16:09.747 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-11-28T19:16:09.747 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-gpio.ko 2023-11-28T19:16:09.747 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio/mdio-regmap.ko 2023-11-28T19:16:09.747 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mdio.ko 2023-11-28T19:16:09.748 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/mii.ko 2023-11-28T19:16:09.748 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/netconsole.ko 2023-11-28T19:16:09.748 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/nlmon.ko 2023-11-28T19:16:09.748 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/ 2023-11-28T19:16:09.748 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs-lynx.ko 2023-11-28T19:16:09.748 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-11-28T19:16:09.748 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ 2023-11-28T19:16:09.748 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/amd.ko 2023-11-28T19:16:09.748 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-11-28T19:16:09.748 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm7xxx.ko 2023-11-28T19:16:09.748 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/bcm87xx.ko 2023-11-28T19:16:09.749 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/broadcom.ko 2023-11-28T19:16:09.749 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/cicada.ko 2023-11-28T19:16:09.749 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/davicom.ko 2023-11-28T19:16:09.749 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/et1011c.ko 2023-11-28T19:16:09.749 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/icplus.ko 2023-11-28T19:16:09.749 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/lxt.ko 2023-11-28T19:16:09.749 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 82049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/marvell.ko 2023-11-28T19:16:09.749 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 76113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/micrel.ko 2023-11-28T19:16:09.749 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/national.ko 2023-11-28T19:16:09.749 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 97857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/phylink.ko 2023-11-28T19:16:09.749 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/qsemi.ko 2023-11-28T19:16:09.749 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/realtek.ko 2023-11-28T19:16:09.750 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/smsc.ko 2023-11-28T19:16:09.750 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/ste10Xp.ko 2023-11-28T19:16:09.750 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/phy/vitesse.ko 2023-11-28T19:16:09.750 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/ 2023-11-28T19:16:09.750 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/plip/plip.ko 2023-11-28T19:16:09.750 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ 2023-11-28T19:16:09.750 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/bsd_comp.ko 2023-11-28T19:16:09.750 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_async.ko 2023-11-28T19:16:09.750 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_deflate.ko 2023-11-28T19:16:09.750 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_mppe.ko 2023-11-28T19:16:09.751 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/ppp_synctty.ko 2023-11-28T19:16:09.751 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppoe.ko 2023-11-28T19:16:09.751 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pppox.ko 2023-11-28T19:16:09.751 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/ppp/pptp.ko 2023-11-28T19:16:09.751 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sb1000.ko 2023-11-28T19:16:09.751 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/ 2023-11-28T19:16:09.751 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/slip/slip.ko 2023-11-28T19:16:09.751 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/sungem_phy.ko 2023-11-28T19:16:09.751 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 64449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/tap.ko 2023-11-28T19:16:09.751 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/ 2023-11-28T19:16:09.751 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 106169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team.ko 2023-11-28T19:16:09.751 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_activebackup.ko 2023-11-28T19:16:09.752 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_broadcast.ko 2023-11-28T19:16:09.752 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-11-28T19:16:09.752 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_random.ko 2023-11-28T19:16:09.752 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-11-28T19:16:09.752 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 87017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/veth.ko 2023-11-28T19:16:09.752 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/ 2023-11-28T19:16:09.752 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 144297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-11-28T19:16:09.752 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/ 2023-11-28T19:16:09.752 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 297329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/vxlan/vxlan.ko 2023-11-28T19:16:09.752 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/ 2023-11-28T19:16:09.752 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 144585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/net/xen-netback/xen-netback.ko 2023-11-28T19:16:09.753 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ 2023-11-28T19:16:09.753 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ntb/ntb.ko 2023-11-28T19:16:09.753 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/ 2023-11-28T19:16:09.753 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/ 2023-11-28T19:16:09.753 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 265121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme-core.ko 2023-11-28T19:16:09.753 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 102209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/nvme/host/nvme.ko 2023-11-28T19:16:09.753 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/ 2023-11-28T19:16:09.753 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 133841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport.ko 2023-11-28T19:16:09.753 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_cs.ko 2023-11-28T19:16:09.753 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 84465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_pc.ko 2023-11-28T19:16:09.753 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/parport/parport_serial.ko 2023-11-28T19:16:09.753 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/ 2023-11-28T19:16:09.754 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/ 2023-11-28T19:16:09.754 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-11-28T19:16:09.754 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-11-28T19:16:09.754 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-11-28T19:16:09.754 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/pci-stub.ko 2023-11-28T19:16:09.754 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pci/xen-pcifront.ko 2023-11-28T19:16:09.754 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/ 2023-11-28T19:16:09.754 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/i82092.ko 2023-11-28T19:16:09.754 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 145809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia.ko 2023-11-28T19:16:09.754 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_core.ko 2023-11-28T19:16:09.754 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-11-28T19:16:09.755 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/pd6729.ko 2023-11-28T19:16:09.755 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 112889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pcmcia/yenta_socket.ko 2023-11-28T19:16:09.755 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/ 2023-11-28T19:16:09.755 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/ 2023-11-28T19:16:09.755 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-11-28T19:16:09.755 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/ 2023-11-28T19:16:09.755 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-11-28T19:16:09.755 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/ 2023-11-28T19:16:09.755 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/ 2023-11-28T19:16:09.755 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-11-28T19:16:09.755 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/ 2023-11-28T19:16:09.755 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/ 2023-11-28T19:16:09.756 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-11-28T19:16:09.756 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec.ko 2023-11-28T19:16:09.756 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-11-28T19:16:09.756 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-11-28T19:16:09.756 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-11-28T19:16:09.756 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-11-28T19:16:09.756 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-11-28T19:16:09.756 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ 2023-11-28T19:16:09.756 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acer-wmi.ko 2023-11-28T19:16:09.756 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/acerhdf.ko 2023-11-28T19:16:09.756 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/apple-gmux.ko 2023-11-28T19:16:09.756 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-laptop.ko 2023-11-28T19:16:09.757 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-11-28T19:16:09.757 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 127441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/asus-wmi.ko 2023-11-28T19:16:09.757 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/classmate-laptop.ko 2023-11-28T19:16:09.757 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-11-28T19:16:09.757 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-11-28T19:16:09.757 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-11-28T19:16:09.757 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-11-28T19:16:09.757 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/hdaps.ko 2023-11-28T19:16:09.757 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/ibm_rtl.ko 2023-11-28T19:16:09.757 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/ 2023-11-28T19:16:09.757 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-11-28T19:16:09.757 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-11-28T19:16:09.758 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/intel_ips.ko 2023-11-28T19:16:09.758 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/msi-wmi.ko 2023-11-28T19:16:09.758 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/mxm-wmi.ko 2023-11-28T19:16:09.758 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-11-28T19:16:09.758 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-laptop.ko 2023-11-28T19:16:09.758 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/samsung-q10.ko 2023-11-28T19:16:09.758 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/topstar-laptop.ko 2023-11-28T19:16:09.758 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-11-28T19:16:09.758 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/toshiba_haps.ko 2023-11-28T19:16:09.758 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi-bmof.ko 2023-11-28T19:16:09.758 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/platform/x86/wmi.ko 2023-11-28T19:16:09.759 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/ 2023-11-28T19:16:09.759 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ 2023-11-28T19:16:09.759 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_battery.ko 2023-11-28T19:16:09.759 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/88pm860x_charger.ko 2023-11-28T19:16:09.759 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq2415x_charger.ko 2023-11-28T19:16:09.759 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24190_charger.ko 2023-11-28T19:16:09.759 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/bq24735-charger.ko 2023-11-28T19:16:09.759 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-11-28T19:16:09.759 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9030_battery.ko 2023-11-28T19:16:09.759 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/da9052-battery.ko 2023-11-28T19:16:09.759 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2760_battery.ko 2023-11-28T19:16:09.759 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2780_battery.ko 2023-11-28T19:16:09.759 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2781_battery.ko 2023-11-28T19:16:09.760 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/ds2782_battery.ko 2023-11-28T19:16:09.760 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/gpio-charger.ko 2023-11-28T19:16:09.760 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/isp1704_charger.ko 2023-11-28T19:16:09.760 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/lp8727_charger.ko 2023-11-28T19:16:09.760 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max14577_charger.ko 2023-11-28T19:16:09.760 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17040_battery.ko 2023-11-28T19:16:09.760 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max17042_battery.ko 2023-11-28T19:16:09.760 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8903_charger.ko 2023-11-28T19:16:09.760 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/max8925_power.ko 2023-11-28T19:16:09.760 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/pcf50633-charger.ko 2023-11-28T19:16:09.760 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/sbs-battery.ko 2023-11-28T19:16:09.760 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/test_power.ko 2023-11-28T19:16:09.761 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/tps65090-charger.ko 2023-11-28T19:16:09.761 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_backup.ko 2023-11-28T19:16:09.761 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm831x_power.ko 2023-11-28T19:16:09.761 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/power/supply/wm8350_power.ko 2023-11-28T19:16:09.761 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/ 2023-11-28T19:16:09.761 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_common.ko 2023-11-28T19:16:09.761 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/powercap/intel_rapl_msr.ko 2023-11-28T19:16:09.761 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/ 2023-11-28T19:16:09.761 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/ 2023-11-28T19:16:09.761 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-gpio.ko 2023-11-28T19:16:09.761 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps-ldisc.ko 2023-11-28T19:16:09.761 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/clients/pps_parport.ko 2023-11-28T19:16:09.762 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/pps/pps_core.ko 2023-11-28T19:16:09.762 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ 2023-11-28T19:16:09.762 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp.ko 2023-11-28T19:16:09.762 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ptp/ptp_kvm.ko 2023-11-28T19:16:09.762 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/ 2023-11-28T19:16:09.762 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm80x.ko 2023-11-28T19:16:09.762 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-88pm860x.ko 2023-11-28T19:16:09.762 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-bq32k.ko 2023-11-28T19:16:09.762 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9052.ko 2023-11-28T19:16:09.762 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9055.ko 2023-11-28T19:16:09.762 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-da9063.ko 2023-11-28T19:16:09.762 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1286.ko 2023-11-28T19:16:09.763 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 68577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1307.ko 2023-11-28T19:16:09.763 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1374.ko 2023-11-28T19:16:09.763 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1511.ko 2023-11-28T19:16:09.763 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1553.ko 2023-11-28T19:16:09.763 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1672.ko 2023-11-28T19:16:09.763 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds1742.ko 2023-11-28T19:16:09.763 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds2404.ko 2023-11-28T19:16:09.763 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-ds3232.ko 2023-11-28T19:16:09.763 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-em3027.ko 2023-11-28T19:16:09.763 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-fm3130.ko 2023-11-28T19:16:09.763 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl12022.ko 2023-11-28T19:16:09.763 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-isl1208.ko 2023-11-28T19:16:09.763 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-lp8788.ko 2023-11-28T19:16:09.764 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m41t80.ko 2023-11-28T19:16:09.764 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t35.ko 2023-11-28T19:16:09.764 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t59.ko 2023-11-28T19:16:09.764 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-m48t86.ko 2023-11-28T19:16:09.764 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max6900.ko 2023-11-28T19:16:09.764 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8907.ko 2023-11-28T19:16:09.764 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8925.ko 2023-11-28T19:16:09.764 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8997.ko 2023-11-28T19:16:09.764 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-max8998.ko 2023-11-28T19:16:09.764 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-11-28T19:16:09.764 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-msm6242.ko 2023-11-28T19:16:09.764 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-palmas.ko 2023-11-28T19:16:09.765 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf2127.ko 2023-11-28T19:16:09.765 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf50633.ko 2023-11-28T19:16:09.765 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf85063.ko 2023-11-28T19:16:09.765 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8523.ko 2023-11-28T19:16:09.765 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8563.ko 2023-11-28T19:16:09.765 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-pcf8583.ko 2023-11-28T19:16:09.765 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rc5t583.ko 2023-11-28T19:16:09.765 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rp5c01.ko 2023-11-28T19:16:09.765 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rs5c372.ko 2023-11-28T19:16:09.765 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-11-28T19:16:09.765 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8025.ko 2023-11-28T19:16:09.765 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-rx8581.ko 2023-11-28T19:16:09.766 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-s35390a.ko 2023-11-28T19:16:09.766 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-11-28T19:16:09.766 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps6586x.ko 2023-11-28T19:16:09.766 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-tps65910.ko 2023-11-28T19:16:09.766 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm831x.ko 2023-11-28T19:16:09.766 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-wm8350.ko 2023-11-28T19:16:09.766 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/rtc/rtc-x1205.ko 2023-11-28T19:16:09.766 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ 2023-11-28T19:16:09.766 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 77617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-9xxx.ko 2023-11-28T19:16:09.766 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-sas.ko 2023-11-28T19:16:09.766 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/3w-xxxx.ko 2023-11-28T19:16:09.766 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 135185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/BusLogic.ko 2023-11-28T19:16:09.767 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/a100u2w.ko 2023-11-28T19:16:09.767 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/ 2023-11-28T19:16:09.767 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 272305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aacraid/aacraid.ko 2023-11-28T19:16:09.767 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 100617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/advansys.ko 2023-11-28T19:16:09.767 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/ 2023-11-28T19:16:09.767 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 356201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-11-28T19:16:09.767 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 295801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-11-28T19:16:09.767 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/ 2023-11-28T19:16:09.767 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 189185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-11-28T19:16:09.767 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/am53c974.ko 2023-11-28T19:16:09.767 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/ 2023-11-28T19:16:09.768 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 106881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-11-28T19:16:09.768 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/atp870u.ko 2023-11-28T19:16:09.768 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/ 2023-11-28T19:16:09.768 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 246985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-11-28T19:16:09.768 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/ 2023-11-28T19:16:09.768 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1171945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bfa/bfa.ko 2023-11-28T19:16:09.768 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/ 2023-11-28T19:16:09.768 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 237273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-11-28T19:16:09.768 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/ 2023-11-28T19:16:09.768 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 115369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-11-28T19:16:09.768 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ch.ko 2023-11-28T19:16:09.768 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/ 2023-11-28T19:16:09.768 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 308921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/csiostor/csiostor.ko 2023-11-28T19:16:09.769 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/ 2023-11-28T19:16:09.769 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-11-28T19:16:09.769 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 76145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-11-28T19:16:09.769 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-11-28T19:16:09.769 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 101449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-11-28T19:16:09.769 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 146689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-11-28T19:16:09.769 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 75553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dc395x.ko 2023-11-28T19:16:09.769 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/dmx3191d.ko 2023-11-28T19:16:09.769 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/ 2023-11-28T19:16:09.769 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 212425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esas2r/esas2r.ko 2023-11-28T19:16:09.769 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/esp_scsi.ko 2023-11-28T19:16:09.769 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/ 2023-11-28T19:16:09.770 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/fcoe.ko 2023-11-28T19:16:09.770 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 158505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-11-28T19:16:09.770 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fdomain.ko 2023-11-28T19:16:09.770 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/ 2023-11-28T19:16:09.770 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 263489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/fnic/fnic.ko 2023-11-28T19:16:09.770 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 201817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hpsa.ko 2023-11-28T19:16:09.770 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hptiop.ko 2023-11-28T19:16:09.770 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/hv_storvsc.ko 2023-11-28T19:16:09.770 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/imm.ko 2023-11-28T19:16:09.770 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/initio.ko 2023-11-28T19:16:09.770 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 266537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ipr.ko 2023-11-28T19:16:09.770 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 101881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ips.ko 2023-11-28T19:16:09.771 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/ 2023-11-28T19:16:09.771 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 317153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/isci/isci.ko 2023-11-28T19:16:09.771 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-11-28T19:16:09.771 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/iscsi_tcp.ko 2023-11-28T19:16:09.771 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/ 2023-11-28T19:16:09.771 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 314865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libfc/libfc.ko 2023-11-28T19:16:09.771 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 145585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi.ko 2023-11-28T19:16:09.771 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libiscsi_tcp.ko 2023-11-28T19:16:09.771 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/ 2023-11-28T19:16:09.771 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 216665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/libsas/libsas.ko 2023-11-28T19:16:09.771 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/ 2023-11-28T19:16:09.771 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 2197249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/lpfc/lpfc.ko 2023-11-28T19:16:09.772 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/ 2023-11-28T19:16:09.772 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 73569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-11-28T19:16:09.772 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-11-28T19:16:09.772 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 310617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-11-28T19:16:09.772 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 84721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/megaraid.ko 2023-11-28T19:16:09.772 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/ 2023-11-28T19:16:09.772 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 659825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-11-28T19:16:09.772 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/ 2023-11-28T19:16:09.772 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 119561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvsas/mvsas.ko 2023-11-28T19:16:09.772 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/mvumi.ko 2023-11-28T19:16:09.772 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/ 2023-11-28T19:16:09.772 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 81625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-11-28T19:16:09.772 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-11-28T19:16:09.773 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-11-28T19:16:09.773 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-11-28T19:16:09.773 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/ 2023-11-28T19:16:09.773 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 364105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-11-28T19:16:09.773 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 123617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/pmcraid.ko 2023-11-28T19:16:09.773 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ppa.ko 2023-11-28T19:16:09.773 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla1280.ko 2023-11-28T19:16:09.773 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/ 2023-11-28T19:16:09.773 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1876689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-11-28T19:16:09.773 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 85289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-11-28T19:16:09.773 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/ 2023-11-28T19:16:09.773 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 559033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-11-28T19:16:09.774 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/qlogicfas408.ko 2023-11-28T19:16:09.774 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/raid_class.ko 2023-11-28T19:16:09.774 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 238761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_debug.ko 2023-11-28T19:16:09.774 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 173937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_fc.ko 2023-11-28T19:16:09.774 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 279313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-11-28T19:16:09.774 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 97729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_sas.ko 2023-11-28T19:16:09.774 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 73881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_spi.ko 2023-11-28T19:16:09.774 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/scsi_transport_srp.ko 2023-11-28T19:16:09.774 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/ses.ko 2023-11-28T19:16:09.774 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 115889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/st.ko 2023-11-28T19:16:09.774 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/stex.ko 2023-11-28T19:16:09.774 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/ 2023-11-28T19:16:09.775 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 162121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-11-28T19:16:09.775 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/virtio_scsi.ko 2023-11-28T19:16:09.775 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/vmw_pvscsi.ko 2023-11-28T19:16:09.775 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/wd719x.ko 2023-11-28T19:16:09.775 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/scsi/xen-scsifront.ko 2023-11-28T19:16:09.775 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ 2023-11-28T19:16:09.775 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 129441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ssb/ssb.ko 2023-11-28T19:16:09.775 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/ 2023-11-28T19:16:09.775 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/ 2023-11-28T19:16:09.775 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 736601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-11-28T19:16:09.775 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/ 2023-11-28T19:16:09.775 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/loopback/tcm_loop.ko 2023-11-28T19:16:09.776 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_file.ko 2023-11-28T19:16:09.776 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_iblock.ko 2023-11-28T19:16:09.776 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 930257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_mod.ko 2023-11-28T19:16:09.776 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_pscsi.ko 2023-11-28T19:16:09.776 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 122521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/target_core_user.ko 2023-11-28T19:16:09.776 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/ 2023-11-28T19:16:09.776 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 75593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-11-28T19:16:09.776 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/ 2023-11-28T19:16:09.776 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/ 2023-11-28T19:16:09.776 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/ 2023-11-28T19:16:09.776 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-11-28T19:16:09.776 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-11-28T19:16:09.777 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-11-28T19:16:09.777 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-11-28T19:16:09.777 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-11-28T19:16:09.777 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-11-28T19:16:09.777 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-11-28T19:16:09.777 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-11-28T19:16:09.777 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-11-28T19:16:09.777 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-11-28T19:16:09.777 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-11-28T19:16:09.777 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-11-28T19:16:09.777 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-11-28T19:16:09.777 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-11-28T19:16:09.777 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-11-28T19:16:09.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-11-28T19:16:09.778 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ 2023-11-28T19:16:09.778 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ 2023-11-28T19:16:09.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-11-28T19:16:09.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/moxa.ko 2023-11-28T19:16:09.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 50953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/mxser.ko 2023-11-28T19:16:09.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 108601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_gsm.ko 2023-11-28T19:16:09.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/n_hdlc.ko 2023-11-28T19:16:09.778 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/nozomi.ko 2023-11-28T19:16:09.778 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/ 2023-11-28T19:16:09.778 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/ 2023-11-28T19:16:09.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-11-28T19:16:09.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-11-28T19:16:09.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-11-28T19:16:09.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/altera_uart.ko 2023-11-28T19:16:09.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/arc_uart.ko 2023-11-28T19:16:09.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 72425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-11-28T19:16:09.779 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/ 2023-11-28T19:16:09.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 103073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/jsm/jsm.ko 2023-11-28T19:16:09.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/rp2.ko 2023-11-28T19:16:09.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/tty/serial/sc16is7xx.ko 2023-11-28T19:16:09.779 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/ 2023-11-28T19:16:09.779 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ 2023-11-28T19:16:09.779 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 531265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/core/ufshcd-core.ko 2023-11-28T19:16:09.780 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ 2023-11-28T19:16:09.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-11-28T19:16:09.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-11-28T19:16:09.780 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/ 2023-11-28T19:16:09.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio.ko 2023-11-28T19:16:09.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_aec.ko 2023-11-28T19:16:09.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_cif.ko 2023-11-28T19:16:09.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_dmem_genirq.ko 2023-11-28T19:16:09.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_mf624.ko 2023-11-28T19:16:09.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_netx.ko 2023-11-28T19:16:09.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pci_generic.ko 2023-11-28T19:16:09.780 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-11-28T19:16:09.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/uio/uio_sercos3.ko 2023-11-28T19:16:09.781 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/ 2023-11-28T19:16:09.781 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/ 2023-11-28T19:16:09.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 73297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/c67x00/c67x00.ko 2023-11-28T19:16:09.781 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ 2023-11-28T19:16:09.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 144377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-11-28T19:16:09.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-11-28T19:16:09.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-11-28T19:16:09.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-11-28T19:16:09.781 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/ 2023-11-28T19:16:09.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 87089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-acm.ko 2023-11-28T19:16:09.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/cdc-wdm.ko 2023-11-28T19:16:09.781 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usblp.ko 2023-11-28T19:16:09.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 89857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/class/usbtmc.ko 2023-11-28T19:16:09.782 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ 2023-11-28T19:16:09.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/common/ulpi.ko 2023-11-28T19:16:09.782 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/ 2023-11-28T19:16:09.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-11-28T19:16:09.782 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/ 2023-11-28T19:16:09.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-11-28T19:16:09.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-11-28T19:16:09.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 448505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/dwc3/dwc3.ko 2023-11-28T19:16:09.782 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/ 2023-11-28T19:16:09.782 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/ 2023-11-28T19:16:09.782 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_ether.ko 2023-11-28T19:16:09.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/u_serial.ko 2023-11-28T19:16:09.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-11-28T19:16:09.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-11-28T19:16:09.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-11-28T19:16:09.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-11-28T19:16:09.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 92489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-11-28T19:16:09.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-11-28T19:16:09.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 122081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-11-28T19:16:09.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-11-28T19:16:09.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-11-28T19:16:09.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-11-28T19:16:09.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-11-28T19:16:09.783 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 85609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-11-28T19:16:09.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-11-28T19:16:09.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 58113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-11-28T19:16:09.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-11-28T19:16:09.784 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/ 2023-11-28T19:16:09.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-11-28T19:16:09.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-11-28T19:16:09.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-11-28T19:16:09.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-11-28T19:16:09.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-11-28T19:16:09.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-11-28T19:16:09.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-11-28T19:16:09.784 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-11-28T19:16:09.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-11-28T19:16:09.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-11-28T19:16:09.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-11-28T19:16:09.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-11-28T19:16:09.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 62185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-11-28T19:16:09.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-11-28T19:16:09.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 161225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/libcomposite.ko 2023-11-28T19:16:09.785 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/ 2023-11-28T19:16:09.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-11-28T19:16:09.785 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/ 2023-11-28T19:16:09.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 157681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-11-28T19:16:09.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-11-28T19:16:09.785 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-11-28T19:16:09.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 69705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-11-28T19:16:09.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 56033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-11-28T19:16:09.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 76057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2272.ko 2023-11-28T19:16:09.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 75073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/net2280.ko 2023-11-28T19:16:09.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 73169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-11-28T19:16:09.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 65809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-11-28T19:16:09.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-11-28T19:16:09.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 81505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-11-28T19:16:09.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 156073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-11-28T19:16:09.786 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ 2023-11-28T19:16:09.786 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/bcma-hcd.ko 2023-11-28T19:16:09.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 80113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/isp116x-hcd.ko 2023-11-28T19:16:09.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 87353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-11-28T19:16:09.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-11-28T19:16:09.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811-hcd.ko 2023-11-28T19:16:09.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/sl811_cs.ko 2023-11-28T19:16:09.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/ssb-hcd.ko 2023-11-28T19:16:09.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-11-28T19:16:09.787 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/ 2023-11-28T19:16:09.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/mdc800.ko 2023-11-28T19:16:09.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/image/microtek.ko 2023-11-28T19:16:09.787 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ 2023-11-28T19:16:09.787 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/adutux.ko 2023-11-28T19:16:09.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/appledisplay.ko 2023-11-28T19:16:09.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-11-28T19:16:09.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/cytherm.ko 2023-11-28T19:16:09.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ehset.ko 2023-11-28T19:16:09.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi26.ko 2023-11-28T19:16:09.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/emi62.ko 2023-11-28T19:16:09.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ezusb.ko 2023-11-28T19:16:09.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/idmouse.ko 2023-11-28T19:16:09.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/iowarrior.ko 2023-11-28T19:16:09.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/isight_firmware.ko 2023-11-28T19:16:09.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/ldusb.ko 2023-11-28T19:16:09.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/legousbtower.ko 2023-11-28T19:16:09.788 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/lvstest.ko 2023-11-28T19:16:09.789 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/ 2023-11-28T19:16:09.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 64841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-11-28T19:16:09.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/trancevibrator.ko 2023-11-28T19:16:09.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usb3503.ko 2023-11-28T19:16:09.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usblcd.ko 2023-11-28T19:16:09.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbsevseg.ko 2023-11-28T19:16:09.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/usbtest.ko 2023-11-28T19:16:09.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/uss720.ko 2023-11-28T19:16:09.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/misc/yurex.ko 2023-11-28T19:16:09.789 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/ 2023-11-28T19:16:09.789 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 72953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/mon/usbmon.ko 2023-11-28T19:16:09.790 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/ 2023-11-28T19:16:09.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 301697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/musb/musb_hdrc.ko 2023-11-28T19:16:09.790 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/ 2023-11-28T19:16:09.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-generic.ko 2023-11-28T19:16:09.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-11-28T19:16:09.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-isp1301.ko 2023-11-28T19:16:09.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/phy/phy-tahvo.ko 2023-11-28T19:16:09.790 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ 2023-11-28T19:16:09.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/aircable.ko 2023-11-28T19:16:09.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ark3116.ko 2023-11-28T19:16:09.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/belkin_sa.ko 2023-11-28T19:16:09.790 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ch341.ko 2023-11-28T19:16:09.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cp210x.ko 2023-11-28T19:16:09.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cyberjack.ko 2023-11-28T19:16:09.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 58217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/cypress_m8.ko 2023-11-28T19:16:09.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/digi_acceleport.ko 2023-11-28T19:16:09.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/empeg.ko 2023-11-28T19:16:09.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/f81232.ko 2023-11-28T19:16:09.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 175137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ftdi_sio.ko 2023-11-28T19:16:09.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/garmin_gps.ko 2023-11-28T19:16:09.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 137081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_edgeport.ko 2023-11-28T19:16:09.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 124833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/io_ti.ko 2023-11-28T19:16:09.791 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipaq.ko 2023-11-28T19:16:09.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ipw.ko 2023-11-28T19:16:09.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ir-usb.ko 2023-11-28T19:16:09.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 58233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-11-28T19:16:09.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 107521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan.ko 2023-11-28T19:16:09.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/keyspan_pda.ko 2023-11-28T19:16:09.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kl5kusb105.ko 2023-11-28T19:16:09.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/kobil_sct.ko 2023-11-28T19:16:09.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mct_u232.ko 2023-11-28T19:16:09.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/metro-usb.ko 2023-11-28T19:16:09.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7720.ko 2023-11-28T19:16:09.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 78217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mos7840.ko 2023-11-28T19:16:09.792 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 56337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/mxuport.ko 2023-11-28T19:16:09.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/navman.ko 2023-11-28T19:16:09.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/omninet.ko 2023-11-28T19:16:09.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/opticon.ko 2023-11-28T19:16:09.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 191137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/option.ko 2023-11-28T19:16:09.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/oti6858.ko 2023-11-28T19:16:09.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/pl2303.ko 2023-11-28T19:16:09.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcaux.ko 2023-11-28T19:16:09.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/qcserial.ko 2023-11-28T19:16:09.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/quatech2.ko 2023-11-28T19:16:09.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/safe_serial.ko 2023-11-28T19:16:09.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 51625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/sierra.ko 2023-11-28T19:16:09.793 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/spcp8x5.ko 2023-11-28T19:16:09.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ssu100.ko 2023-11-28T19:16:09.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/symbolserial.ko 2023-11-28T19:16:09.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-11-28T19:16:09.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-11-28T19:16:09.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_debug.ko 2023-11-28T19:16:09.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usb_wwan.ko 2023-11-28T19:16:09.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 125609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/usbserial.ko 2023-11-28T19:16:09.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/visor.ko 2023-11-28T19:16:09.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/whiteheat.ko 2023-11-28T19:16:09.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/wishbone-serial.ko 2023-11-28T19:16:09.794 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/serial/xsens_mt.ko 2023-11-28T19:16:09.794 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ 2023-11-28T19:16:09.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 52913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/uas.ko 2023-11-28T19:16:09.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-alauda.ko 2023-11-28T19:16:09.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-cypress.ko 2023-11-28T19:16:09.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-datafab.ko 2023-11-28T19:16:09.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-11-28T19:16:09.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-freecom.ko 2023-11-28T19:16:09.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-isd200.ko 2023-11-28T19:16:09.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-11-28T19:16:09.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-karma.ko 2023-11-28T19:16:09.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-onetouch.ko 2023-11-28T19:16:09.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-realtek.ko 2023-11-28T19:16:09.795 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr09.ko 2023-11-28T19:16:09.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-sddr55.ko 2023-11-28T19:16:09.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/ums-usbat.ko 2023-11-28T19:16:09.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 179969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/storage/usb-storage.ko 2023-11-28T19:16:09.796 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/ 2023-11-28T19:16:09.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-core.ko 2023-11-28T19:16:09.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 72177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/usbip-host.ko 2023-11-28T19:16:09.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 107001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-11-28T19:16:09.796 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/ 2023-11-28T19:16:09.796 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/ 2023-11-28T19:16:09.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 154297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-11-28T19:16:09.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/pci/vfio-pci.ko 2023-11-28T19:16:09.796 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 108737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio.ko 2023-11-28T19:16:09.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 77609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-11-28T19:16:09.797 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/ 2023-11-28T19:16:09.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 113785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost.ko 2023-11-28T19:16:09.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_iotlb.ko 2023-11-28T19:16:09.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 58089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_net.ko 2023-11-28T19:16:09.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 89249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/vhost/vhost_scsi.ko 2023-11-28T19:16:09.797 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/ 2023-11-28T19:16:09.797 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/ 2023-11-28T19:16:09.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-11-28T19:16:09.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/aat2870_bl.ko 2023-11-28T19:16:09.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp5520_bl.ko 2023-11-28T19:16:09.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8860_bl.ko 2023-11-28T19:16:09.797 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/adp8870_bl.ko 2023-11-28T19:16:09.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/apple_bl.ko 2023-11-28T19:16:09.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/as3711_bl.ko 2023-11-28T19:16:09.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/bd6107.ko 2023-11-28T19:16:09.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da903x_bl.ko 2023-11-28T19:16:09.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/da9052_bl.ko 2023-11-28T19:16:09.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/gpio_backlight.ko 2023-11-28T19:16:09.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/kb3886_bl.ko 2023-11-28T19:16:09.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lcd.ko 2023-11-28T19:16:09.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3533_bl.ko 2023-11-28T19:16:09.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lm3639_bl.ko 2023-11-28T19:16:09.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/lv5207lp.ko 2023-11-28T19:16:09.798 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/max8925_bl.ko 2023-11-28T19:16:09.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pandora_bl.ko 2023-11-28T19:16:09.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-11-28T19:16:09.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/platform_lcd.ko 2023-11-28T19:16:09.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/video/backlight/wm831x_bl.ko 2023-11-28T19:16:09.799 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/ 2023-11-28T19:16:09.799 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ 2023-11-28T19:16:09.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2482.ko 2023-11-28T19:16:09.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/ds2490.ko 2023-11-28T19:16:09.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/matrox_w1.ko 2023-11-28T19:16:09.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/masters/w1-gpio.ko 2023-11-28T19:16:09.799 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/ 2023-11-28T19:16:09.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-11-28T19:16:09.799 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-11-28T19:16:09.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-11-28T19:16:09.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-11-28T19:16:09.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14153 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-11-28T19:16:09.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-11-28T19:16:09.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-11-28T19:16:09.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-11-28T19:16:09.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-11-28T19:16:09.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_smem.ko 2023-11-28T19:16:09.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 56425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/slaves/w1_therm.ko 2023-11-28T19:16:09.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 102673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/w1/wire.ko 2023-11-28T19:16:09.800 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ 2023-11-28T19:16:09.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/acquirewdt.ko 2023-11-28T19:16:09.800 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/advantechwdt.ko 2023-11-28T19:16:09.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim1535_wdt.ko 2023-11-28T19:16:09.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/alim7101_wdt.ko 2023-11-28T19:16:09.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/cpu5wdt.ko 2023-11-28T19:16:09.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9052_wdt.ko 2023-11-28T19:16:09.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9055_wdt.ko 2023-11-28T19:16:09.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/da9063_wdt.ko 2023-11-28T19:16:09.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/dw_wdt.ko 2023-11-28T19:16:09.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/eurotechwdt.ko 2023-11-28T19:16:09.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/f71808e_wdt.ko 2023-11-28T19:16:09.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/hpwdt.ko 2023-11-28T19:16:09.801 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/i6300esb.ko 2023-11-28T19:16:09.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-11-28T19:16:09.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/iTCO_wdt.ko 2023-11-28T19:16:09.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ib700wdt.ko 2023-11-28T19:16:09.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ibmasr.ko 2023-11-28T19:16:09.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-11-28T19:16:09.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it8712f_wdt.ko 2023-11-28T19:16:09.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/it87_wdt.ko 2023-11-28T19:16:09.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/kempld_wdt.ko 2023-11-28T19:16:09.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/machzwd.ko 2023-11-28T19:16:09.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/mena21_wdt.ko 2023-11-28T19:16:09.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-11-28T19:16:09.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/nv_tco.ko 2023-11-28T19:16:09.802 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-11-28T19:16:09.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22265 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pc87413_wdt.ko 2023-11-28T19:16:09.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_pci.ko 2023-11-28T19:16:09.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/pcwd_usb.ko 2023-11-28T19:16:09.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/retu_wdt.ko 2023-11-28T19:16:09.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-11-28T19:16:09.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-11-28T19:16:09.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-11-28T19:16:09.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sc1200wdt.ko 2023-11-28T19:16:09.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sch311x_wdt.ko 2023-11-28T19:16:09.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-11-28T19:16:09.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/softdog.ko 2023-11-28T19:16:09.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/sp5100_tco.ko 2023-11-28T19:16:09.803 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/twl4030_wdt.ko 2023-11-28T19:16:09.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/via_wdt.ko 2023-11-28T19:16:09.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-11-28T19:16:09.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83877f_wdt.ko 2023-11-28T19:16:09.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/w83977f_wdt.ko 2023-11-28T19:16:09.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wafer5823wdt.ko 2023-11-28T19:16:09.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wdt_pci.ko 2023-11-28T19:16:09.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm831x_wdt.ko 2023-11-28T19:16:09.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/wm8350_wdt.ko 2023-11-28T19:16:09.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/watchdog/xen_wdt.ko 2023-11-28T19:16:09.804 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/ 2023-11-28T19:16:09.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-evtchn.ko 2023-11-28T19:16:09.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntalloc.ko 2023-11-28T19:16:09.804 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-gntdev.ko 2023-11-28T19:16:09.805 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/ 2023-11-28T19:16:09.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 176377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-11-28T19:16:09.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-privcmd.ko 2023-11-28T19:16:09.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 71249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xen-scsiback.ko 2023-11-28T19:16:09.805 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/ 2023-11-28T19:16:09.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/drivers/xen/xenfs/xenfs.ko 2023-11-28T19:16:09.805 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ 2023-11-28T19:16:09.805 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/ 2023-11-28T19:16:09.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 166425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/9p/9p.ko 2023-11-28T19:16:09.805 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/ 2023-11-28T19:16:09.805 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/adfs/adfs.ko 2023-11-28T19:16:09.805 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/ 2023-11-28T19:16:09.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 163593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/affs/affs.ko 2023-11-28T19:16:09.806 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/ 2023-11-28T19:16:09.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 932817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/afs/kafs.ko 2023-11-28T19:16:09.806 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/ 2023-11-28T19:16:09.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 101057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/autofs/autofs4.ko 2023-11-28T19:16:09.806 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/ 2023-11-28T19:16:09.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 64545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/befs/befs.ko 2023-11-28T19:16:09.806 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/ 2023-11-28T19:16:09.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/bfs/bfs.ko 2023-11-28T19:16:09.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/binfmt_misc.ko 2023-11-28T19:16:09.806 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/ 2023-11-28T19:16:09.806 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 3402729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/btrfs/btrfs.ko 2023-11-28T19:16:09.807 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/ 2023-11-28T19:16:09.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 306009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cachefiles/cachefiles.ko 2023-11-28T19:16:09.807 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ 2023-11-28T19:16:09.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1333017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ceph/ceph.ko 2023-11-28T19:16:09.807 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/ 2023-11-28T19:16:09.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 100801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/coda/coda.ko 2023-11-28T19:16:09.807 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/ 2023-11-28T19:16:09.807 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 108393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/configfs/configfs.ko 2023-11-28T19:16:09.807 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/ 2023-11-28T19:16:09.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 29625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/cramfs/cramfs.ko 2023-11-28T19:16:09.808 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/ 2023-11-28T19:16:09.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 642513 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/dlm/dlm.ko 2023-11-28T19:16:09.808 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/ 2023-11-28T19:16:09.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/efs/efs.ko 2023-11-28T19:16:09.808 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/ 2023-11-28T19:16:09.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1505025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/f2fs/f2fs.ko 2023-11-28T19:16:09.808 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/ 2023-11-28T19:16:09.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fat/msdos.ko 2023-11-28T19:16:09.808 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/ 2023-11-28T19:16:09.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/freevxfs/freevxfs.ko 2023-11-28T19:16:09.808 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/ 2023-11-28T19:16:09.808 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 226481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fscache/fscache.ko 2023-11-28T19:16:09.809 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/ 2023-11-28T19:16:09.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/fuse/cuse.ko 2023-11-28T19:16:09.809 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/ 2023-11-28T19:16:09.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1231529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/gfs2/gfs2.ko 2023-11-28T19:16:09.809 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/ 2023-11-28T19:16:09.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 141209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfs/hfs.ko 2023-11-28T19:16:09.809 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/ 2023-11-28T19:16:09.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 222817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hfsplus/hfsplus.ko 2023-11-28T19:16:09.809 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/ 2023-11-28T19:16:09.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 192329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/hpfs/hpfs.ko 2023-11-28T19:16:09.809 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/ 2023-11-28T19:16:09.809 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 74065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/isofs/isofs.ko 2023-11-28T19:16:09.809 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/ 2023-11-28T19:16:09.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 419497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/jfs/jfs.ko 2023-11-28T19:16:09.810 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/ 2023-11-28T19:16:09.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 280313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/lockd/lockd.ko 2023-11-28T19:16:09.810 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/ 2023-11-28T19:16:09.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 89193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/minix/minix.ko 2023-11-28T19:16:09.810 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/ 2023-11-28T19:16:09.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 124649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/netfs/netfs.ko 2023-11-28T19:16:09.810 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/ 2023-11-28T19:16:09.810 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/ 2023-11-28T19:16:09.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 81449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-11-28T19:16:09.810 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/ 2023-11-28T19:16:09.810 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 59449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-11-28T19:16:09.811 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/ 2023-11-28T19:16:09.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 117465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-11-28T19:16:09.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1055721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfs.ko 2023-11-28T19:16:09.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv2.ko 2023-11-28T19:16:09.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 120177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv3.ko 2023-11-28T19:16:09.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 2042137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs/nfsv4.ko 2023-11-28T19:16:09.811 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/ 2023-11-28T19:16:09.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/grace.ko 2023-11-28T19:16:09.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfs_common/nfs_acl.ko 2023-11-28T19:16:09.811 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/ 2023-11-28T19:16:09.811 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1516873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nfsd/nfsd.ko 2023-11-28T19:16:09.811 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/ 2023-11-28T19:16:09.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 592833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nilfs2/nilfs2.ko 2023-11-28T19:16:09.812 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/ 2023-11-28T19:16:09.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-celtic.ko 2023-11-28T19:16:09.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-centeuro.ko 2023-11-28T19:16:09.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-croatian.ko 2023-11-28T19:16:09.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-cyrillic.ko 2023-11-28T19:16:09.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-gaelic.ko 2023-11-28T19:16:09.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-greek.ko 2023-11-28T19:16:09.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-iceland.ko 2023-11-28T19:16:09.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-inuit.ko 2023-11-28T19:16:09.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-roman.ko 2023-11-28T19:16:09.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-romanian.ko 2023-11-28T19:16:09.812 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/mac-turkish.ko 2023-11-28T19:16:09.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ascii.ko 2023-11-28T19:16:09.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1250.ko 2023-11-28T19:16:09.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1251.ko 2023-11-28T19:16:09.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp1255.ko 2023-11-28T19:16:09.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp737.ko 2023-11-28T19:16:09.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp775.ko 2023-11-28T19:16:09.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp850.ko 2023-11-28T19:16:09.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp852.ko 2023-11-28T19:16:09.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp855.ko 2023-11-28T19:16:09.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp857.ko 2023-11-28T19:16:09.813 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp860.ko 2023-11-28T19:16:09.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp861.ko 2023-11-28T19:16:09.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp862.ko 2023-11-28T19:16:09.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp863.ko 2023-11-28T19:16:09.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp864.ko 2023-11-28T19:16:09.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp865.ko 2023-11-28T19:16:09.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp866.ko 2023-11-28T19:16:09.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp869.ko 2023-11-28T19:16:09.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp874.ko 2023-11-28T19:16:09.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 94137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp932.ko 2023-11-28T19:16:09.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 142673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp936.ko 2023-11-28T19:16:09.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 165745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp949.ko 2023-11-28T19:16:09.814 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 118121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_cp950.ko 2023-11-28T19:16:09.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_euc-jp.ko 2023-11-28T19:16:09.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-1.ko 2023-11-28T19:16:09.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-13.ko 2023-11-28T19:16:09.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-14.ko 2023-11-28T19:16:09.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-15.ko 2023-11-28T19:16:09.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-2.ko 2023-11-28T19:16:09.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-3.ko 2023-11-28T19:16:09.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-4.ko 2023-11-28T19:16:09.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-5.ko 2023-11-28T19:16:09.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-6.ko 2023-11-28T19:16:09.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-7.ko 2023-11-28T19:16:09.815 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_iso8859-9.ko 2023-11-28T19:16:09.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-r.ko 2023-11-28T19:16:09.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-ru.ko 2023-11-28T19:16:09.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_koi8-u.ko 2023-11-28T19:16:09.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_ucs2_utils.ko 2023-11-28T19:16:09.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/nls/nls_utf8.ko 2023-11-28T19:16:09.816 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ 2023-11-28T19:16:09.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 219417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ntfs/ntfs.ko 2023-11-28T19:16:09.816 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ 2023-11-28T19:16:09.816 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ 2023-11-28T19:16:09.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 244409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-11-28T19:16:09.816 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ 2023-11-28T19:16:09.816 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 440737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-11-28T19:16:09.817 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ 2023-11-28T19:16:09.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-11-28T19:16:09.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 2592433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2.ko 2023-11-28T19:16:09.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-11-28T19:16:09.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-11-28T19:16:09.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-11-28T19:16:09.817 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/ 2023-11-28T19:16:09.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/omfs/omfs.ko 2023-11-28T19:16:09.817 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/ 2023-11-28T19:16:09.817 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 352161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/overlayfs/overlay.ko 2023-11-28T19:16:09.817 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ 2023-11-28T19:16:09.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/pstore/ramoops.ko 2023-11-28T19:16:09.818 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/ 2023-11-28T19:16:09.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx4/qnx4.ko 2023-11-28T19:16:09.818 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/ 2023-11-28T19:16:09.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 46689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/qnx6/qnx6.ko 2023-11-28T19:16:09.818 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/ 2023-11-28T19:16:09.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_tree.ko 2023-11-28T19:16:09.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v1.ko 2023-11-28T19:16:09.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/quota/quota_v2.ko 2023-11-28T19:16:09.818 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/ 2023-11-28T19:16:09.818 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 532673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/reiserfs/reiserfs.ko 2023-11-28T19:16:09.818 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/ 2023-11-28T19:16:09.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/romfs/romfs.ko 2023-11-28T19:16:09.819 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/ 2023-11-28T19:16:09.819 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/ 2023-11-28T19:16:09.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 2668401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/client/cifs.ko 2023-11-28T19:16:09.819 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/ 2023-11-28T19:16:09.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_arc4.ko 2023-11-28T19:16:09.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/smb/common/cifs_md4.ko 2023-11-28T19:16:09.819 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/ 2023-11-28T19:16:09.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 134641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/squashfs/squashfs.ko 2023-11-28T19:16:09.819 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/ 2023-11-28T19:16:09.819 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 90721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/sysv/sysv.ko 2023-11-28T19:16:09.819 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/ 2023-11-28T19:16:09.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 247737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/udf/udf.ko 2023-11-28T19:16:09.820 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ 2023-11-28T19:16:09.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 162497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/ufs/ufs.ko 2023-11-28T19:16:09.820 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/ 2023-11-28T19:16:09.820 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 4011017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/fs/xfs/xfs.ko 2023-11-28T19:16:09.852 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/ 2023-11-28T19:16:09.852 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/ 2023-11-28T19:16:09.853 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 75489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/locking/locktorture.ko 2023-11-28T19:16:09.853 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/ 2023-11-28T19:16:09.853 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/time/test_udelay.ko 2023-11-28T19:16:09.853 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/kernel/torture.ko 2023-11-28T19:16:09.853 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ 2023-11-28T19:16:09.853 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 6833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc-itu-t.ko 2023-11-28T19:16:09.853 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 6529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc7.ko 2023-11-28T19:16:09.853 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crc8.ko 2023-11-28T19:16:09.853 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/ 2023-11-28T19:16:09.853 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libarc4.ko 2023-11-28T19:16:09.853 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/crypto/libdes.ko 2023-11-28T19:16:09.853 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/interval_tree_test.ko 2023-11-28T19:16:09.854 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/libcrc32c.ko 2023-11-28T19:16:09.854 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lru_cache.ko 2023-11-28T19:16:09.854 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/ 2023-11-28T19:16:09.854 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4_compress.ko 2023-11-28T19:16:09.854 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/lz4/lz4hc_compress.ko 2023-11-28T19:16:09.854 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/ 2023-11-28T19:16:09.854 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 6617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/math/cordic.ko 2023-11-28T19:16:09.854 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/memory-notifier-error-inject.ko 2023-11-28T19:16:09.854 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/notifier-error-inject.ko 2023-11-28T19:16:09.854 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/percpu_test.ko 2023-11-28T19:16:09.854 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/pm-notifier-error-inject.ko 2023-11-28T19:16:09.855 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/ 2023-11-28T19:16:09.855 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 143433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/raid6/raid6_pq.ko 2023-11-28T19:16:09.855 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/rbtree_test.ko 2023-11-28T19:16:09.855 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/ 2023-11-28T19:16:09.855 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/reed_solomon/reed_solomon.ko 2023-11-28T19:16:09.855 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-kstrtox.ko 2023-11-28T19:16:09.855 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test-string_helpers.ko 2023-11-28T19:16:09.855 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 4760425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_bpf.ko 2023-11-28T19:16:09.855 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_firmware.ko 2023-11-28T19:16:09.855 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 6369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_module.ko 2023-11-28T19:16:09.855 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/test_user_copy.ko 2023-11-28T19:16:09.855 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_bm.ko 2023-11-28T19:16:09.855 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_fsm.ko 2023-11-28T19:16:09.856 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/ts_kmp.ko 2023-11-28T19:16:09.856 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/ 2023-11-28T19:16:09.856 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/lib/xz/xz_dec_test.ko 2023-11-28T19:16:09.856 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/ 2023-11-28T19:16:09.856 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/mm/hwpoison-inject.ko 2023-11-28T19:16:09.856 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ 2023-11-28T19:16:09.856 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/ 2023-11-28T19:16:09.856 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/6lowpan.ko 2023-11-28T19:16:09.856 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_dest.ko 2023-11-28T19:16:09.856 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_fragment.ko 2023-11-28T19:16:09.856 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_hop.ko 2023-11-28T19:16:09.856 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 6985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_ipv6.ko 2023-11-28T19:16:09.857 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_mobility.ko 2023-11-28T19:16:09.857 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_routing.ko 2023-11-28T19:16:09.857 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/6lowpan/nhc_udp.ko 2023-11-28T19:16:09.857 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/ 2023-11-28T19:16:09.857 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/garp.ko 2023-11-28T19:16:09.857 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/mrp.ko 2023-11-28T19:16:09.857 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/p8022.ko 2023-11-28T19:16:09.857 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/psnap.ko 2023-11-28T19:16:09.857 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/802/stp.ko 2023-11-28T19:16:09.857 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/ 2023-11-28T19:16:09.857 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 81737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/8021q/8021q.ko 2023-11-28T19:16:09.857 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/ 2023-11-28T19:16:09.858 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 198337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet.ko 2023-11-28T19:16:09.858 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_fd.ko 2023-11-28T19:16:09.858 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26345 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_rdma.ko 2023-11-28T19:16:09.858 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/9p/9pnet_virtio.ko 2023-11-28T19:16:09.858 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/ 2023-11-28T19:16:09.858 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 649297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/batman-adv/batman-adv.ko 2023-11-28T19:16:09.858 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/ 2023-11-28T19:16:09.858 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 63809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/br_netfilter.ko 2023-11-28T19:16:09.858 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 777689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/bridge.ko 2023-11-28T19:16:09.858 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ 2023-11-28T19:16:09.858 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-11-28T19:16:09.858 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_among.ko 2023-11-28T19:16:09.859 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arp.ko 2023-11-28T19:16:09.859 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-11-28T19:16:09.859 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-11-28T19:16:09.859 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip.ko 2023-11-28T19:16:09.859 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-11-28T19:16:09.859 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_limit.ko 2023-11-28T19:16:09.859 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13217 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_log.ko 2023-11-28T19:16:09.859 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark.ko 2023-11-28T19:16:09.859 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-11-28T19:16:09.859 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8385 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-11-28T19:16:09.859 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-11-28T19:16:09.859 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-11-28T19:16:09.860 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_snat.ko 2023-11-28T19:16:09.860 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_stp.ko 2023-11-28T19:16:09.860 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-11-28T19:16:09.860 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-11-28T19:16:09.860 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-11-28T19:16:09.860 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-11-28T19:16:09.860 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 55929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/ebtables.ko 2023-11-28T19:16:09.860 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-11-28T19:16:09.860 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-11-28T19:16:09.860 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/ 2023-11-28T19:16:09.860 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1046833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ceph/libceph.ko 2023-11-28T19:16:09.860 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/ 2023-11-28T19:16:09.860 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 125993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/core/pktgen.ko 2023-11-28T19:16:09.860 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/ 2023-11-28T19:16:09.861 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 194209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp.ko 2023-11-28T19:16:09.861 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_diag.ko 2023-11-28T19:16:09.861 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 57881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv4.ko 2023-11-28T19:16:09.861 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dccp/dccp_ipv6.ko 2023-11-28T19:16:09.861 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/ 2023-11-28T19:16:09.861 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 390473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/dsa_core.ko 2023-11-28T19:16:09.861 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_brcm.ko 2023-11-28T19:16:09.861 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_dsa.ko 2023-11-28T19:16:09.861 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_none.ko 2023-11-28T19:16:09.861 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/dsa/tag_trailer.ko 2023-11-28T19:16:09.861 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/ 2023-11-28T19:16:09.861 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 99729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/hsr/hsr.ko 2023-11-28T19:16:09.861 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ 2023-11-28T19:16:09.862 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ 2023-11-28T19:16:09.862 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 45233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-11-28T19:16:09.862 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 254625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154.ko 2023-11-28T19:16:09.862 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ieee802154/ieee802154_socket.ko 2023-11-28T19:16:09.862 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ 2023-11-28T19:16:09.862 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ah4.ko 2023-11-28T19:16:09.862 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/esp4.ko 2023-11-28T19:16:09.862 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/fou.ko 2023-11-28T19:16:09.862 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/gre.ko 2023-11-28T19:16:09.862 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/inet_diag.ko 2023-11-28T19:16:09.862 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_gre.ko 2023-11-28T19:16:09.862 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61225 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_tunnel.ko 2023-11-28T19:16:09.862 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ip_vti.ko 2023-11-28T19:16:09.863 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipcomp.ko 2023-11-28T19:16:09.863 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/ipip.ko 2023-11-28T19:16:09.863 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ 2023-11-28T19:16:09.863 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arp_tables.ko 2023-11-28T19:16:09.863 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-11-28T19:16:09.863 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-11-28T19:16:09.863 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ip_tables.ko 2023-11-28T19:16:09.863 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-11-28T19:16:09.863 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-11-28T19:16:09.863 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-11-28T19:16:09.863 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-11-28T19:16:09.863 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-11-28T19:16:09.864 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11305 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-11-28T19:16:09.864 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-11-28T19:16:09.864 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-11-28T19:16:09.864 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-11-28T19:16:09.864 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/iptable_security.ko 2023-11-28T19:16:09.864 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-11-28T19:16:09.864 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-11-28T19:16:09.864 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-11-28T19:16:09.864 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18161 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-11-28T19:16:09.864 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-11-28T19:16:09.864 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-11-28T19:16:09.864 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-11-28T19:16:09.865 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-11-28T19:16:09.865 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-11-28T19:16:09.865 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-11-28T19:16:09.865 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-11-28T19:16:09.865 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_bic.ko 2023-11-28T19:16:09.865 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_dctcp.ko 2023-11-28T19:16:09.865 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_diag.ko 2023-11-28T19:16:09.865 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_highspeed.ko 2023-11-28T19:16:09.865 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_htcp.ko 2023-11-28T19:16:09.865 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_hybla.ko 2023-11-28T19:16:09.865 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_illinois.ko 2023-11-28T19:16:09.866 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_lp.ko 2023-11-28T19:16:09.866 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_scalable.ko 2023-11-28T19:16:09.866 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_vegas.ko 2023-11-28T19:16:09.866 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_veno.ko 2023-11-28T19:16:09.866 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_westwood.ko 2023-11-28T19:16:09.866 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tcp_yeah.ko 2023-11-28T19:16:09.866 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/tunnel4.ko 2023-11-28T19:16:09.866 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_diag.ko 2023-11-28T19:16:09.866 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 41665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/udp_tunnel.ko 2023-11-28T19:16:09.866 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv4/xfrm4_tunnel.ko 2023-11-28T19:16:09.866 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ 2023-11-28T19:16:09.866 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ah6.ko 2023-11-28T19:16:09.867 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/esp6.ko 2023-11-28T19:16:09.867 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/fou6.ko 2023-11-28T19:16:09.867 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 80897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_gre.ko 2023-11-28T19:16:09.867 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 93577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_tunnel.ko 2023-11-28T19:16:09.867 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-11-28T19:16:09.867 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ip6_vti.ko 2023-11-28T19:16:09.867 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/ipcomp6.ko 2023-11-28T19:16:09.867 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19017 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/mip6.ko 2023-11-28T19:16:09.867 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ 2023-11-28T19:16:09.867 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-11-28T19:16:09.867 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-11-28T19:16:09.867 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-11-28T19:16:09.868 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-11-28T19:16:09.868 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-11-28T19:16:09.868 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-11-28T19:16:09.868 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-11-28T19:16:09.868 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-11-28T19:16:09.868 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-11-28T19:16:09.868 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-11-28T19:16:09.868 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-11-28T19:16:09.868 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-11-28T19:16:09.868 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-11-28T19:16:09.868 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11121 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-11-28T19:16:09.868 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-11-28T19:16:09.868 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-11-28T19:16:09.869 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-11-28T19:16:09.869 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-11-28T19:16:09.869 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-11-28T19:16:09.869 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25945 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-11-28T19:16:09.869 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-11-28T19:16:09.869 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-11-28T19:16:09.869 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-11-28T19:16:09.869 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-11-28T19:16:09.869 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9009 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-11-28T19:16:09.869 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 74073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/sit.ko 2023-11-28T19:16:09.869 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/tunnel6.ko 2023-11-28T19:16:09.869 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/ipv6/xfrm6_tunnel.ko 2023-11-28T19:16:09.870 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/ 2023-11-28T19:16:09.870 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 82833 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/key/af_key.ko 2023-11-28T19:16:09.870 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/ 2023-11-28T19:16:09.870 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 125281 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_core.ko 2023-11-28T19:16:09.870 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_debugfs.ko 2023-11-28T19:16:09.870 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 25953 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_eth.ko 2023-11-28T19:16:09.870 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip.ko 2023-11-28T19:16:09.870 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36713 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ip6.ko 2023-11-28T19:16:09.870 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_netlink.ko 2023-11-28T19:16:09.870 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 53241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/l2tp/l2tp_ppp.ko 2023-11-28T19:16:09.870 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/ 2023-11-28T19:16:09.870 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 47977 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/lapb/lapb.ko 2023-11-28T19:16:09.870 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/ 2023-11-28T19:16:09.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc.ko 2023-11-28T19:16:09.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 267913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/llc/llc2.ko 2023-11-28T19:16:09.871 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/ 2023-11-28T19:16:09.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 290417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mac802154/mac802154.ko 2023-11-28T19:16:09.871 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/ 2023-11-28T19:16:09.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/mpls/mpls_gso.ko 2023-11-28T19:16:09.871 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ 2023-11-28T19:16:09.871 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ 2023-11-28T19:16:09.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 119585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set.ko 2023-11-28T19:16:09.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-11-28T19:16:09.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26913 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-11-28T19:16:09.871 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-11-28T19:16:09.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 100297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-11-28T19:16:09.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 101441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-11-28T19:16:09.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 102817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-11-28T19:16:09.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 103417 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-11-28T19:16:09.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 112849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-11-28T19:16:09.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 60329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-11-28T19:16:09.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 109593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-11-28T19:16:09.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 113129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-11-28T19:16:09.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 112585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-11-28T19:16:09.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 111585 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-11-28T19:16:09.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 114465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-11-28T19:16:09.872 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-11-28T19:16:09.872 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ 2023-11-28T19:16:09.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 411729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs.ko 2023-11-28T19:16:09.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-11-28T19:16:09.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-11-28T19:16:09.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-11-28T19:16:09.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-11-28T19:16:09.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-11-28T19:16:09.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-11-28T19:16:09.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7689 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-11-28T19:16:09.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10681 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-11-28T19:16:09.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-11-28T19:16:09.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-11-28T19:16:09.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-11-28T19:16:09.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7697 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-11-28T19:16:09.873 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10993 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-11-28T19:16:09.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conncount.ko 2023-11-28T19:16:09.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 408257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack.ko 2023-11-28T19:16:09.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-11-28T19:16:09.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-11-28T19:16:09.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33761 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-11-28T19:16:09.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 118145 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_h323.ko 2023-11-28T19:16:09.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_irc.ko 2023-11-28T19:16:09.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-11-28T19:16:09.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 107233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-11-28T19:16:09.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-11-28T19:16:09.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sane.ko 2023-11-28T19:16:09.874 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66641 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_sip.ko 2023-11-28T19:16:09.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-11-28T19:16:09.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-11-28T19:16:09.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10113 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_dup_netdev.ko 2023-11-28T19:16:09.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 89425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table.ko 2023-11-28T19:16:09.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9593 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_flow_table_inet.ko 2023-11-28T19:16:09.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 37129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_log_syslog.ko 2023-11-28T19:16:09.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 95353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat.ko 2023-11-28T19:16:09.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_amanda.ko 2023-11-28T19:16:09.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_ftp.ko 2023-11-28T19:16:09.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11857 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_irc.ko 2023-11-28T19:16:09.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28929 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_sip.ko 2023-11-28T19:16:09.875 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_nat_tftp.ko 2023-11-28T19:16:09.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 44065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_synproxy_core.ko 2023-11-28T19:16:09.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 615649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nf_tables.ko 2023-11-28T19:16:09.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 42561 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink.ko 2023-11-28T19:16:09.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30233 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_acct.ko 2023-11-28T19:16:09.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30569 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-11-28T19:16:09.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 39785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_log.ko 2023-11-28T19:16:09.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_osf.ko 2023-11-28T19:16:09.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nfnetlink_queue.ko 2023-11-28T19:16:09.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10457 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_chain_nat.ko 2023-11-28T19:16:09.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_compat.ko 2023-11-28T19:16:09.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 40721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_ct.ko 2023-11-28T19:16:09.876 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9601 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_dup_netdev.ko 2023-11-28T19:16:09.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fib.ko 2023-11-28T19:16:09.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_fwd_netdev.ko 2023-11-28T19:16:09.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14185 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_hash.ko 2023-11-28T19:16:09.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_limit.ko 2023-11-28T19:16:09.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_log.ko 2023-11-28T19:16:09.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_masq.ko 2023-11-28T19:16:09.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_nat.ko 2023-11-28T19:16:09.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13673 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_numgen.ko 2023-11-28T19:16:09.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11841 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_osf.ko 2023-11-28T19:16:09.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_queue.ko 2023-11-28T19:16:09.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_redir.ko 2023-11-28T19:16:09.877 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject.ko 2023-11-28T19:16:09.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_reject_inet.ko 2023-11-28T19:16:09.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_socket.ko 2023-11-28T19:16:09.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_synproxy.ko 2023-11-28T19:16:09.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/nft_tproxy.ko 2023-11-28T19:16:09.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 89313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/x_tables.ko 2023-11-28T19:16:09.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_AUDIT.ko 2023-11-28T19:16:09.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CHECKSUM.ko 2023-11-28T19:16:09.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CLASSIFY.ko 2023-11-28T19:16:09.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-11-28T19:16:09.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 18169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_CT.ko 2023-11-28T19:16:09.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_DSCP.ko 2023-11-28T19:16:09.878 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HL.ko 2023-11-28T19:16:09.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13369 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_HMARK.ko 2023-11-28T19:16:09.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_IDLETIMER.ko 2023-11-28T19:16:09.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13889 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LED.ko 2023-11-28T19:16:09.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11489 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_LOG.ko 2023-11-28T19:16:09.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11753 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_MASQUERADE.ko 2023-11-28T19:16:09.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NETMAP.ko 2023-11-28T19:16:09.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFLOG.ko 2023-11-28T19:16:09.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_NFQUEUE.ko 2023-11-28T19:16:09.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_RATEEST.ko 2023-11-28T19:16:09.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_REDIRECT.ko 2023-11-28T19:16:09.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 14337 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_SECMARK.ko 2023-11-28T19:16:09.879 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPMSS.ko 2023-11-28T19:16:09.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-11-28T19:16:09.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17361 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TEE.ko 2023-11-28T19:16:09.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TPROXY.ko 2023-11-28T19:16:09.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8321 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_TRACE.ko 2023-11-28T19:16:09.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_addrtype.ko 2023-11-28T19:16:09.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_bpf.ko 2023-11-28T19:16:09.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cgroup.ko 2023-11-28T19:16:09.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cluster.ko 2023-11-28T19:16:09.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_comment.ko 2023-11-28T19:16:09.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10465 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connbytes.ko 2023-11-28T19:16:09.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlabel.ko 2023-11-28T19:16:09.880 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connlimit.ko 2023-11-28T19:16:09.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13129 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_connmark.ko 2023-11-28T19:16:09.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_conntrack.ko 2023-11-28T19:16:09.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_cpu.ko 2023-11-28T19:16:09.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dccp.ko 2023-11-28T19:16:09.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_devgroup.ko 2023-11-28T19:16:09.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8801 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_dscp.ko 2023-11-28T19:16:09.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ecn.ko 2023-11-28T19:16:09.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_esp.ko 2023-11-28T19:16:09.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hashlimit.ko 2023-11-28T19:16:09.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_helper.ko 2023-11-28T19:16:09.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7865 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_hl.ko 2023-11-28T19:16:09.881 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11921 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipcomp.ko 2023-11-28T19:16:09.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_iprange.ko 2023-11-28T19:16:09.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11785 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_ipvs.ko 2023-11-28T19:16:09.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16041 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_l2tp.ko 2023-11-28T19:16:09.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8001 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_length.ko 2023-11-28T19:16:09.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10209 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_limit.ko 2023-11-28T19:16:09.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7545 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mac.ko 2023-11-28T19:16:09.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_mark.ko 2023-11-28T19:16:09.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11825 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_multiport.ko 2023-11-28T19:16:09.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nat.ko 2023-11-28T19:16:09.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_nfacct.ko 2023-11-28T19:16:09.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_osf.ko 2023-11-28T19:16:09.882 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_owner.ko 2023-11-28T19:16:09.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_physdev.ko 2023-11-28T19:16:09.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_pkttype.ko 2023-11-28T19:16:09.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11985 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_policy.ko 2023-11-28T19:16:09.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_quota.ko 2023-11-28T19:16:09.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_rateest.ko 2023-11-28T19:16:09.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_realm.ko 2023-11-28T19:16:09.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_recent.ko 2023-11-28T19:16:09.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13329 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_sctp.ko 2023-11-28T19:16:09.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_set.ko 2023-11-28T19:16:09.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 16089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_socket.ko 2023-11-28T19:16:09.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9505 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_state.ko 2023-11-28T19:16:09.883 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9473 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_statistic.ko 2023-11-28T19:16:09.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8809 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_string.ko 2023-11-28T19:16:09.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 8553 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpmss.ko 2023-11-28T19:16:09.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15777 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_tcpudp.ko 2023-11-28T19:16:09.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_time.ko 2023-11-28T19:16:09.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netfilter/xt_u32.ko 2023-11-28T19:16:09.884 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/ 2023-11-28T19:16:09.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13969 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/netlink/netlink_diag.ko 2023-11-28T19:16:09.884 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/ 2023-11-28T19:16:09.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 12425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/nsh/nsh.ko 2023-11-28T19:16:09.884 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/ 2023-11-28T19:16:09.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 380033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/openvswitch.ko 2023-11-28T19:16:09.884 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-geneve.ko 2023-11-28T19:16:09.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-gre.ko 2023-11-28T19:16:09.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 11793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/openvswitch/vport-vxlan.ko 2023-11-28T19:16:09.885 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/ 2023-11-28T19:16:09.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13057 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/packet/af_packet_diag.ko 2023-11-28T19:16:09.885 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/ 2023-11-28T19:16:09.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 110201 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/phonet.ko 2023-11-28T19:16:09.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54721 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/phonet/pn_pep.ko 2023-11-28T19:16:09.885 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/ 2023-11-28T19:16:09.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 251481 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds.ko 2023-11-28T19:16:09.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 164937 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_rdma.ko 2023-11-28T19:16:09.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 67377 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rds/rds_tcp.ko 2023-11-28T19:16:09.885 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/ 2023-11-28T19:16:09.885 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 819657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/rxrpc/rxrpc.ko 2023-11-28T19:16:09.886 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/ 2023-11-28T19:16:09.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32241 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_csum.ko 2023-11-28T19:16:09.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23577 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_gact.ko 2023-11-28T19:16:09.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26873 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_ipt.ko 2023-11-28T19:16:09.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_mirred.ko 2023-11-28T19:16:09.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_nat.ko 2023-11-28T19:16:09.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 43449 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_pedit.ko 2023-11-28T19:16:09.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_police.ko 2023-11-28T19:16:09.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_simple.ko 2023-11-28T19:16:09.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35297 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_skbedit.ko 2023-11-28T19:16:09.886 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/act_vlan.ko 2023-11-28T19:16:09.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_basic.ko 2023-11-28T19:16:09.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33961 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_bpf.ko 2023-11-28T19:16:09.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19169 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_cgroup.ko 2023-11-28T19:16:09.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31401 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_flow.ko 2023-11-28T19:16:09.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31769 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_fw.ko 2023-11-28T19:16:09.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 38425 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_route.ko 2023-11-28T19:16:09.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 61409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/cls_u32.ko 2023-11-28T19:16:09.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7441 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_cmp.ko 2023-11-28T19:16:09.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 13409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_ipset.ko 2023-11-28T19:16:09.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33289 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_meta.ko 2023-11-28T19:16:09.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_nbyte.ko 2023-11-28T19:16:09.887 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_text.ko 2023-11-28T19:16:09.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7249 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/em_u32.ko 2023-11-28T19:16:09.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 21649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_choke.ko 2023-11-28T19:16:09.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20849 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_codel.ko 2023-11-28T19:16:09.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 34633 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_drr.ko 2023-11-28T19:16:09.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 33609 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq.ko 2023-11-28T19:16:09.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31617 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_fq_codel.ko 2023-11-28T19:16:09.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 35433 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_gred.ko 2023-11-28T19:16:09.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 49817 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hfsc.ko 2023-11-28T19:16:09.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22089 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_hhf.ko 2023-11-28T19:16:09.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 66393 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_htb.ko 2023-11-28T19:16:09.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26073 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_ingress.ko 2023-11-28T19:16:09.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 30273 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio.ko 2023-11-28T19:16:09.888 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10793 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_mqprio_lib.ko 2023-11-28T19:16:09.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26065 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_multiq.ko 2023-11-28T19:16:09.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 36137 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_netem.ko 2023-11-28T19:16:09.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 27497 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_pie.ko 2023-11-28T19:16:09.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10625 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_plug.ko 2023-11-28T19:16:09.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 24729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_prio.ko 2023-11-28T19:16:09.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 48729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_qfq.ko 2023-11-28T19:16:09.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 32905 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_red.ko 2023-11-28T19:16:09.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 26881 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfb.ko 2023-11-28T19:16:09.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 31353 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_sfq.ko 2023-11-28T19:16:09.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28897 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_tbf.ko 2023-11-28T19:16:09.889 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 28105 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sched/sch_teql.ko 2023-11-28T19:16:09.890 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/ 2023-11-28T19:16:09.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 929745 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp.ko 2023-11-28T19:16:09.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 19033 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sctp/sctp_diag.ko 2023-11-28T19:16:09.890 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/ 2023-11-28T19:16:09.890 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/ 2023-11-28T19:16:09.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 336529 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-11-28T19:16:09.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 54737 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-11-28T19:16:09.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 1520097 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/sunrpc.ko 2023-11-28T19:16:09.890 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/ 2023-11-28T19:16:09.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 707657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-11-28T19:16:09.890 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/ 2023-11-28T19:16:09.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10025 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/diag.ko 2023-11-28T19:16:09.890 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 862665 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/tipc/tipc.ko 2023-11-28T19:16:09.891 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/ 2023-11-28T19:16:09.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15729 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/unix/unix_diag.ko 2023-11-28T19:16:09.891 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/ 2023-11-28T19:16:09.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 85409 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-11-28T19:16:09.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 68049 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-11-28T19:16:09.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 96193 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock.ko 2023-11-28T19:16:09.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 10705 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_diag.ko 2023-11-28T19:16:09.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 17521 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/vmw_vsock/vsock_loopback.ko 2023-11-28T19:16:09.891 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/ 2023-11-28T19:16:09.891 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 125177 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/x25/x25.ko 2023-11-28T19:16:09.891 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/ 2023-11-28T19:16:09.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 22657 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_algo.ko 2023-11-28T19:16:09.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 20649 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_ipcomp.ko 2023-11-28T19:16:09.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 102257 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/net/xfrm/xfrm_user.ko 2023-11-28T19:16:09.893 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/ 2023-11-28T19:16:09.893 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/ 2023-11-28T19:16:09.893 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 15537 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/kernel/virt/lib/irqbypass.ko 2023-11-28T19:16:09.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 640081 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias 2023-11-28T19:16:09.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 624107 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.alias.bin 2023-11-28T19:16:09.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 7663 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin 2023-11-28T19:16:09.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 23428 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.alias.bin 2023-11-28T19:16:09.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 9821 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.bin 2023-11-28T19:16:09.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 70004 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.builtin.modinfo 2023-11-28T19:16:09.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 146313 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep 2023-11-28T19:16:09.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 232548 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.dep.bin 2023-11-28T19:16:09.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 210 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.devname 2023-11-28T19:16:09.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 72606 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.order 2023-11-28T19:16:09.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 879 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.softdep 2023-11-28T19:16:09.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 254438 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols 2023-11-28T19:16:09.894 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 309363 2023-11-23 03:47 ./lib/modules/6.6.0-g8247bbb5b470/modules.symbols.bin 2023-11-28T19:16:09.895 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/ 2023-11-28T19:16:09.895 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/ 2023-11-28T19:16:09.895 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/ 2023-11-28T19:16:09.895 INFO:teuthology.orchestra.run.smithi203.stdout:drwxr-xr-x root/root 0 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/ 2023-11-28T19:16:09.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 172 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/changelog.Debian.gz 2023-11-28T19:16:09.895 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r-- root/root 691 2023-11-23 03:47 ./usr/share/doc/linux-image-6.6.0-g8247bbb5b470/copyright 2023-11-28T19:16:09.896 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-g8247bbb5b470 2023-11-28T19:16:09.896 INFO:teuthology.task.kernel:searching for kernel 6.6.0-g8247bbb5b470 2023-11-28T19:16:09.896 DEBUG:teuthology.orchestra.run.smithi203:> egrep '(submenu|menuentry.*6.6.0-g8247bbb5b470).*{' /boot/grub/grub.cfg 2023-11-28T19:16:09.903 INFO:teuthology.orchestra.run.smithi203.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:16:09.903 INFO:teuthology.orchestra.run.smithi203.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:16:09.903 INFO:teuthology.orchestra.run.smithi203.stdout: menuentry 'Ubuntu, with Linux 6.6.0-g8247bbb5b470 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.6.0-g8247bbb5b470-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-11-28T19:16:09.904 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-11-28T19:16:09.904 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.6.0-g8247bbb5b470 2023-11-28T19:16:09.904 DEBUG:teuthology.orchestra.run.smithi203:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-11-28T19:16:09.946 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi203.front.sepia.ceph.com to complete... 2023-11-28T19:16:10.303 INFO:teuthology.orchestra.run.smithi203.stderr:Sourcing file `/etc/default/grub' 2023-11-28T19:16:10.304 INFO:teuthology.orchestra.run.smithi203.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-11-28T19:16:10.317 INFO:teuthology.orchestra.run.smithi203.stderr:Generating grub configuration file ... 2023-11-28T19:16:10.503 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-6.6.0-g8247bbb5b470 2023-11-28T19:16:10.509 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:16:10.743 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-11-28T19:16:10.748 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-11-28T19:16:10.789 INFO:teuthology.orchestra.run.smithi203.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-11-28T19:16:10.794 INFO:teuthology.orchestra.run.smithi203.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-11-28T19:16:10.917 INFO:teuthology.orchestra.run.smithi203.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-11-28T19:16:10.917 INFO:teuthology.orchestra.run.smithi203.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-11-28T19:16:10.917 INFO:teuthology.orchestra.run.smithi203.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-11-28T19:16:10.933 INFO:teuthology.orchestra.run.smithi203.stderr:done 2023-11-28T19:16:42.070 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-11-28T19:16:42.071 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-11-28T19:16:42.072 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:17:00.393 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-28T19:17:09.394 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-11-28T19:17:09.395 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:17:12.450 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2023-11-28T19:17:24.452 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-11-28T19:17:24.452 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:18:24.455 DEBUG:teuthology.orchestra.remote:timed out 2023-11-28T19:18:39.457 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-11-28T19:18:39.458 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:18:39.737 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-11-28T19:18:40.427 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-11-28T19:18:40.427 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-g8247bbb5b470"... 2023-11-28T19:18:40.428 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2023-11-28T19:18:40.482 INFO:teuthology.orchestra.run.smithi203.stdout:6.6.0-g8247bbb5b470 2023-11-28T19:18:40.483 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-g8247bbb5b470 vs 6.6.0-g8247bbb5b470 2023-11-28T19:18:40.483 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-11-28T19:18:40.484 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-11-28T19:18:41.485 DEBUG:teuthology.parallel:result is None 2023-11-28T19:18:41.485 INFO:teuthology.run_tasks:Running task internal.base... 2023-11-28T19:18:41.719 INFO:teuthology.task.internal:Creating test directory... 2023-11-28T19:18:41.719 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T19:18:41.723 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T19:18:41.730 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-11-28T19:18:41.745 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-11-28T19:18:41.801 INFO:teuthology.run_tasks:Running task internal.archive... 2023-11-28T19:18:41.809 INFO:teuthology.task.internal:Creating archive directory... 2023-11-28T19:18:41.809 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T19:18:41.814 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T19:18:41.817 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-11-28T19:18:41.848 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-11-28T19:18:41.856 INFO:teuthology.task.internal:Enabling coredump saving... 2023-11-28T19:18:41.856 DEBUG:teuthology.orchestra.run.smithi028:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T19:18:41.873 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:18:41.874 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2023-11-28T19:18:41.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:18:41.885 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T19:18:41.921 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T19:18:41.929 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-11-28T19:18:41.951 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T19:18:41.955 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T19:18:41.963 INFO:teuthology.orchestra.run.smithi028.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T19:18:41.973 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T19:18:42.010 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T19:18:42.029 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-11-28T19:18:42.031 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-11-28T19:18:42.043 INFO:teuthology.task.internal:Configuring sudo... 2023-11-28T19:18:42.043 DEBUG:teuthology.orchestra.run.smithi028:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T19:18:42.047 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T19:18:42.052 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-11-28T19:18:42.079 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-11-28T19:18:42.091 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-11-28T19:18:42.092 DEBUG:teuthology.orchestra.run.smithi028:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T19:18:42.103 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T19:18:42.110 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-11-28T19:18:42.133 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T19:18:42.160 DEBUG:teuthology.orchestra.run.smithi028:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T19:18:42.212 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:18:42.212 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T19:18:42.307 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T19:18:42.315 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T19:18:42.363 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:18:42.363 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T19:18:42.455 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-11-28T19:18:42.467 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-11-28T19:18:42.521 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:18:42.521 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-11-28T19:18:42.590 DEBUG:teuthology.orchestra.run.smithi028:> sudo service rsyslog restart 2023-11-28T19:18:42.592 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2023-11-28T19:18:42.595 DEBUG:teuthology.orchestra.run.smithi203:> sudo service rsyslog restart 2023-11-28T19:18:42.730 INFO:teuthology.run_tasks:Running task internal.timer... 2023-11-28T19:18:42.740 INFO:teuthology.task.internal:Starting timer... 2023-11-28T19:18:42.740 INFO:teuthology.run_tasks:Running task pcp... 2023-11-28T19:18:42.765 INFO:teuthology.run_tasks:Running task selinux... 2023-11-28T19:18:42.797 DEBUG:teuthology.task.selinux:Excluding smithi028: OS 'ubuntu' does not support SELinux 2023-11-28T19:18:42.797 DEBUG:teuthology.task.selinux:Excluding smithi131: OS 'ubuntu' does not support SELinux 2023-11-28T19:18:42.797 DEBUG:teuthology.task.selinux:Excluding smithi203: OS 'ubuntu' does not support SELinux 2023-11-28T19:18:42.797 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-11-28T19:18:42.797 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-11-28T19:18:42.797 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-11-28T19:18:42.797 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-11-28T19:18:42.831 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-11-28T19:18:42.838 INFO:teuthology.repo_utils:Fetching main from origin 2023-11-28T19:18:42.955 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-11-28T19:18:42.972 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-11-28T19:18:42.974 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi028.front.sepia.ceph.com,smithi131.front.sepia.ceph.com,smithi203.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-11-28T19:27:24.836 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi028.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com'), Remote(name='ubuntu@smithi203.front.sepia.ceph.com')] 2023-11-28T19:27:24.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-11-28T19:27:24.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi028.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:27:24.916 DEBUG:teuthology.orchestra.run.smithi028:> true 2023-11-28T19:27:25.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi028.front.sepia.ceph.com' 2023-11-28T19:27:25.035 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-11-28T19:27:25.035 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:27:25.109 DEBUG:teuthology.orchestra.run.smithi131:> true 2023-11-28T19:27:25.215 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2023-11-28T19:27:25.215 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-11-28T19:27:25.216 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-11-28T19:27:25.293 DEBUG:teuthology.orchestra.run.smithi203:> true 2023-11-28T19:27:25.417 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2023-11-28T19:27:25.418 INFO:teuthology.run_tasks:Running task clock... 2023-11-28T19:27:25.430 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-11-28T19:27:25.430 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T19:27:25.430 DEBUG:teuthology.orchestra.run.smithi028:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T19:27:25.433 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T19:27:25.433 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T19:27:25.435 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-11-28T19:27:25.435 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-11-28T19:27:25.460 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T19:27:25.460 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: Command line: ntpd -gq 2023-11-28T19:27:25.460 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: ---------------------------------------------------- 2023-11-28T19:27:25.460 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T19:27:25.460 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T19:27:25.460 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: corporation. Support and training for ntp-4 are 2023-11-28T19:27:25.460 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: available at https://www.nwtime.org/support 2023-11-28T19:27:25.460 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: ---------------------------------------------------- 2023-11-28T19:27:25.462 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: proto: precision = 0.067 usec (-24) 2023-11-28T19:27:25.462 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: basedate set to 2022-02-04 2023-11-28T19:27:25.462 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: gps base set to 2022-02-06 (week 2196) 2023-11-28T19:27:25.462 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T19:27:25.462 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T19:27:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T19:27:25.463 INFO:teuthology.orchestra.run.smithi028.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T19:27:25.464 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T19:27:25.464 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T19:27:25.464 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T19:27:25.464 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: Listen normally on 3 ens1f0 172.21.15.28:123 2023-11-28T19:27:25.464 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: Listen normally on 4 lo [::1]:123 2023-11-28T19:27:25.464 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:ca3c%4]:123 2023-11-28T19:27:25.464 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:25 ntpd[28522]: Listening on routing socket on fd #22 for interface updates 2023-11-28T19:27:25.465 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T19:27:25.465 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: Command line: ntpd -gq 2023-11-28T19:27:25.465 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: ---------------------------------------------------- 2023-11-28T19:27:25.465 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T19:27:25.466 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T19:27:25.466 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: corporation. Support and training for ntp-4 are 2023-11-28T19:27:25.466 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: available at https://www.nwtime.org/support 2023-11-28T19:27:25.466 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: ---------------------------------------------------- 2023-11-28T19:27:25.466 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: proto: precision = 0.044 usec (-24) 2023-11-28T19:27:25.466 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: basedate set to 2022-02-04 2023-11-28T19:27:25.466 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: gps base set to 2022-02-06 (week 2196) 2023-11-28T19:27:25.467 INFO:teuthology.orchestra.run.smithi131.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T19:27:25.467 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T19:27:25.467 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T19:27:25.467 INFO:teuthology.orchestra.run.smithi131.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T19:27:25.468 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T19:27:25.468 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T19:27:25.468 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T19:27:25.468 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: Listen normally on 3 enp3s0f1 172.21.15.131:123 2023-11-28T19:27:25.468 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: Listen normally on 4 lo [::1]:123 2023-11-28T19:27:25.469 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:72f9%5]:123 2023-11-28T19:27:25.469 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:25 ntpd[28441]: Listening on routing socket on fd #22 for interface updates 2023-11-28T19:27:25.498 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-11-28T19:27:25.498 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: Command line: ntpd -gq 2023-11-28T19:27:25.498 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: ---------------------------------------------------- 2023-11-28T19:27:25.498 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: ntp-4 is maintained by Network Time Foundation, 2023-11-28T19:27:25.498 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-11-28T19:27:25.498 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: corporation. Support and training for ntp-4 are 2023-11-28T19:27:25.498 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: available at https://www.nwtime.org/support 2023-11-28T19:27:25.499 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: ---------------------------------------------------- 2023-11-28T19:27:25.499 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: proto: precision = 0.040 usec (-24) 2023-11-28T19:27:25.499 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: basedate set to 2022-02-04 2023-11-28T19:27:25.499 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: gps base set to 2022-02-06 (week 2196) 2023-11-28T19:27:25.500 INFO:teuthology.orchestra.run.smithi203.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T19:27:25.500 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-11-28T19:27:25.500 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: restrict ::: KOD does nothing without LIMITED. 2023-11-28T19:27:25.501 INFO:teuthology.orchestra.run.smithi203.stderr:restrict ::: KOD does nothing without LIMITED. 2023-11-28T19:27:25.501 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: Listen and drop on 0 v6wildcard [::]:123 2023-11-28T19:27:25.502 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-11-28T19:27:25.502 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: Listen normally on 2 lo 127.0.0.1:123 2023-11-28T19:27:25.502 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: Listen normally on 3 enp3s0f1 172.21.15.203:123 2023-11-28T19:27:25.502 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: Listen normally on 4 lo [::1]:123 2023-11-28T19:27:25.502 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:4a23%5]:123 2023-11-28T19:27:25.502 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:25 ntpd[27967]: Listening on routing socket on fd #22 for interface updates 2023-11-28T19:27:26.462 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:26 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:26.462 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:26 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:26.463 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:26 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:26.463 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:26 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:26.463 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:26 ntpd[28441]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:26.463 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:26 ntpd[28441]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:26.499 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:26 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:26.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:26 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:26.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:26 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:26.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:26 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:26.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:26 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:26.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:26 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:26.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:26 ntpd[27967]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:26.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:26 ntpd[27967]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:26.502 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:26 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:26.502 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:26 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:26.503 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:26 ntpd[27967]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:26.503 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:26 ntpd[27967]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:28.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:28.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:28.464 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:28 ntpd[28522]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:28.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:28.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:28.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:28.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:28.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:28.468 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:28 ntpd[28441]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:28.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:28.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:28.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:28.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:28.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:28.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:28.502 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:28.502 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:28 ntpd[27967]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:29.460 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:29 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:29.460 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:29 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:29.462 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:29 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:29.462 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:29 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:30.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:30.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:30.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:30.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:30.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:30 ntpd[28522]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:30.465 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.465 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:30.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:30.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:30.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:30.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:30.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:30 ntpd[28441]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:30.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:30.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:30.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:30.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:30.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:30.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:30.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:30.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:30 ntpd[27967]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:32.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:32.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:32.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.464 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.464 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:32.464 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:32.464 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.464 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.464 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:32.464 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:32 ntpd[28522]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:32.466 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.467 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.468 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.468 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.468 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.468 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.468 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:32.468 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:32.468 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.469 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.469 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:32.469 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:32.469 INFO:teuthology.orchestra.run.smithi131.stdout:28 Nov 19:27:32 ntpd[28441]: ntpd: time slew -0.004607 s 2023-11-28T19:27:32.469 INFO:teuthology.orchestra.run.smithi131.stdout:ntpd: time slew -0.004607s 2023-11-28T19:27:32.470 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T19:27:32.470 INFO:teuthology.orchestra.run.smithi131.stderr:28 Nov 19:27:32 ntpd[28441]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T19:27:32.499 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:32 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.499 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:32 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:32 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:32 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:32 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:32 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:32 ntpd[27967]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:32.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:32 ntpd[27967]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:32.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:32 ntpd[27967]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:32.500 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:32 ntpd[27967]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:32.501 INFO:teuthology.orchestra.run.smithi203.stdout:28 Nov 19:27:32 ntpd[27967]: ntpd: time slew -0.002266 s 2023-11-28T19:27:32.501 INFO:teuthology.orchestra.run.smithi203.stdout:ntpd: time slew -0.002266s 2023-11-28T19:27:32.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:32 ntpd[27967]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T19:27:32.501 INFO:teuthology.orchestra.run.smithi203.stderr:28 Nov 19:27:32 ntpd[27967]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T19:27:32.560 INFO:teuthology.orchestra.run.smithi131.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T19:27:32.560 INFO:teuthology.orchestra.run.smithi131.stdout:============================================================================== 2023-11-28T19:27:32.560 INFO:teuthology.orchestra.run.smithi131.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:27:32.560 INFO:teuthology.orchestra.run.smithi131.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:27:32.561 INFO:teuthology.orchestra.run.smithi131.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:27:32.561 INFO:teuthology.orchestra.run.smithi131.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:27:32.595 INFO:teuthology.orchestra.run.smithi203.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T19:27:32.595 INFO:teuthology.orchestra.run.smithi203.stdout:============================================================================== 2023-11-28T19:27:32.595 INFO:teuthology.orchestra.run.smithi203.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:27:32.596 INFO:teuthology.orchestra.run.smithi203.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:27:32.596 INFO:teuthology.orchestra.run.smithi203.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:27:32.596 INFO:teuthology.orchestra.run.smithi203.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:27:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:34 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:34 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:34.462 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:34 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:34 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:34 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:34 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:34 ntpd[28522]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-11-28T19:27:34.463 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:34 ntpd[28522]: can't open /var/log/ntpstats/rawstats.20231128: Permission denied 2023-11-28T19:27:34.464 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:34 ntpd[28522]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-11-28T19:27:34.464 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:34 ntpd[28522]: can't open /var/log/ntpstats/peerstats.20231128: Permission denied 2023-11-28T19:27:34.464 INFO:teuthology.orchestra.run.smithi028.stdout:28 Nov 19:27:34 ntpd[28522]: ntpd: time slew -0.005879 s 2023-11-28T19:27:34.464 INFO:teuthology.orchestra.run.smithi028.stdout:ntpd: time slew -0.005879s 2023-11-28T19:27:34.464 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:34 ntpd[28522]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-11-28T19:27:34.465 INFO:teuthology.orchestra.run.smithi028.stderr:28 Nov 19:27:34 ntpd[28522]: can't open /var/log/ntpstats/loopstats.20231128: Permission denied 2023-11-28T19:27:34.559 INFO:teuthology.orchestra.run.smithi028.stdout: remote refid st t when poll reach delay offset jitter 2023-11-28T19:27:34.559 INFO:teuthology.orchestra.run.smithi028.stdout:============================================================================== 2023-11-28T19:27:34.559 INFO:teuthology.orchestra.run.smithi028.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:27:34.559 INFO:teuthology.orchestra.run.smithi028.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:27:34.560 INFO:teuthology.orchestra.run.smithi028.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:27:34.560 INFO:teuthology.orchestra.run.smithi028.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-11-28T19:27:34.560 INFO:teuthology.run_tasks:Running task install... 2023-11-28T19:27:34.574 DEBUG:teuthology.task.install:project ceph 2023-11-28T19:27:34.574 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}} 2023-11-28T19:27:34.574 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'} 2023-11-28T19:27:34.574 INFO:teuthology.task.install:Using flavor: default 2023-11-28T19:27:34.580 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-11-28T19:27:34.580 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-11-28T19:27:34.580 DEBUG:teuthology.orchestra.run.smithi028:> sudo apt-key list | grep Ceph 2023-11-28T19:27:34.581 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-key list | grep Ceph 2023-11-28T19:27:34.581 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-key list | grep Ceph 2023-11-28T19:27:34.644 INFO:teuthology.orchestra.run.smithi131.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T19:27:34.659 INFO:teuthology.orchestra.run.smithi028.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T19:27:34.686 INFO:teuthology.orchestra.run.smithi028.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T19:27:34.687 INFO:teuthology.orchestra.run.smithi028.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T19:27:34.687 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T19:27:34.687 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T19:27:34.688 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T19:27:34.692 INFO:teuthology.orchestra.run.smithi203.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-11-28T19:27:34.701 INFO:teuthology.orchestra.run.smithi131.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T19:27:34.701 INFO:teuthology.orchestra.run.smithi131.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T19:27:34.702 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T19:27:34.702 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T19:27:34.702 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T19:27:34.743 INFO:teuthology.orchestra.run.smithi203.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-11-28T19:27:34.743 INFO:teuthology.orchestra.run.smithi203.stdout:uid [ unknown] Ceph.com (release key) 2023-11-28T19:27:34.744 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-11-28T19:27:34.744 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-11-28T19:27:34.744 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T19:27:34.845 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default/ 2023-11-28T19:27:34.845 INFO:teuthology.task.install.deb:Package version is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:27:34.904 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default/ 2023-11-28T19:27:34.905 INFO:teuthology.task.install.deb:Package version is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:27:34.911 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default/ 2023-11-28T19:27:34.912 INFO:teuthology.task.install.deb:Package version is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:27:35.019 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:27:35.019 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T19:27:35.023 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:27:35.023 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T19:27:35.038 DEBUG:teuthology.orchestra.run.smithi131:> sudo apt-get update 2023-11-28T19:27:35.067 DEBUG:teuthology.orchestra.run.smithi028:> sudo apt-get update 2023-11-28T19:27:35.082 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:27:35.082 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-11-28T19:27:35.103 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-get update 2023-11-28T19:27:35.226 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T19:27:35.236 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T19:27:35.237 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T19:27:35.253 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T19:27:35.292 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T19:27:35.292 INFO:teuthology.orchestra.run.smithi028.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T19:27:35.315 INFO:teuthology.orchestra.run.smithi028.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-28T19:27:35.323 INFO:teuthology.orchestra.run.smithi131.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T19:27:35.338 INFO:teuthology.orchestra.run.smithi203.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy InRelease 2023-11-28T19:27:35.339 INFO:teuthology.orchestra.run.smithi028.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T19:27:35.351 INFO:teuthology.orchestra.run.smithi131.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-11-28T19:27:35.357 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-28T19:27:35.358 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T19:27:35.359 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release [6,978 B] 2023-11-28T19:27:35.359 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T19:27:35.378 INFO:teuthology.orchestra.run.smithi203.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T19:27:35.388 INFO:teuthology.orchestra.run.smithi028.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-28T19:27:35.396 INFO:teuthology.orchestra.run.smithi131.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy Release.gpg 2023-11-28T19:27:35.399 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-28T19:27:35.414 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-11-28T19:27:35.434 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T19:27:35.435 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2023-11-28T19:27:35.440 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T19:27:35.475 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,413 B] 2023-11-28T19:27:35.485 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-11-28T19:27:35.522 INFO:teuthology.orchestra.run.smithi028.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T19:27:35.566 INFO:teuthology.orchestra.run.smithi203.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-11-28T19:27:35.573 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 27.9 kB in 0s (78.5 kB/s) 2023-11-28T19:27:35.673 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 27.9 kB in 0s (66.5 kB/s) 2023-11-28T19:27:35.896 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 27.9 kB in 1s (48.5 kB/s) 2023-11-28T19:27:36.463 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2023-11-28T19:27:36.479 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7520-g43dd94c1-1jammy cephadm=18.0.0-7520-g43dd94c1-1jammy ceph-mds=18.0.0-7520-g43dd94c1-1jammy ceph-mgr=18.0.0-7520-g43dd94c1-1jammy ceph-common=18.0.0-7520-g43dd94c1-1jammy ceph-fuse=18.0.0-7520-g43dd94c1-1jammy ceph-test=18.0.0-7520-g43dd94c1-1jammy ceph-volume=18.0.0-7520-g43dd94c1-1jammy radosgw=18.0.0-7520-g43dd94c1-1jammy python3-rados=18.0.0-7520-g43dd94c1-1jammy python3-rgw=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy python3-rbd=18.0.0-7520-g43dd94c1-1jammy libcephfs2=18.0.0-7520-g43dd94c1-1jammy libcephfs-dev=18.0.0-7520-g43dd94c1-1jammy librados2=18.0.0-7520-g43dd94c1-1jammy librbd1=18.0.0-7520-g43dd94c1-1jammy rbd-fuse=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy cephfs-shell=18.0.0-7520-g43dd94c1-1jammy cephfs-top=18.0.0-7520-g43dd94c1-1jammy cephfs-mirror=18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:27:36.537 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2023-11-28T19:27:36.583 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2023-11-28T19:27:36.599 DEBUG:teuthology.orchestra.run.smithi028:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7520-g43dd94c1-1jammy cephadm=18.0.0-7520-g43dd94c1-1jammy ceph-mds=18.0.0-7520-g43dd94c1-1jammy ceph-mgr=18.0.0-7520-g43dd94c1-1jammy ceph-common=18.0.0-7520-g43dd94c1-1jammy ceph-fuse=18.0.0-7520-g43dd94c1-1jammy ceph-test=18.0.0-7520-g43dd94c1-1jammy ceph-volume=18.0.0-7520-g43dd94c1-1jammy radosgw=18.0.0-7520-g43dd94c1-1jammy python3-rados=18.0.0-7520-g43dd94c1-1jammy python3-rgw=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy python3-rbd=18.0.0-7520-g43dd94c1-1jammy libcephfs2=18.0.0-7520-g43dd94c1-1jammy libcephfs-dev=18.0.0-7520-g43dd94c1-1jammy librados2=18.0.0-7520-g43dd94c1-1jammy librbd1=18.0.0-7520-g43dd94c1-1jammy rbd-fuse=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy cephfs-shell=18.0.0-7520-g43dd94c1-1jammy cephfs-top=18.0.0-7520-g43dd94c1-1jammy cephfs-mirror=18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:27:36.653 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2023-11-28T19:27:36.723 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2023-11-28T19:27:36.724 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2023-11-28T19:27:36.815 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2023-11-28T19:27:36.822 INFO:teuthology.orchestra.run.smithi028.stdout:Building dependency tree... 2023-11-28T19:27:36.823 INFO:teuthology.orchestra.run.smithi028.stdout:Reading state information... 2023-11-28T19:27:36.829 DEBUG:teuthology.orchestra.run.smithi203:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-7520-g43dd94c1-1jammy cephadm=18.0.0-7520-g43dd94c1-1jammy ceph-mds=18.0.0-7520-g43dd94c1-1jammy ceph-mgr=18.0.0-7520-g43dd94c1-1jammy ceph-common=18.0.0-7520-g43dd94c1-1jammy ceph-fuse=18.0.0-7520-g43dd94c1-1jammy ceph-test=18.0.0-7520-g43dd94c1-1jammy ceph-volume=18.0.0-7520-g43dd94c1-1jammy radosgw=18.0.0-7520-g43dd94c1-1jammy python3-rados=18.0.0-7520-g43dd94c1-1jammy python3-rgw=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy python3-rbd=18.0.0-7520-g43dd94c1-1jammy libcephfs2=18.0.0-7520-g43dd94c1-1jammy libcephfs-dev=18.0.0-7520-g43dd94c1-1jammy librados2=18.0.0-7520-g43dd94c1-1jammy librbd1=18.0.0-7520-g43dd94c1-1jammy rbd-fuse=18.0.0-7520-g43dd94c1-1jammy python3-cephfs=18.0.0-7520-g43dd94c1-1jammy cephfs-shell=18.0.0-7520-g43dd94c1-1jammy cephfs-top=18.0.0-7520-g43dd94c1-1jammy cephfs-mirror=18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:27:36.896 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T19:27:36.896 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T19:27:36.896 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T19:27:36.897 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T19:27:36.897 INFO:teuthology.orchestra.run.smithi131.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-28T19:27:36.897 INFO:teuthology.orchestra.run.smithi131.stdout: python2.7-minimal 2023-11-28T19:27:36.897 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T19:27:36.898 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2023-11-28T19:27:36.898 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T19:27:36.898 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T19:27:36.899 INFO:teuthology.orchestra.run.smithi131.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T19:27:36.899 INFO:teuthology.orchestra.run.smithi131.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T19:27:36.899 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T19:27:36.899 INFO:teuthology.orchestra.run.smithi131.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T19:27:36.899 INFO:teuthology.orchestra.run.smithi131.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T19:27:36.899 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T19:27:36.899 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T19:27:36.899 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T19:27:36.899 INFO:teuthology.orchestra.run.smithi131.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T19:27:36.899 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T19:27:36.899 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T19:27:36.899 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T19:27:36.899 INFO:teuthology.orchestra.run.smithi131.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T19:27:36.900 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T19:27:36.900 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T19:27:36.900 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T19:27:36.900 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T19:27:36.900 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T19:27:36.900 INFO:teuthology.orchestra.run.smithi131.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T19:27:36.900 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T19:27:36.900 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T19:27:36.900 INFO:teuthology.orchestra.run.smithi131.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T19:27:36.901 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2023-11-28T19:27:36.901 INFO:teuthology.orchestra.run.smithi131.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T19:27:36.901 INFO:teuthology.orchestra.run.smithi131.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T19:27:36.901 INFO:teuthology.orchestra.run.smithi131.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T19:27:36.901 INFO:teuthology.orchestra.run.smithi131.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T19:27:36.901 INFO:teuthology.orchestra.run.smithi131.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T19:27:36.901 INFO:teuthology.orchestra.run.smithi131.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T19:27:36.901 INFO:teuthology.orchestra.run.smithi131.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T19:27:36.901 INFO:teuthology.orchestra.run.smithi131.stdout:Recommended packages: 2023-11-28T19:27:36.901 INFO:teuthology.orchestra.run.smithi131.stdout: btrfs-tools 2023-11-28T19:27:36.904 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2023-11-28T19:27:36.981 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T19:27:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T19:27:36.981 INFO:teuthology.orchestra.run.smithi028.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T19:27:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T19:27:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-28T19:27:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: python2.7-minimal 2023-11-28T19:27:36.982 INFO:teuthology.orchestra.run.smithi028.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T19:27:36.982 INFO:teuthology.orchestra.run.smithi028.stdout:The following additional packages will be installed: 2023-11-28T19:27:36.982 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T19:27:36.983 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T19:27:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T19:27:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T19:27:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T19:27:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T19:27:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T19:27:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T19:27:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T19:27:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T19:27:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T19:27:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T19:27:36.984 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T19:27:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T19:27:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T19:27:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T19:27:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T19:27:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T19:27:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T19:27:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T19:27:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T19:27:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T19:27:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T19:27:36.985 INFO:teuthology.orchestra.run.smithi028.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T19:27:36.986 INFO:teuthology.orchestra.run.smithi028.stdout:Suggested packages: 2023-11-28T19:27:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T19:27:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T19:27:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T19:27:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T19:27:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T19:27:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T19:27:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T19:27:36.986 INFO:teuthology.orchestra.run.smithi028.stdout:Recommended packages: 2023-11-28T19:27:36.986 INFO:teuthology.orchestra.run.smithi028.stdout: btrfs-tools 2023-11-28T19:27:37.005 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2023-11-28T19:27:37.005 INFO:teuthology.orchestra.run.smithi131.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T19:27:37.005 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T19:27:37.005 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T19:27:37.005 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T19:27:37.005 INFO:teuthology.orchestra.run.smithi131.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T19:27:37.005 INFO:teuthology.orchestra.run.smithi131.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T19:27:37.005 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T19:27:37.005 INFO:teuthology.orchestra.run.smithi131.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T19:27:37.006 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T19:27:37.006 INFO:teuthology.orchestra.run.smithi131.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T19:27:37.006 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T19:27:37.006 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T19:27:37.006 INFO:teuthology.orchestra.run.smithi131.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T19:27:37.007 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T19:27:37.007 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T19:27:37.007 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T19:27:37.007 INFO:teuthology.orchestra.run.smithi131.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T19:27:37.007 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T19:27:37.007 INFO:teuthology.orchestra.run.smithi131.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T19:27:37.008 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T19:27:37.008 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T19:27:37.008 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T19:27:37.008 INFO:teuthology.orchestra.run.smithi131.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T19:27:37.008 INFO:teuthology.orchestra.run.smithi131.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T19:27:37.008 INFO:teuthology.orchestra.run.smithi131.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T19:27:37.009 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T19:27:37.009 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T19:27:37.009 INFO:teuthology.orchestra.run.smithi131.stdout: socat unzip xmlstarlet zip 2023-11-28T19:27:37.070 INFO:teuthology.orchestra.run.smithi203.stdout:Building dependency tree... 2023-11-28T19:27:37.070 INFO:teuthology.orchestra.run.smithi203.stdout:Reading state information... 2023-11-28T19:27:37.093 INFO:teuthology.orchestra.run.smithi028.stdout:The following NEW packages will be installed: 2023-11-28T19:27:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T19:27:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T19:27:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T19:27:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T19:27:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T19:27:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T19:27:37.094 INFO:teuthology.orchestra.run.smithi028.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T19:27:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T19:27:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T19:27:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T19:27:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T19:27:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T19:27:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T19:27:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T19:27:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T19:27:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T19:27:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T19:27:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T19:27:37.095 INFO:teuthology.orchestra.run.smithi028.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T19:27:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T19:27:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T19:27:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T19:27:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T19:27:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T19:27:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T19:27:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T19:27:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T19:27:37.096 INFO:teuthology.orchestra.run.smithi028.stdout: socat unzip xmlstarlet zip 2023-11-28T19:27:37.192 INFO:teuthology.orchestra.run.smithi131.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T19:27:37.192 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 187 MB of archives. 2023-11-28T19:27:37.192 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T19:27:37.192 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T19:27:37.223 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T19:27:37.223 INFO:teuthology.orchestra.run.smithi203.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T19:27:37.223 INFO:teuthology.orchestra.run.smithi203.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T19:27:37.223 INFO:teuthology.orchestra.run.smithi203.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T19:27:37.223 INFO:teuthology.orchestra.run.smithi203.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T19:27:37.224 INFO:teuthology.orchestra.run.smithi203.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T19:27:37.224 INFO:teuthology.orchestra.run.smithi203.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T19:27:37.227 INFO:teuthology.orchestra.run.smithi203.stdout:The following additional packages will be installed: 2023-11-28T19:27:37.227 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-11-28T19:27:37.227 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-11-28T19:27:37.227 INFO:teuthology.orchestra.run.smithi203.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T19:27:37.228 INFO:teuthology.orchestra.run.smithi203.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-11-28T19:27:37.228 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2023-11-28T19:27:37.228 INFO:teuthology.orchestra.run.smithi203.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2023-11-28T19:27:37.228 INFO:teuthology.orchestra.run.smithi203.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-11-28T19:27:37.228 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-11-28T19:27:37.228 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-11-28T19:27:37.228 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-11-28T19:27:37.228 INFO:teuthology.orchestra.run.smithi203.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-11-28T19:27:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-11-28T19:27:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-11-28T19:27:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-11-28T19:27:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-11-28T19:27:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-11-28T19:27:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-11-28T19:27:37.229 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-11-28T19:27:37.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-11-28T19:27:37.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-11-28T19:27:37.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-11-28T19:27:37.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-11-28T19:27:37.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-11-28T19:27:37.230 INFO:teuthology.orchestra.run.smithi203.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2023-11-28T19:27:37.230 INFO:teuthology.orchestra.run.smithi203.stdout:Suggested packages: 2023-11-28T19:27:37.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2023-11-28T19:27:37.231 INFO:teuthology.orchestra.run.smithi203.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2023-11-28T19:27:37.231 INFO:teuthology.orchestra.run.smithi203.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2023-11-28T19:27:37.231 INFO:teuthology.orchestra.run.smithi203.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2023-11-28T19:27:37.231 INFO:teuthology.orchestra.run.smithi203.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2023-11-28T19:27:37.231 INFO:teuthology.orchestra.run.smithi203.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-11-28T19:27:37.231 INFO:teuthology.orchestra.run.smithi203.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2023-11-28T19:27:37.232 INFO:teuthology.orchestra.run.smithi203.stdout:Recommended packages: 2023-11-28T19:27:37.232 INFO:teuthology.orchestra.run.smithi203.stdout: btrfs-tools 2023-11-28T19:27:37.281 INFO:teuthology.orchestra.run.smithi028.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T19:27:37.281 INFO:teuthology.orchestra.run.smithi028.stdout:Need to get 187 MB of archives. 2023-11-28T19:27:37.281 INFO:teuthology.orchestra.run.smithi028.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T19:27:37.281 INFO:teuthology.orchestra.run.smithi028.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T19:27:37.364 INFO:teuthology.orchestra.run.smithi028.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T19:27:37.376 INFO:teuthology.orchestra.run.smithi203.stdout:The following NEW packages will be installed: 2023-11-28T19:27:37.376 INFO:teuthology.orchestra.run.smithi203.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-11-28T19:27:37.376 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-11-28T19:27:37.376 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-11-28T19:27:37.376 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-11-28T19:27:37.377 INFO:teuthology.orchestra.run.smithi203.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2023-11-28T19:27:37.377 INFO:teuthology.orchestra.run.smithi203.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-11-28T19:27:37.377 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2023-11-28T19:27:37.377 INFO:teuthology.orchestra.run.smithi203.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2023-11-28T19:27:37.377 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2023-11-28T19:27:37.377 INFO:teuthology.orchestra.run.smithi203.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-11-28T19:27:37.377 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-11-28T19:27:37.377 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-11-28T19:27:37.378 INFO:teuthology.orchestra.run.smithi203.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-11-28T19:27:37.378 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-11-28T19:27:37.378 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-11-28T19:27:37.378 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-11-28T19:27:37.378 INFO:teuthology.orchestra.run.smithi203.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-11-28T19:27:37.378 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-11-28T19:27:37.378 INFO:teuthology.orchestra.run.smithi203.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-11-28T19:27:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-11-28T19:27:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-11-28T19:27:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-11-28T19:27:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-11-28T19:27:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-11-28T19:27:37.379 INFO:teuthology.orchestra.run.smithi203.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-11-28T19:27:37.380 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-11-28T19:27:37.380 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-11-28T19:27:37.380 INFO:teuthology.orchestra.run.smithi203.stdout: socat unzip xmlstarlet zip 2023-11-28T19:27:37.393 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T19:27:37.409 INFO:teuthology.orchestra.run.smithi028.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T19:27:37.411 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7520-g43dd94c1-1jammy [3,469 kB] 2023-11-28T19:27:37.433 INFO:teuthology.orchestra.run.smithi028.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7520-g43dd94c1-1jammy [3,469 kB] 2023-11-28T19:27:37.441 INFO:teuthology.orchestra.run.smithi203.stdout:0 upgraded, 124 newly installed, 0 to remove and 264 not upgraded. 2023-11-28T19:27:37.441 INFO:teuthology.orchestra.run.smithi203.stdout:Need to get 187 MB of archives. 2023-11-28T19:27:37.441 INFO:teuthology.orchestra.run.smithi203.stdout:After this operation, 835 MB of additional disk space will be used. 2023-11-28T19:27:37.441 INFO:teuthology.orchestra.run.smithi203.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-11-28T19:27:37.459 INFO:teuthology.orchestra.run.smithi203.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-11-28T19:27:37.468 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T19:27:37.511 INFO:teuthology.orchestra.run.smithi203.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T19:27:37.532 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T19:27:37.533 INFO:teuthology.orchestra.run.smithi203.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T19:27:37.545 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T19:27:37.578 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-11-28T19:27:37.583 INFO:teuthology.orchestra.run.smithi203.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T19:27:37.586 INFO:teuthology.orchestra.run.smithi203.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T19:27:37.593 INFO:teuthology.orchestra.run.smithi203.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T19:27:37.596 INFO:teuthology.orchestra.run.smithi203.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T19:27:37.596 INFO:teuthology.orchestra.run.smithi203.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T19:27:37.602 INFO:teuthology.orchestra.run.smithi203.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T19:27:37.604 INFO:teuthology.orchestra.run.smithi203.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T19:27:37.605 INFO:teuthology.orchestra.run.smithi028.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T19:27:37.606 INFO:teuthology.orchestra.run.smithi203.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T19:27:37.607 INFO:teuthology.orchestra.run.smithi203.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T19:27:37.608 INFO:teuthology.orchestra.run.smithi203.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T19:27:37.618 INFO:teuthology.orchestra.run.smithi203.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T19:27:37.620 INFO:teuthology.orchestra.run.smithi203.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T19:27:37.622 INFO:teuthology.orchestra.run.smithi203.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T19:27:37.622 INFO:teuthology.orchestra.run.smithi203.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T19:27:37.636 INFO:teuthology.orchestra.run.smithi203.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T19:27:37.639 INFO:teuthology.orchestra.run.smithi203.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T19:27:37.639 INFO:teuthology.orchestra.run.smithi203.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T19:27:37.639 INFO:teuthology.orchestra.run.smithi203.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T19:27:37.639 INFO:teuthology.orchestra.run.smithi203.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T19:27:37.639 INFO:teuthology.orchestra.run.smithi203.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T19:27:37.652 INFO:teuthology.orchestra.run.smithi203.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T19:27:37.652 INFO:teuthology.orchestra.run.smithi203.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T19:27:37.654 INFO:teuthology.orchestra.run.smithi203.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T19:27:37.655 INFO:teuthology.orchestra.run.smithi203.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T19:27:37.670 INFO:teuthology.orchestra.run.smithi203.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T19:27:37.670 INFO:teuthology.orchestra.run.smithi203.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T19:27:37.670 INFO:teuthology.orchestra.run.smithi203.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T19:27:37.671 INFO:teuthology.orchestra.run.smithi203.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T19:27:37.671 INFO:teuthology.orchestra.run.smithi203.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T19:27:37.672 INFO:teuthology.orchestra.run.smithi203.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T19:27:37.686 INFO:teuthology.orchestra.run.smithi203.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T19:27:37.686 INFO:teuthology.orchestra.run.smithi203.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T19:27:37.690 INFO:teuthology.orchestra.run.smithi203.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T19:27:37.690 INFO:teuthology.orchestra.run.smithi203.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T19:27:37.702 INFO:teuthology.orchestra.run.smithi203.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T19:27:37.703 INFO:teuthology.orchestra.run.smithi203.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T19:27:37.703 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T19:27:37.704 INFO:teuthology.orchestra.run.smithi203.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T19:27:37.705 INFO:teuthology.orchestra.run.smithi203.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T19:27:37.706 INFO:teuthology.orchestra.run.smithi203.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T19:27:37.707 INFO:teuthology.orchestra.run.smithi203.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T19:27:37.717 INFO:teuthology.orchestra.run.smithi028.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T19:27:37.719 INFO:teuthology.orchestra.run.smithi203.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T19:27:37.721 INFO:teuthology.orchestra.run.smithi203.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T19:27:37.721 INFO:teuthology.orchestra.run.smithi203.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T19:27:37.722 INFO:teuthology.orchestra.run.smithi203.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-7520-g43dd94c1-1jammy [3,469 kB] 2023-11-28T19:27:37.722 INFO:teuthology.orchestra.run.smithi203.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T19:27:37.736 INFO:teuthology.orchestra.run.smithi203.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T19:27:37.769 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T19:27:37.780 INFO:teuthology.orchestra.run.smithi203.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T19:27:37.781 INFO:teuthology.orchestra.run.smithi203.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T19:27:37.782 INFO:teuthology.orchestra.run.smithi203.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T19:27:37.783 INFO:teuthology.orchestra.run.smithi203.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T19:27:37.784 INFO:teuthology.orchestra.run.smithi203.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T19:27:37.803 INFO:teuthology.orchestra.run.smithi203.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T19:27:37.805 INFO:teuthology.orchestra.run.smithi203.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T19:27:37.805 INFO:teuthology.orchestra.run.smithi203.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T19:27:37.822 INFO:teuthology.orchestra.run.smithi203.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T19:27:37.822 INFO:teuthology.orchestra.run.smithi203.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T19:27:37.823 INFO:teuthology.orchestra.run.smithi203.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T19:27:37.823 INFO:teuthology.orchestra.run.smithi203.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T19:27:37.824 INFO:teuthology.orchestra.run.smithi203.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T19:27:37.824 INFO:teuthology.orchestra.run.smithi203.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T19:27:37.832 INFO:teuthology.orchestra.run.smithi203.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T19:27:37.833 INFO:teuthology.orchestra.run.smithi203.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T19:27:37.836 INFO:teuthology.orchestra.run.smithi203.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T19:27:37.849 INFO:teuthology.orchestra.run.smithi203.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T19:27:37.851 INFO:teuthology.orchestra.run.smithi203.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T19:27:37.851 INFO:teuthology.orchestra.run.smithi203.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T19:27:37.855 INFO:teuthology.orchestra.run.smithi203.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T19:27:37.858 INFO:teuthology.orchestra.run.smithi203.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T19:27:37.858 INFO:teuthology.orchestra.run.smithi203.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T19:27:37.859 INFO:teuthology.orchestra.run.smithi203.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T19:27:37.866 INFO:teuthology.orchestra.run.smithi203.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T19:27:37.871 INFO:teuthology.orchestra.run.smithi203.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T19:27:37.871 INFO:teuthology.orchestra.run.smithi203.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T19:27:37.883 INFO:teuthology.orchestra.run.smithi203.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T19:27:37.883 INFO:teuthology.orchestra.run.smithi203.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T19:27:37.884 INFO:teuthology.orchestra.run.smithi203.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T19:27:37.885 INFO:teuthology.orchestra.run.smithi203.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T19:27:37.886 INFO:teuthology.orchestra.run.smithi203.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T19:27:37.887 INFO:teuthology.orchestra.run.smithi203.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T19:27:37.894 INFO:teuthology.orchestra.run.smithi203.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T19:27:37.900 INFO:teuthology.orchestra.run.smithi203.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T19:27:37.900 INFO:teuthology.orchestra.run.smithi203.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T19:27:37.902 INFO:teuthology.orchestra.run.smithi203.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T19:27:37.917 INFO:teuthology.orchestra.run.smithi203.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T19:27:37.921 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-11-28T19:27:37.946 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T19:27:37.955 INFO:teuthology.orchestra.run.smithi028.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T19:27:37.982 INFO:teuthology.orchestra.run.smithi028.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T19:27:37.991 INFO:teuthology.orchestra.run.smithi028.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T19:27:38.098 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-11-28T19:27:38.156 INFO:teuthology.orchestra.run.smithi028.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T19:27:38.186 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-11-28T19:27:38.304 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-11-28T19:27:38.613 INFO:teuthology.orchestra.run.smithi203.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7520-g43dd94c1-1jammy [3,111 kB] 2023-11-28T19:27:38.622 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-11-28T19:27:38.642 INFO:teuthology.orchestra.run.smithi028.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7520-g43dd94c1-1jammy [3,111 kB] 2023-11-28T19:27:38.710 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-11-28T19:27:38.723 INFO:teuthology.orchestra.run.smithi028.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T19:27:38.738 INFO:teuthology.orchestra.run.smithi028.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T19:27:38.754 INFO:teuthology.orchestra.run.smithi028.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T19:27:38.762 INFO:teuthology.orchestra.run.smithi028.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T19:27:38.763 INFO:teuthology.orchestra.run.smithi028.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T19:27:38.780 INFO:teuthology.orchestra.run.smithi028.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T19:27:38.810 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-11-28T19:27:38.817 INFO:teuthology.orchestra.run.smithi028.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T19:27:38.830 INFO:teuthology.orchestra.run.smithi028.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T19:27:38.834 INFO:teuthology.orchestra.run.smithi028.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T19:27:38.835 INFO:teuthology.orchestra.run.smithi028.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T19:27:38.899 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-11-28T19:27:38.981 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-11-28T19:27:39.005 INFO:teuthology.orchestra.run.smithi028.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T19:27:39.087 INFO:teuthology.orchestra.run.smithi028.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T19:27:39.106 INFO:teuthology.orchestra.run.smithi203.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7520-g43dd94c1-1jammy [691 kB] 2023-11-28T19:27:39.109 INFO:teuthology.orchestra.run.smithi028.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T19:27:39.161 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2023-11-28T19:27:39.169 INFO:teuthology.orchestra.run.smithi028.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T19:27:39.208 INFO:teuthology.orchestra.run.smithi028.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T19:27:39.220 INFO:teuthology.orchestra.run.smithi203.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7520-g43dd94c1-1jammy [356 kB] 2023-11-28T19:27:39.231 INFO:teuthology.orchestra.run.smithi028.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T19:27:39.258 INFO:teuthology.orchestra.run.smithi028.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T19:27:39.279 INFO:teuthology.orchestra.run.smithi203.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7520-g43dd94c1-1jammy [32.8 kB] 2023-11-28T19:27:39.284 INFO:teuthology.orchestra.run.smithi203.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7520-g43dd94c1-1jammy [180 kB] 2023-11-28T19:27:39.323 INFO:teuthology.orchestra.run.smithi203.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7520-g43dd94c1-1jammy [63.5 kB] 2023-11-28T19:27:39.330 INFO:teuthology.orchestra.run.smithi203.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7520-g43dd94c1-1jammy [330 kB] 2023-11-28T19:27:39.386 INFO:teuthology.orchestra.run.smithi203.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7520-g43dd94c1-1jammy [6,233 kB] 2023-11-28T19:27:39.441 INFO:teuthology.orchestra.run.smithi028.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T19:27:39.457 INFO:teuthology.orchestra.run.smithi028.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T19:27:39.464 INFO:teuthology.orchestra.run.smithi028.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T19:27:39.469 INFO:teuthology.orchestra.run.smithi028.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T19:27:39.571 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2023-11-28T19:27:39.613 INFO:teuthology.orchestra.run.smithi028.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7520-g43dd94c1-1jammy [691 kB] 2023-11-28T19:27:39.654 INFO:teuthology.orchestra.run.smithi028.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T19:27:39.712 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2023-11-28T19:27:39.737 INFO:teuthology.orchestra.run.smithi028.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T19:27:39.753 INFO:teuthology.orchestra.run.smithi028.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T19:27:39.791 INFO:teuthology.orchestra.run.smithi028.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7520-g43dd94c1-1jammy [356 kB] 2023-11-28T19:27:39.822 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2023-11-28T19:27:39.857 INFO:teuthology.orchestra.run.smithi028.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7520-g43dd94c1-1jammy [32.8 kB] 2023-11-28T19:27:39.859 INFO:teuthology.orchestra.run.smithi028.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7520-g43dd94c1-1jammy [180 kB] 2023-11-28T19:27:39.894 INFO:teuthology.orchestra.run.smithi028.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7520-g43dd94c1-1jammy [63.5 kB] 2023-11-28T19:27:39.898 INFO:teuthology.orchestra.run.smithi028.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7520-g43dd94c1-1jammy [330 kB] 2023-11-28T19:27:39.905 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2023-11-28T19:27:39.939 INFO:teuthology.orchestra.run.smithi028.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T19:27:39.963 INFO:teuthology.orchestra.run.smithi028.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7520-g43dd94c1-1jammy [6,233 kB] 2023-11-28T19:27:39.990 INFO:teuthology.orchestra.run.smithi028.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T19:27:40.004 INFO:teuthology.orchestra.run.smithi028.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T19:27:40.038 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.1 [174 kB] 2023-11-28T19:27:40.086 INFO:teuthology.orchestra.run.smithi203.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7520-g43dd94c1-1jammy [112 kB] 2023-11-28T19:27:40.089 INFO:teuthology.orchestra.run.smithi203.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7520-g43dd94c1-1jammy [439 kB] 2023-11-28T19:27:40.127 INFO:teuthology.orchestra.run.smithi203.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7520-g43dd94c1-1jammy [22.6 MB] 2023-11-28T19:27:40.162 INFO:teuthology.orchestra.run.smithi028.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T19:27:40.163 INFO:teuthology.orchestra.run.smithi028.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T19:27:40.165 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2023-11-28T19:27:40.168 INFO:teuthology.orchestra.run.smithi028.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T19:27:40.173 INFO:teuthology.orchestra.run.smithi028.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T19:27:40.187 INFO:teuthology.orchestra.run.smithi028.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T19:27:40.282 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-11-28T19:27:40.340 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-7520-g43dd94c1-1jammy [3,111 kB] 2023-11-28T19:27:40.373 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-11-28T19:27:40.389 INFO:teuthology.orchestra.run.smithi028.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T19:27:40.457 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-11-28T19:27:40.557 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-11-28T19:27:40.653 INFO:teuthology.orchestra.run.smithi028.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T19:27:40.722 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-11-28T19:27:40.769 INFO:teuthology.orchestra.run.smithi028.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T19:27:40.804 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-11-28T19:27:40.814 INFO:teuthology.orchestra.run.smithi028.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T19:27:40.896 INFO:teuthology.orchestra.run.smithi028.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T19:27:40.903 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-11-28T19:27:40.909 INFO:teuthology.orchestra.run.smithi028.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T19:27:40.921 INFO:teuthology.orchestra.run.smithi028.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T19:27:40.962 INFO:teuthology.orchestra.run.smithi028.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T19:27:41.013 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-11-28T19:27:41.088 INFO:teuthology.orchestra.run.smithi028.stdout:Get:62 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7520-g43dd94c1-1jammy [112 kB] 2023-11-28T19:27:41.094 INFO:teuthology.orchestra.run.smithi028.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7520-g43dd94c1-1jammy [439 kB] 2023-11-28T19:27:41.109 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-11-28T19:27:41.173 INFO:teuthology.orchestra.run.smithi028.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7520-g43dd94c1-1jammy [22.6 MB] 2023-11-28T19:27:41.205 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-11-28T19:27:41.223 INFO:teuthology.orchestra.run.smithi028.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T19:27:41.225 INFO:teuthology.orchestra.run.smithi028.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T19:27:41.227 INFO:teuthology.orchestra.run.smithi028.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T19:27:41.392 INFO:teuthology.orchestra.run.smithi028.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T19:27:41.538 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-11-28T19:27:41.627 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-11-28T19:27:41.713 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-11-28T19:27:41.732 INFO:teuthology.orchestra.run.smithi028.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T19:27:41.798 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-11-28T19:27:41.894 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-11-28T19:27:41.936 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-7520-g43dd94c1-1jammy [691 kB] 2023-11-28T19:27:42.061 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-11-28T19:27:42.113 INFO:teuthology.orchestra.run.smithi203.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7520-g43dd94c1-1jammy [6,900 kB] 2023-11-28T19:27:42.132 INFO:teuthology.orchestra.run.smithi028.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T19:27:42.142 INFO:teuthology.orchestra.run.smithi028.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T19:27:42.143 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-11-28T19:27:42.143 INFO:teuthology.orchestra.run.smithi028.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T19:27:42.214 INFO:teuthology.orchestra.run.smithi028.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T19:27:42.215 INFO:teuthology.orchestra.run.smithi028.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T19:27:42.217 INFO:teuthology.orchestra.run.smithi028.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T19:27:42.218 INFO:teuthology.orchestra.run.smithi028.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T19:27:42.219 INFO:teuthology.orchestra.run.smithi028.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T19:27:42.317 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-7520-g43dd94c1-1jammy [356 kB] 2023-11-28T19:27:42.387 INFO:teuthology.orchestra.run.smithi028.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T19:27:42.412 INFO:teuthology.orchestra.run.smithi131.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-11-28T19:27:42.485 INFO:teuthology.orchestra.run.smithi028.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T19:27:42.511 INFO:teuthology.orchestra.run.smithi131.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-7520-g43dd94c1-1jammy [32.8 kB] 2023-11-28T19:27:42.523 INFO:teuthology.orchestra.run.smithi131.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-11-28T19:27:42.563 INFO:teuthology.orchestra.run.smithi131.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-7520-g43dd94c1-1jammy [180 kB] 2023-11-28T19:27:42.579 INFO:teuthology.orchestra.run.smithi028.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T19:27:42.613 INFO:teuthology.orchestra.run.smithi131.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-11-28T19:27:42.637 INFO:teuthology.orchestra.run.smithi131.stdout:Get:46 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-7520-g43dd94c1-1jammy [63.5 kB] 2023-11-28T19:27:42.697 INFO:teuthology.orchestra.run.smithi131.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-7520-g43dd94c1-1jammy [330 kB] 2023-11-28T19:27:42.826 INFO:teuthology.orchestra.run.smithi028.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T19:27:42.838 INFO:teuthology.orchestra.run.smithi203.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7520-g43dd94c1-1jammy [238 kB] 2023-11-28T19:27:42.846 INFO:teuthology.orchestra.run.smithi131.stdout:Get:48 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-7520-g43dd94c1-1jammy [6,233 kB] 2023-11-28T19:27:42.862 INFO:teuthology.orchestra.run.smithi203.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7520-g43dd94c1-1jammy [124 kB] 2023-11-28T19:27:42.871 INFO:teuthology.orchestra.run.smithi028.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T19:27:42.885 INFO:teuthology.orchestra.run.smithi203.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7520-g43dd94c1-1jammy [1,496 kB] 2023-11-28T19:27:42.895 INFO:teuthology.orchestra.run.smithi028.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T19:27:42.897 INFO:teuthology.orchestra.run.smithi131.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-11-28T19:27:42.904 INFO:teuthology.orchestra.run.smithi028.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T19:27:42.948 INFO:teuthology.orchestra.run.smithi028.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T19:27:42.973 INFO:teuthology.orchestra.run.smithi028.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T19:27:42.975 INFO:teuthology.orchestra.run.smithi028.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T19:27:42.979 INFO:teuthology.orchestra.run.smithi131.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-11-28T19:27:42.982 INFO:teuthology.orchestra.run.smithi028.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T19:27:43.055 INFO:teuthology.orchestra.run.smithi203.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7520-g43dd94c1-1jammy [9,956 kB] 2023-11-28T19:27:43.063 INFO:teuthology.orchestra.run.smithi131.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-11-28T19:27:43.147 INFO:teuthology.orchestra.run.smithi131.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-11-28T19:27:43.149 INFO:teuthology.orchestra.run.smithi028.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T19:27:43.320 INFO:teuthology.orchestra.run.smithi131.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-11-28T19:27:43.425 INFO:teuthology.orchestra.run.smithi131.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-11-28T19:27:43.594 INFO:teuthology.orchestra.run.smithi131.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2023-11-28T19:27:43.682 INFO:teuthology.orchestra.run.smithi028.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T19:27:43.687 INFO:teuthology.orchestra.run.smithi028.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T19:27:43.727 INFO:teuthology.orchestra.run.smithi028.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T19:27:43.728 INFO:teuthology.orchestra.run.smithi028.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T19:27:43.734 INFO:teuthology.orchestra.run.smithi028.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T19:27:43.737 INFO:teuthology.orchestra.run.smithi028.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T19:27:43.778 INFO:teuthology.orchestra.run.smithi028.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T19:27:43.787 INFO:teuthology.orchestra.run.smithi028.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T19:27:43.860 INFO:teuthology.orchestra.run.smithi028.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T19:27:43.861 INFO:teuthology.orchestra.run.smithi028.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T19:27:43.941 INFO:teuthology.orchestra.run.smithi131.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2023-11-28T19:27:44.037 INFO:teuthology.orchestra.run.smithi028.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T19:27:44.053 INFO:teuthology.orchestra.run.smithi131.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-11-28T19:27:44.247 INFO:teuthology.orchestra.run.smithi131.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-11-28T19:27:44.335 INFO:teuthology.orchestra.run.smithi131.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-11-28T19:27:44.420 INFO:teuthology.orchestra.run.smithi203.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7520-g43dd94c1-1jammy [31.9 MB] 2023-11-28T19:27:44.426 INFO:teuthology.orchestra.run.smithi131.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-11-28T19:27:44.472 INFO:teuthology.orchestra.run.smithi028.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T19:27:44.487 INFO:teuthology.orchestra.run.smithi028.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T19:27:44.547 INFO:teuthology.orchestra.run.smithi131.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-11-28T19:27:44.992 INFO:teuthology.orchestra.run.smithi131.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-11-28T19:27:45.076 INFO:teuthology.orchestra.run.smithi131.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-11-28T19:27:45.160 INFO:teuthology.orchestra.run.smithi131.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-11-28T19:27:45.243 INFO:teuthology.orchestra.run.smithi131.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-11-28T19:27:45.409 INFO:teuthology.orchestra.run.smithi131.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-11-28T19:27:46.111 INFO:teuthology.orchestra.run.smithi131.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-11-28T19:27:46.198 INFO:teuthology.orchestra.run.smithi131.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-11-28T19:27:46.244 INFO:teuthology.orchestra.run.smithi131.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-7520-g43dd94c1-1jammy [112 kB] 2023-11-28T19:27:46.281 INFO:teuthology.orchestra.run.smithi131.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-11-28T19:27:46.293 INFO:teuthology.orchestra.run.smithi131.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-7520-g43dd94c1-1jammy [439 kB] 2023-11-28T19:27:46.368 INFO:teuthology.orchestra.run.smithi028.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7520-g43dd94c1-1jammy [6,900 kB] 2023-11-28T19:27:46.413 INFO:teuthology.orchestra.run.smithi131.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-11-28T19:27:46.447 INFO:teuthology.orchestra.run.smithi131.stdout:Get:73 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-7520-g43dd94c1-1jammy [22.6 MB] 2023-11-28T19:27:46.496 INFO:teuthology.orchestra.run.smithi131.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-11-28T19:27:46.579 INFO:teuthology.orchestra.run.smithi131.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-11-28T19:27:46.662 INFO:teuthology.orchestra.run.smithi131.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-11-28T19:27:46.745 INFO:teuthology.orchestra.run.smithi131.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-11-28T19:27:46.827 INFO:teuthology.orchestra.run.smithi131.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-11-28T19:27:46.910 INFO:teuthology.orchestra.run.smithi131.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-11-28T19:27:47.074 INFO:teuthology.orchestra.run.smithi131.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-11-28T19:27:47.355 INFO:teuthology.orchestra.run.smithi028.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7520-g43dd94c1-1jammy [238 kB] 2023-11-28T19:27:47.373 INFO:teuthology.orchestra.run.smithi028.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7520-g43dd94c1-1jammy [124 kB] 2023-11-28T19:27:47.407 INFO:teuthology.orchestra.run.smithi028.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7520-g43dd94c1-1jammy [1,496 kB] 2023-11-28T19:27:47.568 INFO:teuthology.orchestra.run.smithi131.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-11-28T19:27:47.628 INFO:teuthology.orchestra.run.smithi028.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7520-g43dd94c1-1jammy [9,956 kB] 2023-11-28T19:27:47.678 INFO:teuthology.orchestra.run.smithi131.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-11-28T19:27:47.782 INFO:teuthology.orchestra.run.smithi131.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-11-28T19:27:47.872 INFO:teuthology.orchestra.run.smithi131.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-11-28T19:27:48.012 INFO:teuthology.orchestra.run.smithi131.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-11-28T19:27:48.131 INFO:teuthology.orchestra.run.smithi131.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-11-28T19:27:48.139 INFO:teuthology.orchestra.run.smithi203.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7520-g43dd94c1-1jammy [14.1 kB] 2023-11-28T19:27:48.140 INFO:teuthology.orchestra.run.smithi203.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [839 kB] 2023-11-28T19:27:48.214 INFO:teuthology.orchestra.run.smithi131.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2023-11-28T19:27:48.217 INFO:teuthology.orchestra.run.smithi203.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7520-g43dd94c1-1jammy [2,148 kB] 2023-11-28T19:27:48.307 INFO:teuthology.orchestra.run.smithi131.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2023-11-28T19:27:48.393 INFO:teuthology.orchestra.run.smithi131.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-11-28T19:27:48.444 INFO:teuthology.orchestra.run.smithi203.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7520-g43dd94c1-1jammy [801 kB] 2023-11-28T19:27:48.516 INFO:teuthology.orchestra.run.smithi203.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7520-g43dd94c1-1jammy [139 kB] 2023-11-28T19:27:48.539 INFO:teuthology.orchestra.run.smithi203.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7520-g43dd94c1-1jammy [1,900 kB] 2023-11-28T19:27:48.540 INFO:teuthology.orchestra.run.smithi131.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-11-28T19:27:48.709 INFO:teuthology.orchestra.run.smithi131.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-11-28T19:27:48.723 INFO:teuthology.orchestra.run.smithi203.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7520-g43dd94c1-1jammy [8,625 kB] 2023-11-28T19:27:49.198 INFO:teuthology.orchestra.run.smithi131.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-11-28T19:27:49.205 INFO:teuthology.orchestra.run.smithi028.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7520-g43dd94c1-1jammy [31.9 MB] 2023-11-28T19:27:49.280 INFO:teuthology.orchestra.run.smithi131.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-11-28T19:27:49.372 INFO:teuthology.orchestra.run.smithi131.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-11-28T19:27:49.457 INFO:teuthology.orchestra.run.smithi131.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-11-28T19:27:49.568 INFO:teuthology.orchestra.run.smithi131.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-11-28T19:27:49.640 INFO:teuthology.orchestra.run.smithi203.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7520-g43dd94c1-1jammy [14.2 kB] 2023-11-28T19:27:49.640 INFO:teuthology.orchestra.run.smithi203.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7520-g43dd94c1-1jammy [48.7 MB] 2023-11-28T19:27:49.663 INFO:teuthology.orchestra.run.smithi131.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-11-28T19:27:49.885 INFO:teuthology.orchestra.run.smithi131.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-11-28T19:27:49.969 INFO:teuthology.orchestra.run.smithi131.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-11-28T19:27:50.051 INFO:teuthology.orchestra.run.smithi131.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-11-28T19:27:50.145 INFO:teuthology.orchestra.run.smithi131.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-11-28T19:27:50.311 INFO:teuthology.orchestra.run.smithi131.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-11-28T19:27:52.049 INFO:teuthology.orchestra.run.smithi131.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-7520-g43dd94c1-1jammy [6,900 kB] 2023-11-28T19:27:52.897 INFO:teuthology.orchestra.run.smithi131.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-7520-g43dd94c1-1jammy [238 kB] 2023-11-28T19:27:52.916 INFO:teuthology.orchestra.run.smithi131.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-7520-g43dd94c1-1jammy [124 kB] 2023-11-28T19:27:52.924 INFO:teuthology.orchestra.run.smithi131.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-7520-g43dd94c1-1jammy [1,496 kB] 2023-11-28T19:27:53.106 INFO:teuthology.orchestra.run.smithi131.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-7520-g43dd94c1-1jammy [9,956 kB] 2023-11-28T19:27:53.975 INFO:teuthology.orchestra.run.smithi028.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7520-g43dd94c1-1jammy [14.1 kB] 2023-11-28T19:27:53.976 INFO:teuthology.orchestra.run.smithi028.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [839 kB] 2023-11-28T19:27:53.994 INFO:teuthology.orchestra.run.smithi028.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7520-g43dd94c1-1jammy [2,148 kB] 2023-11-28T19:27:54.234 INFO:teuthology.orchestra.run.smithi028.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7520-g43dd94c1-1jammy [801 kB] 2023-11-28T19:27:54.343 INFO:teuthology.orchestra.run.smithi028.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7520-g43dd94c1-1jammy [139 kB] 2023-11-28T19:27:54.352 INFO:teuthology.orchestra.run.smithi028.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7520-g43dd94c1-1jammy [1,900 kB] 2023-11-28T19:27:54.457 INFO:teuthology.orchestra.run.smithi131.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-7520-g43dd94c1-1jammy [31.9 MB] 2023-11-28T19:27:54.559 INFO:teuthology.orchestra.run.smithi028.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7520-g43dd94c1-1jammy [8,625 kB] 2023-11-28T19:27:55.401 INFO:teuthology.orchestra.run.smithi028.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7520-g43dd94c1-1jammy [14.2 kB] 2023-11-28T19:27:55.425 INFO:teuthology.orchestra.run.smithi028.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7520-g43dd94c1-1jammy [48.7 MB] 2023-11-28T19:27:56.480 INFO:teuthology.orchestra.run.smithi203.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7520-g43dd94c1-1jammy [121 kB] 2023-11-28T19:27:56.481 INFO:teuthology.orchestra.run.smithi203.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7520-g43dd94c1-1jammy [225 kB] 2023-11-28T19:27:56.483 INFO:teuthology.orchestra.run.smithi203.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7520-g43dd94c1-1jammy [34.0 kB] 2023-11-28T19:27:56.483 INFO:teuthology.orchestra.run.smithi203.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7520-g43dd94c1-1jammy [23.4 kB] 2023-11-28T19:27:56.508 INFO:teuthology.orchestra.run.smithi203.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7520-g43dd94c1-1jammy [38.4 kB] 2023-11-28T19:27:56.509 INFO:teuthology.orchestra.run.smithi203.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7520-g43dd94c1-1jammy [12.3 MB] 2023-11-28T19:27:57.864 INFO:teuthology.orchestra.run.smithi203.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [91.2 kB] 2023-11-28T19:27:58.283 INFO:teuthology.orchestra.run.smithi131.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-7520-g43dd94c1-1jammy [14.1 kB] 2023-11-28T19:27:58.284 INFO:teuthology.orchestra.run.smithi131.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [839 kB] 2023-11-28T19:27:58.300 INFO:teuthology.orchestra.run.smithi131.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-7520-g43dd94c1-1jammy [2,148 kB] 2023-11-28T19:27:58.363 INFO:teuthology.orchestra.run.smithi131.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-7520-g43dd94c1-1jammy [801 kB] 2023-11-28T19:27:58.420 INFO:teuthology.orchestra.run.smithi131.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-7520-g43dd94c1-1jammy [139 kB] 2023-11-28T19:27:58.430 INFO:teuthology.orchestra.run.smithi131.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-7520-g43dd94c1-1jammy [1,900 kB] 2023-11-28T19:27:58.518 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 187 MB in 20s (9,133 kB/s) 2023-11-28T19:27:58.563 INFO:teuthology.orchestra.run.smithi131.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-7520-g43dd94c1-1jammy [8,625 kB] 2023-11-28T19:27:58.700 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T19:27:58.769 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132930 files and directories currently installed.) 2023-11-28T19:27:58.773 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T19:27:58.815 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T19:27:59.152 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T19:27:59.165 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T19:27:59.174 INFO:teuthology.orchestra.run.smithi131.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-7520-g43dd94c1-1jammy [14.2 kB] 2023-11-28T19:27:59.174 INFO:teuthology.orchestra.run.smithi131.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-7520-g43dd94c1-1jammy [48.7 MB] 2023-11-28T19:27:59.210 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T19:27:59.529 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T19:27:59.543 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T19:27:59.588 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T19:27:59.736 INFO:teuthology.orchestra.run.smithi028.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7520-g43dd94c1-1jammy [121 kB] 2023-11-28T19:27:59.738 INFO:teuthology.orchestra.run.smithi028.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7520-g43dd94c1-1jammy [225 kB] 2023-11-28T19:27:59.743 INFO:teuthology.orchestra.run.smithi028.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7520-g43dd94c1-1jammy [34.0 kB] 2023-11-28T19:27:59.744 INFO:teuthology.orchestra.run.smithi028.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7520-g43dd94c1-1jammy [23.4 kB] 2023-11-28T19:27:59.745 INFO:teuthology.orchestra.run.smithi028.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7520-g43dd94c1-1jammy [38.4 kB] 2023-11-28T19:27:59.746 INFO:teuthology.orchestra.run.smithi028.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7520-g43dd94c1-1jammy [12.3 MB] 2023-11-28T19:27:59.940 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T19:27:59.954 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T19:28:00.040 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T19:28:00.375 INFO:teuthology.orchestra.run.smithi028.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [91.2 kB] 2023-11-28T19:28:00.419 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T19:28:00.433 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T19:28:00.477 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T19:28:00.855 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T19:28:00.869 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T19:28:00.914 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:28:01.013 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 187 MB in 23s (8,037 kB/s) 2023-11-28T19:28:01.137 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T19:28:01.190 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2023-11-28T19:28:01.194 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T19:28:01.228 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T19:28:01.367 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T19:28:01.382 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:28:01.434 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:28:01.505 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T19:28:01.526 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T19:28:01.563 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T19:28:01.845 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T19:28:01.860 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:28:01.891 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T19:28:01.904 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:28:01.912 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T19:28:01.958 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T19:28:01.993 INFO:teuthology.orchestra.run.smithi131.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-7520-g43dd94c1-1jammy [121 kB] 2023-11-28T19:28:01.995 INFO:teuthology.orchestra.run.smithi131.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-7520-g43dd94c1-1jammy [225 kB] 2023-11-28T19:28:02.000 INFO:teuthology.orchestra.run.smithi131.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-7520-g43dd94c1-1jammy [34.0 kB] 2023-11-28T19:28:02.067 INFO:teuthology.orchestra.run.smithi131.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-7520-g43dd94c1-1jammy [23.4 kB] 2023-11-28T19:28:02.068 INFO:teuthology.orchestra.run.smithi131.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-7520-g43dd94c1-1jammy [38.4 kB] 2023-11-28T19:28:02.069 INFO:teuthology.orchestra.run.smithi131.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-7520-g43dd94c1-1jammy [12.3 MB] 2023-11-28T19:28:02.240 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T19:28:02.255 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:28:02.290 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:28:02.294 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T19:28:02.315 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T19:28:02.394 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T19:28:02.454 INFO:teuthology.orchestra.run.smithi131.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20231127.102914/43dd94c190073cf16cff1e711dd7f5a7b1cbc883/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-7520-g43dd94c1-1jammy [91.2 kB] 2023-11-28T19:28:02.652 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T19:28:02.667 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T19:28:02.709 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T19:28:02.806 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T19:28:02.826 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T19:28:02.930 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T19:28:03.054 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librados2. 2023-11-28T19:28:03.058 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 187 MB in 25s (7,352 kB/s) 2023-11-28T19:28:03.069 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../010-librados2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:03.112 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:03.258 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T19:28:03.264 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyperclip. 2023-11-28T19:28:03.279 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T19:28:03.317 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:28:03.351 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130504 files and directories currently installed.) 2023-11-28T19:28:03.355 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-11-28T19:28:03.396 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-11-28T19:28:03.682 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librbd1. 2023-11-28T19:28:03.696 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../011-librbd1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:03.707 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-wcwidth. 2023-11-28T19:28:03.728 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-11-28T19:28:03.740 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:03.766 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T19:28:03.770 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T19:28:03.791 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:28:03.836 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:28:04.068 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cmd2. 2023-11-28T19:28:04.089 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-11-28T19:28:04.118 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-11-28T19:28:04.193 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T19:28:04.207 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T19:28:04.207 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:04.227 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:28:04.251 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:04.256 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:28:04.455 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-11-28T19:28:04.475 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-11-28T19:28:04.539 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T19:28:04.553 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rados. 2023-11-28T19:28:04.567 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T19:28:04.568 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:04.588 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:28:04.612 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:04.626 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:28:04.876 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-11-28T19:28:04.896 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-11-28T19:28:04.934 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T19:28:04.956 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T19:28:04.971 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:04.978 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T19:28:04.999 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T19:28:05.006 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:05.037 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T19:28:05.234 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T19:28:05.248 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:05.270 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-11-28T19:28:05.291 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T19:28:05.300 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:05.328 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:28:05.349 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librados2. 2023-11-28T19:28:05.368 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../010-librados2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:05.398 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:05.645 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T19:28:05.660 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:05.703 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:05.817 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librbd1. 2023-11-28T19:28:05.838 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../011-librbd1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:05.875 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:05.891 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-11-28T19:28:05.911 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:28:05.949 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:28:06.056 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T19:28:06.071 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T19:28:06.114 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T19:28:06.311 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T19:28:06.332 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:06.369 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-11-28T19:28:06.369 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:06.389 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:28:06.400 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T19:28:06.414 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:06.427 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:28:06.458 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:06.680 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rados. 2023-11-28T19:28:06.693 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:06.730 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:06.761 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T19:28:06.776 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T19:28:06.814 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-11-28T19:28:06.835 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-11-28T19:28:06.844 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T19:28:06.873 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:28:07.000 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T19:28:07.020 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:07.049 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:07.122 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T19:28:07.137 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T19:28:07.180 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T19:28:07.201 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-11-28T19:28:07.222 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-11-28T19:28:07.252 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T19:28:07.259 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T19:28:07.264 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:07.321 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:07.499 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T19:28:07.514 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T19:28:07.558 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T19:28:07.587 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librados2. 2023-11-28T19:28:07.608 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../010-librados2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:07.621 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T19:28:07.642 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:07.645 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:07.679 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:07.928 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua5.1. 2023-11-28T19:28:07.943 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T19:28:07.986 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T19:28:07.998 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T19:28:08.019 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T19:28:08.057 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T19:28:08.124 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librbd1. 2023-11-28T19:28:08.144 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../011-librbd1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:08.181 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:08.314 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua-any. 2023-11-28T19:28:08.329 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T19:28:08.364 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T19:28:08.435 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T19:28:08.457 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:08.493 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:08.585 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libcephfs2. 2023-11-28T19:28:08.606 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../012-libcephfs2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:08.634 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:08.795 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T19:28:08.817 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T19:28:08.845 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T19:28:08.921 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rados. 2023-11-28T19:28:08.941 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../013-python3-rados_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:08.979 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:09.114 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T19:28:09.135 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T19:28:09.173 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T19:28:09.283 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package zip. 2023-11-28T19:28:09.299 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T19:28:09.315 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-11-28T19:28:09.336 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../014-python3-ceph-argparse_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:09.367 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T19:28:09.373 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:09.484 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T19:28:09.496 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T19:28:09.534 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T19:28:09.626 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cephfs. 2023-11-28T19:28:09.646 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../015-python3-cephfs_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:09.685 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:09.686 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package unzip. 2023-11-28T19:28:09.702 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T19:28:09.745 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T19:28:09.862 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua5.1. 2023-11-28T19:28:09.883 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T19:28:09.920 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T19:28:10.037 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-ceph-common. 2023-11-28T19:28:10.061 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../016-python3-ceph-common_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:10.096 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:10.124 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package luarocks. 2023-11-28T19:28:10.138 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T19:28:10.174 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T19:28:10.190 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua-any. 2023-11-28T19:28:10.211 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T19:28:10.239 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T19:28:10.425 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-prettytable. 2023-11-28T19:28:10.445 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2023-11-28T19:28:10.482 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-11-28T19:28:10.556 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package librgw2. 2023-11-28T19:28:10.571 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../027-librgw2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:10.614 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:10.752 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rbd. 2023-11-28T19:28:10.773 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../018-python3-rbd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:10.810 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:11.091 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T19:28:11.106 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:11.122 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-11-28T19:28:11.143 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-11-28T19:28:11.149 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:11.180 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T19:28:11.251 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package zip. 2023-11-28T19:28:11.272 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T19:28:11.309 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T19:28:11.466 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libreadline-dev:amd64. 2023-11-28T19:28:11.487 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2023-11-28T19:28:11.494 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T19:28:11.510 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T19:28:11.524 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T19:28:11.553 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T19:28:11.771 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package unzip. 2023-11-28T19:28:11.792 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T19:28:11.829 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T19:28:11.844 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2023-11-28T19:28:11.857 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2023-11-28T19:28:11.864 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T19:28:11.878 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:11.894 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T19:28:11.913 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:12.174 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package luarocks. 2023-11-28T19:28:12.195 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T19:28:12.198 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua5.1. 2023-11-28T19:28:12.210 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2023-11-28T19:28:12.224 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T19:28:12.239 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2023-11-28T19:28:12.325 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-common. 2023-11-28T19:28:12.340 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:12.384 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:12.559 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-any. 2023-11-28T19:28:12.573 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package librgw2. 2023-11-28T19:28:12.580 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2023-11-28T19:28:12.593 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../027-librgw2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:12.617 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-any (27ubuntu1) ... 2023-11-28T19:28:12.631 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:12.870 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package zip. 2023-11-28T19:28:12.882 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2023-11-28T19:28:12.920 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking zip (3.0-12build2) ... 2023-11-28T19:28:13.158 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T19:28:13.180 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:13.216 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:13.240 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package unzip. 2023-11-28T19:28:13.261 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.1_amd64.deb ... 2023-11-28T19:28:13.290 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking unzip (6.0-26ubuntu3.1) ... 2023-11-28T19:28:13.397 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-base. 2023-11-28T19:28:13.412 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:13.456 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:13.686 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package luarocks. 2023-11-28T19:28:13.707 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2023-11-28T19:28:13.730 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T19:28:13.744 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2023-11-28T19:28:13.753 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T19:28:13.779 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T19:28:14.074 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T19:28:14.095 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:14.119 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package librgw2. 2023-11-28T19:28:14.132 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:14.140 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../027-librgw2_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:14.177 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:14.362 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T19:28:14.376 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T19:28:14.420 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T19:28:14.560 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-common. 2023-11-28T19:28:14.581 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:14.618 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:14.688 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rgw. 2023-11-28T19:28:14.700 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../028-python3-rgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:14.706 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T19:28:14.721 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T19:28:14.738 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:14.789 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T19:28:15.092 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T19:28:15.100 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liboath0:amd64. 2023-11-28T19:28:15.107 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T19:28:15.121 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2023-11-28T19:28:15.142 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T19:28:15.166 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T19:28:15.445 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T19:28:15.460 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T19:28:15.469 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libradosstriper1. 2023-11-28T19:28:15.490 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../030-libradosstriper1_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:15.504 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T19:28:15.536 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:15.832 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T19:28:15.847 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T19:28:15.865 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-base. 2023-11-28T19:28:15.886 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:15.890 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T19:28:15.924 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:16.205 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T19:28:16.215 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-common. 2023-11-28T19:28:16.220 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T19:28:16.236 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../031-ceph-common_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:16.260 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T19:28:16.281 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:16.539 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-portend. 2023-11-28T19:28:16.553 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T19:28:16.597 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T19:28:16.628 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T19:28:16.640 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T19:28:16.677 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T19:28:16.924 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T19:28:16.940 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T19:28:16.972 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T19:28:16.983 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T19:28:16.993 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T19:28:17.030 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T19:28:17.302 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T19:28:17.316 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T19:28:17.352 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T19:28:17.357 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T19:28:17.379 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T19:28:17.415 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T19:28:17.704 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-base. 2023-11-28T19:28:17.718 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T19:28:17.725 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../032-ceph-base_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:17.731 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T19:28:17.739 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T19:28:17.745 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T19:28:17.771 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:17.776 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T19:28:17.781 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T19:28:18.034 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T19:28:18.048 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T19:28:18.063 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T19:28:18.084 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T19:28:18.118 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T19:28:18.129 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T19:28:18.429 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T19:28:18.432 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T19:28:18.444 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T19:28:18.453 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T19:28:18.461 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-11-28T19:28:18.479 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-11-28T19:28:18.487 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T19:28:18.490 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T19:28:18.517 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-11-28T19:28:18.762 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cheroot. 2023-11-28T19:28:18.782 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-11-28T19:28:18.811 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T19:28:18.815 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-mako. 2023-11-28T19:28:18.830 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T19:28:18.874 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T19:28:18.926 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-portend. 2023-11-28T19:28:18.947 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T19:28:18.976 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T19:28:19.115 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-11-28T19:28:19.135 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-11-28T19:28:19.173 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-11-28T19:28:19.244 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T19:28:19.259 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T19:28:19.302 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T19:28:19.379 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T19:28:19.400 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T19:28:19.437 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T19:28:19.476 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.text. 2023-11-28T19:28:19.497 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2023-11-28T19:28:19.534 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-11-28T19:28:19.631 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T19:28:19.646 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T19:28:19.689 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T19:28:19.773 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T19:28:19.794 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T19:28:19.804 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-11-28T19:28:19.824 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-11-28T19:28:19.831 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T19:28:19.862 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-11-28T19:28:19.992 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-webob. 2023-11-28T19:28:20.007 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T19:28:20.075 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T19:28:20.135 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T19:28:20.149 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-tempora. 2023-11-28T19:28:20.156 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T19:28:20.169 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2023-11-28T19:28:20.201 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T19:28:20.207 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-11-28T19:28:20.412 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T19:28:20.427 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T19:28:20.465 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T19:28:20.510 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-portend. 2023-11-28T19:28:20.521 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T19:28:20.530 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2023-11-28T19:28:20.542 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T19:28:20.568 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-11-28T19:28:20.579 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T19:28:20.781 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T19:28:20.796 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T19:28:20.839 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T19:28:20.871 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-11-28T19:28:20.882 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T19:28:20.892 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2023-11-28T19:28:20.903 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T19:28:20.929 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-11-28T19:28:20.940 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T19:28:21.176 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-paste. 2023-11-28T19:28:21.192 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T19:28:21.234 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T19:28:21.249 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cherrypy3. 2023-11-28T19:28:21.270 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2023-11-28T19:28:21.276 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-mako. 2023-11-28T19:28:21.297 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T19:28:21.308 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-11-28T19:28:21.334 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T19:28:21.571 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T19:28:21.586 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T19:28:21.630 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T19:28:21.678 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-natsort. 2023-11-28T19:28:21.679 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T19:28:21.699 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2023-11-28T19:28:21.700 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T19:28:21.736 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-11-28T19:28:21.737 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T19:28:21.954 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T19:28:21.969 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T19:28:22.016 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T19:28:22.040 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T19:28:22.061 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T19:28:22.078 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-logutils. 2023-11-28T19:28:22.098 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T19:28:22.098 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2023-11-28T19:28:22.140 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-11-28T19:28:22.319 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T19:28:22.334 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T19:28:22.377 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T19:28:22.443 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-markupsafe. 2023-11-28T19:28:22.463 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-11-28T19:28:22.493 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-webob. 2023-11-28T19:28:22.501 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-11-28T19:28:22.514 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T19:28:22.559 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T19:28:22.664 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T19:28:22.679 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T19:28:22.714 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T19:28:22.804 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-mako. 2023-11-28T19:28:22.824 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-11-28T19:28:22.862 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T19:28:22.979 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T19:28:23.000 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T19:28:23.048 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T19:28:23.077 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T19:28:23.092 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T19:28:23.135 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T19:28:23.191 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-simplegeneric. 2023-11-28T19:28:23.212 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2023-11-28T19:28:23.249 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-11-28T19:28:23.390 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T19:28:23.411 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T19:28:23.448 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T19:28:23.497 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-idna. 2023-11-28T19:28:23.512 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T19:28:23.518 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-singledispatch. 2023-11-28T19:28:23.530 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-11-28T19:28:23.555 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T19:28:23.560 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-11-28T19:28:23.767 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-paste. 2023-11-28T19:28:23.789 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T19:28:23.821 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-webob. 2023-11-28T19:28:23.825 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T19:28:23.833 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T19:28:23.842 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-11-28T19:28:23.848 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T19:28:23.880 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-11-28T19:28:23.916 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T19:28:24.170 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T19:28:24.183 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T19:28:24.220 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T19:28:24.225 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-waitress. 2023-11-28T19:28:24.246 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-11-28T19:28:24.286 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T19:28:24.412 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-requests. 2023-11-28T19:28:24.427 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T19:28:24.470 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T19:28:24.490 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T19:28:24.503 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T19:28:24.531 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T19:28:24.595 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-tempita. 2023-11-28T19:28:24.607 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-11-28T19:28:24.644 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T19:28:24.826 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T19:28:24.847 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T19:28:24.857 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T19:28:24.872 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T19:28:24.884 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T19:28:24.915 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T19:28:24.939 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-paste. 2023-11-28T19:28:24.960 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-11-28T19:28:24.998 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T19:28:25.204 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T19:28:25.225 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T19:28:25.229 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T19:28:25.242 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:25.278 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T19:28:25.331 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:25.351 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-11-28T19:28:25.372 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-11-28T19:28:25.409 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T19:28:25.642 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T19:28:25.663 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T19:28:25.699 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T19:28:25.707 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T19:28:25.712 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pastedeploy. 2023-11-28T19:28:25.714 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:25.734 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2023-11-28T19:28:25.748 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:25.771 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-11-28T19:28:26.041 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-webtest. 2023-11-28T19:28:26.044 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-idna. 2023-11-28T19:28:26.062 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2023-11-28T19:28:26.065 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T19:28:26.091 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-11-28T19:28:26.102 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T19:28:26.135 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T19:28:26.150 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T19:28:26.193 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T19:28:26.422 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T19:28:33.125 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T19:28:33.125 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T19:28:33.126 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-requests. 2023-11-28T19:28:33.126 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T19:28:33.126 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T19:28:33.126 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T19:28:33.126 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T19:28:33.126 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T19:28:33.126 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T19:28:33.126 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:33.126 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.126 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T19:28:33.127 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.127 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.127 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T19:28:33.127 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T19:28:33.127 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T19:28:33.127 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T19:28:33.127 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T19:28:33.127 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T19:28:33.127 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T19:28:33.127 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.157 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.157 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T19:28:33.157 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.157 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.157 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T19:28:33.157 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.157 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.157 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph. 2023-11-28T19:28:33.158 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../068-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.158 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.159 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T19:28:33.159 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T19:28:33.159 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T19:28:33.159 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T19:28:33.159 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.159 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.159 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T19:28:33.159 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.159 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.159 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T19:28:33.159 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.160 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.160 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph. 2023-11-28T19:28:33.160 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../068-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.160 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.160 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T19:28:33.160 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.160 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.160 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T19:28:33.160 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.160 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.160 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package cephadm. 2023-11-28T19:28:33.160 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../071-cephadm_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.160 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.161 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T19:28:33.161 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T19:28:33.161 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T19:28:33.161 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T19:28:33.161 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T19:28:33.161 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T19:28:33.161 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-babel. 2023-11-28T19:28:33.161 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T19:28:33.161 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T19:28:33.161 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T19:28:33.161 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T19:28:33.161 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T19:28:33.162 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pecan. 2023-11-28T19:28:33.162 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-11-28T19:28:33.162 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T19:28:33.162 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-certifi. 2023-11-28T19:28:33.162 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2023-11-28T19:28:33.162 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-11-28T19:28:33.162 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-idna. 2023-11-28T19:28:33.162 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2023-11-28T19:28:33.162 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-idna (3.3-1) ... 2023-11-28T19:28:33.162 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-urllib3. 2023-11-28T19:28:33.163 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2023-11-28T19:28:33.163 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T19:28:33.163 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-requests. 2023-11-28T19:28:33.163 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2023-11-28T19:28:33.163 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T19:28:33.163 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-werkzeug. 2023-11-28T19:28:33.163 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-11-28T19:28:33.163 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T19:28:33.163 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-11-28T19:28:33.163 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:33.163 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.163 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-11-28T19:28:33.163 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.164 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.164 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-bcrypt. 2023-11-28T19:28:33.164 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-11-28T19:28:33.164 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-11-28T19:28:33.164 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-openssl. 2023-11-28T19:28:33.164 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2023-11-28T19:28:33.164 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-11-28T19:28:33.164 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr. 2023-11-28T19:28:33.164 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../065-ceph-mgr_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.164 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.164 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mon. 2023-11-28T19:28:33.164 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../066-ceph-mon_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.164 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.165 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-osd. 2023-11-28T19:28:33.165 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../067-ceph-osd_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.165 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.312 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T19:28:33.334 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.370 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.394 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T19:28:33.409 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:33.454 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.740 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T19:28:33.762 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:33.798 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:33.822 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T19:28:33.838 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T19:28:33.881 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T19:28:33.966 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph. 2023-11-28T19:28:33.978 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../068-ceph_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:34.015 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:34.168 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephadm. 2023-11-28T19:28:34.189 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../071-cephadm_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:34.217 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-routes. 2023-11-28T19:28:34.226 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:34.232 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T19:28:34.275 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T19:28:34.335 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-fuse. 2023-11-28T19:28:34.356 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../069-ceph-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:34.385 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:34.545 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T19:28:34.567 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T19:28:34.620 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T19:28:34.662 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T19:28:34.677 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:34.720 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:34.855 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mds. 2023-11-28T19:28:34.876 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../070-ceph-mds_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:34.922 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:34.940 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T19:28:34.961 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T19:28:35.006 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T19:28:35.165 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T19:28:35.180 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T19:28:35.223 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T19:28:35.309 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephadm. 2023-11-28T19:28:35.329 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../071-cephadm_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:35.375 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:35.744 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T19:28:35.753 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-asyncssh. 2023-11-28T19:28:35.758 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T19:28:35.774 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2023-11-28T19:28:35.802 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T19:28:35.820 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-11-28T19:28:36.069 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-babel. 2023-11-28T19:28:36.091 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T19:28:36.135 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T19:28:36.156 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-babel-localedata. 2023-11-28T19:28:36.168 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T19:28:36.198 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T19:28:36.212 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T19:28:36.214 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T19:28:36.333 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T19:28:36.472 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T19:28:36.493 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T19:28:36.538 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T19:28:36.661 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T19:28:36.677 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T19:28:36.719 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T19:28:36.891 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T19:28:36.913 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:36.958 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:37.294 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T19:28:37.316 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T19:28:37.361 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T19:28:37.397 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T19:28:37.410 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:37.455 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:37.503 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-babel. 2023-11-28T19:28:37.525 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-11-28T19:28:37.570 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T19:28:37.672 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-routes. 2023-11-28T19:28:37.694 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T19:28:37.738 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T19:28:37.898 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-jinja2. 2023-11-28T19:28:37.919 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1_all.deb ... 2023-11-28T19:28:37.956 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-11-28T19:28:38.083 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T19:28:38.105 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:38.150 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:38.310 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-11-28T19:28:38.330 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:38.368 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:38.433 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T19:28:38.448 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T19:28:38.516 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T19:28:38.586 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T19:28:38.599 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T19:28:38.636 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T19:28:38.713 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-repoze.lru. 2023-11-28T19:28:38.734 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2023-11-28T19:28:38.771 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-11-28T19:28:38.819 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T19:28:38.835 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T19:28:38.877 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T19:28:39.074 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-routes. 2023-11-28T19:28:39.095 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-11-28T19:28:39.132 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T19:28:39.248 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T19:28:39.264 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T19:28:39.306 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T19:28:39.323 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T19:28:39.345 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T19:28:39.389 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T19:28:39.478 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-11-28T19:28:39.499 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:39.536 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:39.751 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T19:28:39.772 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T19:28:39.843 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T19:28:39.858 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T19:28:39.903 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T19:28:39.926 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T19:28:39.956 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-11-28T19:28:39.978 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-11-28T19:28:40.023 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T19:28:40.189 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T19:28:40.211 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T19:28:40.213 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T19:28:40.229 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T19:28:40.255 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T19:28:40.263 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T19:28:40.568 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-joblib. 2023-11-28T19:28:40.589 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-11-28T19:28:40.600 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T19:28:40.615 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T19:28:40.626 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T19:28:40.658 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T19:28:40.922 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T19:28:40.944 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:40.980 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-11-28T19:28:40.988 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:40.992 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-11-28T19:28:41.003 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T19:28:41.018 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T19:28:41.061 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T19:28:41.116 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-11-28T19:28:41.382 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T19:28:41.398 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T19:28:41.436 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-sklearn. 2023-11-28T19:28:41.440 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T19:28:41.458 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-11-28T19:28:41.494 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T19:28:41.941 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T19:28:41.963 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T19:28:42.008 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T19:28:42.112 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T19:28:42.126 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:42.171 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:42.187 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-11-28T19:28:42.208 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:42.253 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:42.302 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T19:28:42.324 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T19:28:42.369 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T19:28:42.507 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T19:28:42.521 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T19:28:42.565 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T19:28:42.722 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T19:28:42.744 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T19:28:42.789 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T19:28:42.927 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T19:28:42.941 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T19:28:42.985 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T19:28:43.099 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T19:28:43.112 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T19:28:43.149 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T19:28:43.206 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-cachetools. 2023-11-28T19:28:43.228 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2023-11-28T19:28:43.271 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package jq. 2023-11-28T19:28:43.273 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-11-28T19:28:43.286 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T19:28:43.330 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T19:28:43.478 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T19:28:43.500 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T19:28:43.528 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T19:28:43.551 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyasn1. 2023-11-28T19:28:43.573 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2023-11-28T19:28:43.582 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package socat. 2023-11-28T19:28:43.598 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T19:28:43.618 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-11-28T19:28:43.641 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T19:28:43.806 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T19:28:43.828 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T19:28:43.872 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T19:28:43.955 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-11-28T19:28:43.976 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-11-28T19:28:43.994 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T19:28:44.010 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T19:28:44.013 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T19:28:44.052 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T19:28:44.217 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T19:28:44.239 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T19:28:44.283 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T19:28:44.325 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-rsa. 2023-11-28T19:28:44.346 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2023-11-28T19:28:44.407 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-test. 2023-11-28T19:28:44.407 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-rsa (4.8-1) ... 2023-11-28T19:28:44.422 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:44.457 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:44.603 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T19:28:44.625 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T19:28:44.670 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T19:28:44.729 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-google-auth. 2023-11-28T19:28:44.750 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2023-11-28T19:28:44.795 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-11-28T19:28:45.090 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-11-28T19:28:45.111 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-11-28T19:28:45.140 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T19:28:45.367 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T19:28:45.380 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:45.425 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:45.435 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-websocket. 2023-11-28T19:28:45.457 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2023-11-28T19:28:45.493 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-11-28T19:28:45.744 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T19:28:45.767 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T19:28:45.811 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T19:28:45.813 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-kubernetes. 2023-11-28T19:28:45.835 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-11-28T19:28:45.871 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T19:28:46.164 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T19:28:46.186 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T19:28:46.230 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T19:28:46.445 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T19:28:46.460 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:46.466 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package jq. 2023-11-28T19:28:46.479 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T19:28:46.503 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:46.516 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T19:28:46.577 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-11-28T19:28:46.591 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:46.627 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:46.752 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package socat. 2023-11-28T19:28:46.765 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T19:28:46.802 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T19:28:46.891 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T19:28:46.906 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:46.940 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:46.947 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libonig5:amd64. 2023-11-28T19:28:46.969 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-11-28T19:28:47.014 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T19:28:47.114 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T19:28:47.135 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T19:28:47.180 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T19:28:47.269 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T19:28:47.284 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T19:28:47.327 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T19:28:47.513 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libjq1:amd64. 2023-11-28T19:28:47.535 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T19:28:47.559 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-test. 2023-11-28T19:28:47.572 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:47.608 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:47.613 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T19:28:47.629 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:47.663 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:47.675 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T19:28:47.924 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T19:28:47.940 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:47.945 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package jq. 2023-11-28T19:28:47.967 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-11-28T19:28:47.982 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:48.011 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-11-28T19:28:48.264 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package socat. 2023-11-28T19:28:48.268 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T19:28:48.284 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:48.286 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-11-28T19:28:48.326 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:48.330 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-11-28T19:28:48.651 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package xmlstarlet. 2023-11-28T19:28:48.654 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T19:28:48.670 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T19:28:48.673 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-11-28T19:28:48.713 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T19:28:48.718 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-11-28T19:28:49.076 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T19:28:49.089 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-test. 2023-11-28T19:28:49.091 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T19:28:49.108 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../099-ceph-test_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:49.126 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T19:28:49.147 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:49.521 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T19:28:49.537 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T19:28:49.588 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T19:28:50.035 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package pkg-config. 2023-11-28T19:28:50.050 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T19:28:50.088 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T19:28:50.093 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T19:28:50.110 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:50.163 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:50.347 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T19:28:50.362 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T19:28:50.407 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T19:28:50.550 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T19:28:50.572 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:50.617 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:50.843 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T19:28:50.859 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T19:28:50.901 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T19:28:50.936 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T19:28:50.958 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T19:28:50.994 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T19:28:51.213 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T19:28:51.229 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T19:28:51.239 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T19:28:51.251 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:51.271 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T19:28:51.288 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:51.485 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ceph-volume. 2023-11-28T19:28:51.509 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../100-ceph-volume_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:51.549 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T19:28:51.551 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:51.562 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:51.599 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:51.608 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T19:28:51.623 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T19:28:51.666 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T19:28:51.852 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T19:28:51.873 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:51.918 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:51.923 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephfs-mirror. 2023-11-28T19:28:51.945 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../101-cephfs-mirror_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:51.986 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T19:28:51.989 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:52.002 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T19:28:52.044 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T19:28:52.246 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T19:28:52.268 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T19:28:52.312 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T19:28:52.318 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-colorama. 2023-11-28T19:28:52.339 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2023-11-28T19:28:52.384 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-11-28T19:28:52.422 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-py. 2023-11-28T19:28:52.438 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T19:28:52.472 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T19:28:52.596 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephfs-shell. 2023-11-28T19:28:52.617 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../103-cephfs-shell_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:52.654 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:52.677 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T19:28:52.699 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T19:28:52.744 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T19:28:52.793 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T19:28:52.807 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T19:28:52.886 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T19:28:52.924 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package cephfs-top. 2023-11-28T19:28:52.945 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../104-cephfs-top_18.0.0-7520-g43dd94c1-1jammy_all.deb ... 2023-11-28T19:28:52.990 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:53.114 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T19:28:53.136 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T19:28:53.181 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T19:28:53.268 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libcephfs-dev. 2023-11-28T19:28:53.289 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../105-libcephfs-dev_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:53.345 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:53.413 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T19:28:53.428 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T19:28:53.471 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T19:28:53.611 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package pkg-config. 2023-11-28T19:28:53.629 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-socket:amd64. 2023-11-28T19:28:53.634 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T19:28:53.651 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2023-11-28T19:28:53.678 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T19:28:53.687 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T19:28:53.749 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-toml. 2023-11-28T19:28:53.764 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T19:28:53.834 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T19:28:53.914 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T19:28:53.927 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T19:28:53.957 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T19:28:53.967 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package lua-sec:amd64. 2023-11-28T19:28:53.980 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2023-11-28T19:28:54.017 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2023-11-28T19:28:54.127 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T19:28:54.142 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T19:28:54.185 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T19:28:54.377 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T19:28:54.388 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package nvme-cli. 2023-11-28T19:28:54.398 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T19:28:54.410 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-11-28T19:28:54.442 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T19:28:54.455 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T19:28:54.547 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T19:28:54.563 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T19:28:54.606 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T19:28:54.745 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T19:28:54.758 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T19:28:54.803 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T19:28:54.894 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package pkg-config. 2023-11-28T19:28:54.916 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-11-28T19:28:54.917 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T19:28:54.933 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T19:28:54.960 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T19:28:54.975 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T19:28:55.123 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T19:28:55.146 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T19:28:55.198 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-11-28T19:28:55.206 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T19:28:55.209 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-11-28T19:28:55.238 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-11-28T19:28:55.484 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T19:28:55.507 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T19:28:55.543 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T19:28:55.634 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-iniconfig. 2023-11-28T19:28:55.656 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2023-11-28T19:28:55.688 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package radosgw. 2023-11-28T19:28:55.692 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-11-28T19:28:55.702 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../122-radosgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:55.746 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:55.879 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-py. 2023-11-28T19:28:55.901 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T19:28:55.937 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T19:28:55.995 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pastescript. 2023-11-28T19:28:56.017 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2023-11-28T19:28:56.086 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-11-28T19:28:56.257 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T19:28:56.280 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T19:28:56.315 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T19:28:56.366 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T19:28:56.381 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:56.407 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pluggy. 2023-11-28T19:28:56.424 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:56.429 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2023-11-28T19:28:56.473 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-11-28T19:28:56.719 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T19:28:56.768 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-psutil. 2023-11-28T19:28:56.790 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-11-28T19:28:56.811 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T19:28:56.833 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T19:28:56.835 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-11-28T19:28:56.877 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T19:28:57.005 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T19:28:57.131 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T19:28:57.155 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-py. 2023-11-28T19:28:57.172 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-toml. 2023-11-28T19:28:57.175 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2023-11-28T19:28:57.194 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T19:28:57.221 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-py (1.10.0-1) ... 2023-11-28T19:28:57.238 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T19:28:57.419 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T19:28:57.533 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pygments. 2023-11-28T19:28:57.555 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-11-28T19:28:57.575 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T19:28:57.597 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T19:28:57.599 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T19:28:57.641 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T19:28:57.825 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T19:28:57.990 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T19:28:58.009 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T19:28:58.053 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T19:28:58.096 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pyinotify. 2023-11-28T19:28:58.118 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-11-28T19:28:58.162 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-11-28T19:28:58.322 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T19:28:58.344 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T19:28:58.389 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T19:28:58.465 INFO:teuthology.orchestra.run.smithi203.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T19:28:58.479 INFO:teuthology.orchestra.run.smithi203.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-11-28T19:28:58.482 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-toml. 2023-11-28T19:28:58.504 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2023-11-28T19:28:58.548 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-11-28T19:28:58.660 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:58.835 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-pytest. 2023-11-28T19:28:58.857 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-11-28T19:28:58.901 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T19:28:59.144 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package radosgw. 2023-11-28T19:28:59.165 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../122-radosgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:28:59.180 INFO:teuthology.orchestra.run.smithi203.stdout:Adding system user cephadm....done 2023-11-28T19:28:59.210 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:28:59.255 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package python3-simplejson. 2023-11-28T19:28:59.277 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-11-28T19:28:59.322 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-11-28T19:28:59.340 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T19:28:59.599 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-11-28T19:28:59.612 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-11-28T19:28:59.650 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-11-28T19:28:59.684 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T19:28:59.943 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T19:29:00.038 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T19:29:00.051 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:29:00.069 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T19:29:00.096 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:00.354 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T19:29:00.407 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T19:29:00.421 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package radosgw. 2023-11-28T19:29:00.443 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../122-radosgw_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:29:00.487 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:00.638 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T19:29:00.718 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T19:29:00.748 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T19:29:00.836 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T19:29:01.058 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T19:29:01.077 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T19:29:01.274 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package rbd-fuse. 2023-11-28T19:29:01.295 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../123-rbd-fuse_18.0.0-7520-g43dd94c1-1jammy_amd64.deb ... 2023-11-28T19:29:01.340 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:01.437 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T19:29:01.452 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T19:29:01.651 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-11-28T19:29:01.703 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T19:29:01.944 INFO:teuthology.orchestra.run.smithi028.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T19:29:01.962 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-11-28T19:29:01.971 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T19:29:02.063 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:02.105 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-11-28T19:29:02.272 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T19:29:02.362 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-11-28T19:29:02.556 INFO:teuthology.orchestra.run.smithi028.stdout:Adding system user cephadm....done 2023-11-28T19:29:02.633 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T19:29:02.694 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-11-28T19:29:02.710 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T19:29:02.900 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T19:29:03.045 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T19:29:03.146 INFO:teuthology.orchestra.run.smithi131.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-11-28T19:29:03.160 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T19:29:03.216 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:03.296 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T19:29:03.420 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:03.422 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T19:29:03.682 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T19:29:03.712 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T19:29:03.776 INFO:teuthology.orchestra.run.smithi131.stdout:Adding system user cephadm....done 2023-11-28T19:29:03.838 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T19:29:03.930 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-11-28T19:29:03.941 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T19:29:04.014 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T19:29:04.068 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T19:29:04.207 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-11-28T19:29:04.283 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T19:29:04.387 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T19:29:04.408 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T19:29:04.433 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-11-28T19:29:04.543 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-11-28T19:29:04.701 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T19:29:04.755 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T19:29:04.794 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-11-28T19:29:05.023 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T19:29:05.054 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-11-28T19:29:05.066 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T19:29:05.124 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T19:29:05.180 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-py (1.10.0-1) ... 2023-11-28T19:29:05.188 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:29:05.314 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T19:29:05.424 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T19:29:05.483 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-11-28T19:29:05.701 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T19:29:05.707 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T19:29:05.834 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T19:29:05.851 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-11-28T19:29:05.985 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T19:29:06.136 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-11-28T19:29:06.143 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T19:29:06.261 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T19:29:06.396 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-11-28T19:29:06.402 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T19:29:06.513 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T19:29:06.664 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up unzip (6.0-26ubuntu3.1) ... 2023-11-28T19:29:06.704 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T19:29:06.772 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:06.813 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T19:29:06.907 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-11-28T19:29:07.040 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T19:29:07.158 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-11-28T19:29:07.166 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T19:29:07.284 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T19:29:07.426 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-11-28T19:29:07.524 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T19:29:07.535 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T19:29:07.652 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T19:29:07.671 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-ceph-argparse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:07.825 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T19:29:07.895 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T19:29:07.930 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-11-28T19:29:07.943 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T19:29:08.056 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2023-11-28T19:29:08.060 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T19:29:08.182 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-11-28T19:29:08.343 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T19:29:08.361 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T19:29:08.375 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T19:29:08.440 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:29:08.442 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2023-11-28T19:29:08.566 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T19:29:08.568 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-11-28T19:29:08.788 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T19:29:08.819 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2023-11-28T19:29:08.951 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T19:29:09.047 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T19:29:09.077 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T19:29:09.228 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2023-11-28T19:29:09.258 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2023-11-28T19:29:09.322 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:29:09.336 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T19:29:09.441 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T19:29:09.448 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-11-28T19:29:09.604 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T19:29:09.759 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T19:29:09.808 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-11-28T19:29:09.922 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T19:29:09.933 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-11-28T19:29:10.048 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T19:29:10.077 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T19:29:10.218 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-11-28T19:29:10.420 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T19:29:10.486 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-11-28T19:29:10.682 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T19:29:10.792 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T19:29:10.795 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up zip (3.0-12build2) ... 2023-11-28T19:29:10.806 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:10.921 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-11-28T19:29:11.051 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T19:29:11.107 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T19:29:11.178 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T19:29:11.303 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T19:29:11.484 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T19:29:11.613 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T19:29:11.625 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-11-28T19:29:11.875 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-11-28T19:29:12.000 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-11-28T19:29:12.034 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T19:29:12.126 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-11-28T19:29:12.282 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T19:29:12.427 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-11-28T19:29:12.676 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T19:29:12.732 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T19:29:12.804 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-11-28T19:29:12.977 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T19:29:12.983 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:29:13.055 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-11-28T19:29:13.135 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T19:29:13.278 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T19:29:13.386 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T19:29:13.423 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-11-28T19:29:13.503 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T19:29:13.621 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T19:29:13.638 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T19:29:13.724 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-11-28T19:29:13.880 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T19:29:13.931 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T19:29:14.006 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:14.025 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-11-28T19:29:14.249 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T19:29:14.325 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T19:29:14.351 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-11-28T19:29:14.554 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:29:14.594 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-11-28T19:29:14.642 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T19:29:14.684 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T19:29:14.721 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:15.005 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-idna (3.3-1) ... 2023-11-28T19:29:15.028 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T19:29:15.296 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T19:29:15.315 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-11-28T19:29:15.547 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T19:29:15.814 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T19:29:15.848 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T19:29:16.091 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T19:29:16.116 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:29:16.251 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T19:29:16.367 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T19:29:16.445 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-11-28T19:29:16.518 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T19:29:16.519 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T19:29:16.653 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T19:29:16.705 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:29:16.779 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T19:29:16.794 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T19:29:16.831 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-toml (0.10.2-1) ... 2023-11-28T19:29:16.946 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T19:29:17.089 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T19:29:17.090 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-11-28T19:29:17.208 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-11-28T19:29:17.238 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T19:29:17.334 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2023-11-28T19:29:17.348 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T19:29:17.548 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T19:29:17.616 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:29:17.618 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-11-28T19:29:17.742 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T19:29:17.816 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T19:29:17.886 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-11-28T19:29:17.975 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T19:29:18.052 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T19:29:18.085 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T19:29:18.138 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:29:18.173 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T19:29:18.256 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-11-28T19:29:18.303 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T19:29:18.412 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T19:29:18.537 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T19:29:18.579 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T19:29:18.782 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-11-28T19:29:18.847 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T19:29:18.939 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T19:29:19.017 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-11-28T19:29:19.106 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T19:29:19.217 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T19:29:19.300 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-11-28T19:29:19.375 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T19:29:19.383 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T19:29:19.508 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T19:29:19.560 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-11-28T19:29:19.634 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:29:19.735 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T19:29:19.793 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T19:29:19.811 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-11-28T19:29:19.919 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T19:29:20.087 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T19:29:20.088 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-11-28T19:29:20.213 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-11-28T19:29:20.220 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T19:29:20.405 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T19:29:20.481 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-11-28T19:29:20.530 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T19:29:20.590 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-11-28T19:29:20.797 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T19:29:20.867 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-11-28T19:29:20.923 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T19:29:21.048 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T19:29:21.083 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T19:29:21.155 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T19:29:21.167 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-11-28T19:29:21.251 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T19:29:21.393 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T19:29:21.419 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2023-11-28T19:29:21.502 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T19:29:21.544 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T19:29:21.545 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2023-11-28T19:29:21.674 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-11-28T19:29:21.760 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-11-28T19:29:21.829 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T19:29:21.937 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T19:29:22.006 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-11-28T19:29:22.105 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T19:29:22.123 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-11-28T19:29:22.222 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T19:29:22.381 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T19:29:22.482 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T19:29:22.491 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-11-28T19:29:22.640 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:29:22.751 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up lua-any (27ubuntu1) ... 2023-11-28T19:29:22.767 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T19:29:22.784 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T19:29:22.877 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-portend (3.0.0-1) ... 2023-11-28T19:29:23.076 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T19:29:23.136 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T19:29:23.169 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-11-28T19:29:23.288 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:23.306 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-11-28T19:29:23.403 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T19:29:23.414 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:23.531 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T19:29:23.630 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-11-28T19:29:23.687 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T19:29:23.877 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:23.898 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T19:29:23.964 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2023-11-28T19:29:24.003 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:24.129 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T19:29:24.183 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T19:29:24.224 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-11-28T19:29:24.435 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rsa (4.8-1) ... 2023-11-28T19:29:24.451 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T19:29:24.472 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:24.598 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:24.711 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T19:29:24.711 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-11-28T19:29:24.749 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:24.961 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T19:29:24.961 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T19:29:24.987 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-11-28T19:29:25.096 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T19:29:25.239 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-11-28T19:29:25.439 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T19:29:25.599 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-11-28T19:29:25.642 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:25.760 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:25.784 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T19:29:25.878 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:25.884 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-11-28T19:29:25.910 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:26.004 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:26.036 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:26.137 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T19:29:26.155 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T19:29:26.219 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-11-28T19:29:26.346 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librados2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:26.471 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libsqlite3-mod-ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:26.473 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:26.597 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2023-11-28T19:29:26.598 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:26.725 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T19:29:26.925 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libcephfs2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:27.010 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:27.051 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libradosstriper1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:27.127 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:27.177 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-11-28T19:29:27.228 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:27.445 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T19:29:27.445 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T19:29:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:27.453 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librbd1 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:27.585 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:27.588 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-modules-core (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:27.703 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:27.705 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:27.829 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:27.924 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T19:29:27.924 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-11-28T19:29:27.955 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:27.988 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:28.114 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:28.115 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:28.240 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:28.358 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:28.431 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libcephfs-dev (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:28.459 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T19:29:28.550 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rados (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:28.675 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up librgw2 (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:28.695 INFO:teuthology.orchestra.run.smithi203.stdout:Adding group ceph....done 2023-11-28T19:29:28.801 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephfs-top (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:28.944 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-11-28T19:29:29.069 INFO:teuthology.orchestra.run.smithi203.stdout:Adding system user ceph....done 2023-11-28T19:29:29.231 INFO:teuthology.orchestra.run.smithi203.stdout:Setting system user ceph properties....done 2023-11-28T19:29:29.247 INFO:teuthology.orchestra.run.smithi203.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T19:29:29.388 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T19:29:29.671 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:29.796 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T19:29:29.797 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:29.923 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:30.058 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:30.081 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rbd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:30.184 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:30.199 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up rbd-fuse (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:30.310 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:30.325 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-rgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:30.451 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up python3-cephfs (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:30.475 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:30.577 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephfs-shell (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:30.674 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T19:29:30.675 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T19:29:30.719 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-common (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:30.828 INFO:teuthology.orchestra.run.smithi028.stdout:Adding group ceph....done 2023-11-28T19:29:31.154 INFO:teuthology.orchestra.run.smithi028.stdout:Adding system user ceph....done 2023-11-28T19:29:31.287 INFO:teuthology.orchestra.run.smithi131.stdout:Adding group ceph....done 2023-11-28T19:29:31.293 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:31.333 INFO:teuthology.orchestra.run.smithi028.stdout:Setting system user ceph properties....done 2023-11-28T19:29:31.351 INFO:teuthology.orchestra.run.smithi028.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T19:29:31.453 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:31.515 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T19:29:31.697 INFO:teuthology.orchestra.run.smithi131.stdout:Adding system user ceph....done 2023-11-28T19:29:31.891 INFO:teuthology.orchestra.run.smithi131.stdout:Setting system user ceph properties....done 2023-11-28T19:29:31.905 INFO:teuthology.orchestra.run.smithi131.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-11-28T19:29:31.906 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T19:29:31.996 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T19:29:31.996 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T19:29:32.044 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-11-28T19:29:32.414 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-11-28T19:29:32.613 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:32.638 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:32.864 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T19:29:32.865 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T19:29:32.946 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up cephfs-mirror (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:32.969 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T19:29:33.159 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T19:29:33.159 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2023-11-28T19:29:33.430 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:33.556 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:33.640 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:33.689 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-test (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:33.798 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up radosgw (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:33.838 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T19:29:33.838 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T19:29:34.074 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T19:29:34.074 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T19:29:34.266 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T19:29:34.266 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-11-28T19:29:34.484 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:34.600 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:34.688 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T19:29:34.688 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T19:29:34.767 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-base (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:34.953 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T19:29:35.106 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-11-28T19:29:35.260 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:35.503 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:35.605 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T19:29:35.605 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T19:29:35.627 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mds (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:35.752 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T19:29:35.752 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T19:29:35.864 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T19:29:35.864 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-11-28T19:29:36.221 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:36.355 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:36.370 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:36.414 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:36.507 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:36.579 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T19:29:36.579 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T19:29:36.670 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T19:29:36.670 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-11-28T19:29:36.714 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T19:29:36.714 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T19:29:37.072 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:37.249 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-osd (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:37.317 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:37.360 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T19:29:37.360 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T19:29:37.451 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:37.577 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:37.598 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T19:29:37.598 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-11-28T19:29:37.753 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:37.907 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:38.042 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:38.131 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T19:29:38.159 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-k8sevents (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:38.193 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:38.232 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T19:29:38.285 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:38.401 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T19:29:38.435 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T19:29:38.435 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T19:29:38.436 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mon (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:38.657 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T19:29:38.658 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-11-28T19:29:38.987 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:39.221 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-cephadm (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:39.270 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:39.372 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:39.498 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:39.558 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T19:29:39.649 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:39.662 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-mgr-dashboard (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:39.823 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ceph-volume (18.0.0-7520-g43dd94c1-1jammy) ... 2023-11-28T19:29:40.019 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T19:29:40.120 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T19:29:40.168 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2023-11-28T19:29:40.245 INFO:teuthology.orchestra.run.smithi203.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T19:29:40.252 DEBUG:teuthology.orchestra.run.smithi203:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T19:29:40.269 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T19:29:40.272 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T19:29:40.329 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2023-11-28T19:29:40.429 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T19:29:40.494 INFO:teuthology.orchestra.run.smithi203.stdout:Building dependency tree... 2023-11-28T19:29:40.495 INFO:teuthology.orchestra.run.smithi203.stdout:Reading state information... 2023-11-28T19:29:40.648 INFO:teuthology.orchestra.run.smithi203.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T19:29:40.648 INFO:teuthology.orchestra.run.smithi203.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T19:29:40.648 INFO:teuthology.orchestra.run.smithi203.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T19:29:40.648 INFO:teuthology.orchestra.run.smithi203.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T19:29:40.648 INFO:teuthology.orchestra.run.smithi203.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T19:29:40.648 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T19:29:40.648 INFO:teuthology.orchestra.run.smithi203.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T19:29:40.649 INFO:teuthology.orchestra.run.smithi203.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T19:29:40.649 INFO:teuthology.orchestra.run.smithi203.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T19:29:40.649 INFO:teuthology.orchestra.run.smithi203.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-11-28T19:29:40.650 INFO:teuthology.orchestra.run.smithi203.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-11-28T19:29:40.650 INFO:teuthology.orchestra.run.smithi203.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T19:29:40.650 INFO:teuthology.orchestra.run.smithi203.stdout:The following additional packages will be installed: 2023-11-28T19:29:40.650 INFO:teuthology.orchestra.run.smithi203.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T19:29:40.650 INFO:teuthology.orchestra.run.smithi203.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T19:29:40.650 INFO:teuthology.orchestra.run.smithi203.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T19:29:40.650 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T19:29:40.650 INFO:teuthology.orchestra.run.smithi203.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T19:29:40.651 INFO:teuthology.orchestra.run.smithi203.stdout:Suggested packages: 2023-11-28T19:29:40.651 INFO:teuthology.orchestra.run.smithi203.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T19:29:40.651 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T19:29:40.651 INFO:teuthology.orchestra.run.smithi203.stdout: libengine-pkcs11-openssl 2023-11-28T19:29:40.700 INFO:teuthology.orchestra.run.smithi203.stdout:The following NEW packages will be installed: 2023-11-28T19:29:40.701 INFO:teuthology.orchestra.run.smithi203.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T19:29:40.701 INFO:teuthology.orchestra.run.smithi203.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T19:29:40.701 INFO:teuthology.orchestra.run.smithi203.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T19:29:40.701 INFO:teuthology.orchestra.run.smithi203.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T19:29:40.702 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T19:29:40.702 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T19:29:40.702 INFO:teuthology.orchestra.run.smithi203.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T19:29:40.702 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages will be upgraded: 2023-11-28T19:29:40.703 INFO:teuthology.orchestra.run.smithi203.stdout: libssl3 2023-11-28T19:29:40.759 INFO:teuthology.orchestra.run.smithi203.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T19:29:40.759 INFO:teuthology.orchestra.run.smithi203.stdout:Need to get 54.6 MB of archives. 2023-11-28T19:29:40.759 INFO:teuthology.orchestra.run.smithi203.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T19:29:40.759 INFO:teuthology.orchestra.run.smithi203.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T19:29:40.862 INFO:teuthology.orchestra.run.smithi203.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T19:29:40.916 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T19:29:40.923 INFO:teuthology.orchestra.run.smithi203.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T19:29:40.923 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T19:29:40.925 INFO:teuthology.orchestra.run.smithi203.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T19:29:40.926 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T19:29:40.927 INFO:teuthology.orchestra.run.smithi203.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T19:29:40.928 INFO:teuthology.orchestra.run.smithi203.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T19:29:40.928 INFO:teuthology.orchestra.run.smithi203.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T19:29:40.929 INFO:teuthology.orchestra.run.smithi203.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T19:29:40.934 INFO:teuthology.orchestra.run.smithi203.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T19:29:40.946 INFO:teuthology.orchestra.run.smithi203.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T19:29:40.990 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T19:29:41.159 INFO:teuthology.orchestra.run.smithi203.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T19:29:41.161 INFO:teuthology.orchestra.run.smithi203.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T19:29:41.161 INFO:teuthology.orchestra.run.smithi203.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T19:29:41.164 INFO:teuthology.orchestra.run.smithi203.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T19:29:41.164 INFO:teuthology.orchestra.run.smithi203.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T19:29:41.169 INFO:teuthology.orchestra.run.smithi203.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T19:29:41.170 INFO:teuthology.orchestra.run.smithi203.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T19:29:41.177 INFO:teuthology.orchestra.run.smithi203.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T19:29:41.178 INFO:teuthology.orchestra.run.smithi203.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T19:29:41.178 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T19:29:41.199 INFO:teuthology.orchestra.run.smithi203.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T19:29:41.200 INFO:teuthology.orchestra.run.smithi203.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T19:29:41.210 INFO:teuthology.orchestra.run.smithi203.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T19:29:41.230 INFO:teuthology.orchestra.run.smithi203.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T19:29:41.234 INFO:teuthology.orchestra.run.smithi203.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T19:29:41.235 INFO:teuthology.orchestra.run.smithi203.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T19:29:41.235 INFO:teuthology.orchestra.run.smithi203.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T19:29:41.236 INFO:teuthology.orchestra.run.smithi203.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T19:29:41.248 INFO:teuthology.orchestra.run.smithi203.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T19:29:41.249 INFO:teuthology.orchestra.run.smithi203.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T19:29:41.396 INFO:teuthology.orchestra.run.smithi203.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T19:29:41.396 INFO:teuthology.orchestra.run.smithi203.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T19:29:41.397 INFO:teuthology.orchestra.run.smithi203.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T19:29:41.397 INFO:teuthology.orchestra.run.smithi203.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T19:29:41.397 INFO:teuthology.orchestra.run.smithi203.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T19:29:41.397 INFO:teuthology.orchestra.run.smithi203.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T19:29:41.410 INFO:teuthology.orchestra.run.smithi203.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T19:29:41.411 INFO:teuthology.orchestra.run.smithi203.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T19:29:41.731 INFO:teuthology.orchestra.run.smithi028.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T19:29:41.734 DEBUG:teuthology.orchestra.run.smithi028:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T19:29:41.793 INFO:teuthology.orchestra.run.smithi203.stdout:Preconfiguring packages ... 2023-11-28T19:29:41.806 INFO:teuthology.orchestra.run.smithi131.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T19:29:41.809 DEBUG:teuthology.orchestra.run.smithi131:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-11-28T19:29:41.838 INFO:teuthology.orchestra.run.smithi028.stdout:Reading package lists... 2023-11-28T19:29:41.867 INFO:teuthology.orchestra.run.smithi131.stdout:Reading package lists... 2023-11-28T19:29:41.936 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 54.6 MB in 1s (77.9 MB/s) 2023-11-28T19:29:42.030 INFO:teuthology.orchestra.run.smithi028.stdout:Building dependency tree... 2023-11-28T19:29:42.031 INFO:teuthology.orchestra.run.smithi028.stdout:Reading state information... 2023-11-28T19:29:42.054 INFO:teuthology.orchestra.run.smithi131.stdout:Building dependency tree... 2023-11-28T19:29:42.055 INFO:teuthology.orchestra.run.smithi131.stdout:Reading state information... 2023-11-28T19:29:42.102 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package flex. 2023-11-28T19:29:42.175 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140565 files and directories currently installed.) 2023-11-28T19:29:42.179 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T19:29:42.206 INFO:teuthology.orchestra.run.smithi028.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T19:29:42.206 INFO:teuthology.orchestra.run.smithi028.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T19:29:42.206 INFO:teuthology.orchestra.run.smithi028.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T19:29:42.206 INFO:teuthology.orchestra.run.smithi028.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T19:29:42.206 INFO:teuthology.orchestra.run.smithi028.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T19:29:42.206 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T19:29:42.206 INFO:teuthology.orchestra.run.smithi028.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T19:29:42.206 INFO:teuthology.orchestra.run.smithi028.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T19:29:42.207 INFO:teuthology.orchestra.run.smithi028.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T19:29:42.208 INFO:teuthology.orchestra.run.smithi028.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-28T19:29:42.208 INFO:teuthology.orchestra.run.smithi028.stdout: python2.7-minimal 2023-11-28T19:29:42.208 INFO:teuthology.orchestra.run.smithi028.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T19:29:42.208 INFO:teuthology.orchestra.run.smithi028.stdout:The following additional packages will be installed: 2023-11-28T19:29:42.208 INFO:teuthology.orchestra.run.smithi028.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T19:29:42.208 INFO:teuthology.orchestra.run.smithi028.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T19:29:42.208 INFO:teuthology.orchestra.run.smithi028.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T19:29:42.209 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T19:29:42.209 INFO:teuthology.orchestra.run.smithi028.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T19:29:42.210 INFO:teuthology.orchestra.run.smithi028.stdout:Suggested packages: 2023-11-28T19:29:42.210 INFO:teuthology.orchestra.run.smithi028.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T19:29:42.210 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T19:29:42.210 INFO:teuthology.orchestra.run.smithi028.stdout: libengine-pkcs11-openssl 2023-11-28T19:29:42.217 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi131.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-11-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi131.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi131.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-11-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi131.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi131.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi131.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-11-28T19:29:42.220 INFO:teuthology.orchestra.run.smithi131.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-11-28T19:29:42.221 INFO:teuthology.orchestra.run.smithi131.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-11-28T19:29:42.221 INFO:teuthology.orchestra.run.smithi131.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-11-28T19:29:42.221 INFO:teuthology.orchestra.run.smithi131.stdout: python2.7-minimal 2023-11-28T19:29:42.221 INFO:teuthology.orchestra.run.smithi131.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T19:29:42.222 INFO:teuthology.orchestra.run.smithi131.stdout:The following additional packages will be installed: 2023-11-28T19:29:42.222 INFO:teuthology.orchestra.run.smithi131.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-11-28T19:29:42.222 INFO:teuthology.orchestra.run.smithi131.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-11-28T19:29:42.223 INFO:teuthology.orchestra.run.smithi131.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-11-28T19:29:42.223 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-11-28T19:29:42.223 INFO:teuthology.orchestra.run.smithi131.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T19:29:42.224 INFO:teuthology.orchestra.run.smithi131.stdout:Suggested packages: 2023-11-28T19:29:42.224 INFO:teuthology.orchestra.run.smithi131.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-11-28T19:29:42.224 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-11-28T19:29:42.225 INFO:teuthology.orchestra.run.smithi131.stdout: libengine-pkcs11-openssl 2023-11-28T19:29:42.248 INFO:teuthology.orchestra.run.smithi028.stdout:The following NEW packages will be installed: 2023-11-28T19:29:42.249 INFO:teuthology.orchestra.run.smithi028.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T19:29:42.249 INFO:teuthology.orchestra.run.smithi028.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T19:29:42.249 INFO:teuthology.orchestra.run.smithi028.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T19:29:42.249 INFO:teuthology.orchestra.run.smithi028.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T19:29:42.249 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T19:29:42.249 INFO:teuthology.orchestra.run.smithi028.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T19:29:42.250 INFO:teuthology.orchestra.run.smithi028.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T19:29:42.250 INFO:teuthology.orchestra.run.smithi028.stdout:The following packages will be upgraded: 2023-11-28T19:29:42.251 INFO:teuthology.orchestra.run.smithi028.stdout: libssl3 2023-11-28T19:29:42.259 INFO:teuthology.orchestra.run.smithi131.stdout:The following NEW packages will be installed: 2023-11-28T19:29:42.260 INFO:teuthology.orchestra.run.smithi131.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-11-28T19:29:42.260 INFO:teuthology.orchestra.run.smithi131.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-11-28T19:29:42.260 INFO:teuthology.orchestra.run.smithi131.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-11-28T19:29:42.260 INFO:teuthology.orchestra.run.smithi131.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-11-28T19:29:42.260 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-11-28T19:29:42.261 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-11-28T19:29:42.261 INFO:teuthology.orchestra.run.smithi131.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-11-28T19:29:42.261 INFO:teuthology.orchestra.run.smithi131.stdout:The following packages will be upgraded: 2023-11-28T19:29:42.262 INFO:teuthology.orchestra.run.smithi131.stdout: libssl3 2023-11-28T19:29:42.302 INFO:teuthology.orchestra.run.smithi028.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T19:29:42.302 INFO:teuthology.orchestra.run.smithi028.stdout:Need to get 54.6 MB of archives. 2023-11-28T19:29:42.303 INFO:teuthology.orchestra.run.smithi028.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T19:29:42.303 INFO:teuthology.orchestra.run.smithi028.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T19:29:42.403 INFO:teuthology.orchestra.run.smithi028.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T19:29:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:1 upgraded, 39 newly installed, 0 to remove and 263 not upgraded. 2023-11-28T19:29:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:Need to get 54.6 MB of archives. 2023-11-28T19:29:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:After this operation, 202 MB of additional disk space will be used. 2023-11-28T19:29:42.453 INFO:teuthology.orchestra.run.smithi131.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-11-28T19:29:42.465 INFO:teuthology.orchestra.run.smithi028.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T19:29:42.480 INFO:teuthology.orchestra.run.smithi028.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T19:29:42.481 INFO:teuthology.orchestra.run.smithi028.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T19:29:42.484 INFO:teuthology.orchestra.run.smithi028.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T19:29:42.485 INFO:teuthology.orchestra.run.smithi028.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T19:29:42.486 INFO:teuthology.orchestra.run.smithi028.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T19:29:42.488 INFO:teuthology.orchestra.run.smithi028.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T19:29:42.489 INFO:teuthology.orchestra.run.smithi028.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T19:29:42.489 INFO:teuthology.orchestra.run.smithi028.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T19:29:42.490 INFO:teuthology.orchestra.run.smithi028.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T19:29:42.504 INFO:teuthology.orchestra.run.smithi028.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T19:29:42.762 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T19:29:42.813 INFO:teuthology.orchestra.run.smithi028.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T19:29:42.815 INFO:teuthology.orchestra.run.smithi028.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T19:29:42.816 INFO:teuthology.orchestra.run.smithi028.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T19:29:42.818 INFO:teuthology.orchestra.run.smithi028.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T19:29:42.818 INFO:teuthology.orchestra.run.smithi028.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T19:29:42.822 INFO:teuthology.orchestra.run.smithi028.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T19:29:42.824 INFO:teuthology.orchestra.run.smithi028.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T19:29:42.831 INFO:teuthology.orchestra.run.smithi028.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T19:29:42.831 INFO:teuthology.orchestra.run.smithi028.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T19:29:42.852 INFO:teuthology.orchestra.run.smithi028.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T19:29:42.852 INFO:teuthology.orchestra.run.smithi028.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T19:29:42.862 INFO:teuthology.orchestra.run.smithi028.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T19:29:42.882 INFO:teuthology.orchestra.run.smithi028.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T19:29:42.886 INFO:teuthology.orchestra.run.smithi028.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T19:29:42.886 INFO:teuthology.orchestra.run.smithi028.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T19:29:42.887 INFO:teuthology.orchestra.run.smithi028.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T19:29:42.887 INFO:teuthology.orchestra.run.smithi028.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T19:29:42.898 INFO:teuthology.orchestra.run.smithi028.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T19:29:42.900 INFO:teuthology.orchestra.run.smithi028.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T19:29:42.937 INFO:teuthology.orchestra.run.smithi131.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.12 [1,901 kB] 2023-11-28T19:29:42.959 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T19:29:43.095 INFO:teuthology.orchestra.run.smithi028.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T19:29:43.095 INFO:teuthology.orchestra.run.smithi028.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T19:29:43.095 INFO:teuthology.orchestra.run.smithi028.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T19:29:43.095 INFO:teuthology.orchestra.run.smithi028.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T19:29:43.095 INFO:teuthology.orchestra.run.smithi028.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T19:29:43.096 INFO:teuthology.orchestra.run.smithi028.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T19:29:43.107 INFO:teuthology.orchestra.run.smithi028.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T19:29:43.107 INFO:teuthology.orchestra.run.smithi028.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T19:29:43.195 INFO:teuthology.orchestra.run.smithi131.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-11-28T19:29:43.230 INFO:teuthology.orchestra.run.smithi131.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-11-28T19:29:43.231 INFO:teuthology.orchestra.run.smithi131.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-11-28T19:29:43.236 INFO:teuthology.orchestra.run.smithi131.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2023-11-28T19:29:43.240 INFO:teuthology.orchestra.run.smithi131.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-11-28T19:29:43.240 INFO:teuthology.orchestra.run.smithi131.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-11-28T19:29:43.243 INFO:teuthology.orchestra.run.smithi131.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-11-28T19:29:43.245 INFO:teuthology.orchestra.run.smithi131.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-11-28T19:29:43.246 INFO:teuthology.orchestra.run.smithi131.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-11-28T19:29:43.349 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:29:43.411 INFO:teuthology.orchestra.run.smithi131.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-11-28T19:29:43.525 INFO:teuthology.orchestra.run.smithi028.stdout:Preconfiguring packages ... 2023-11-28T19:29:43.685 INFO:teuthology.orchestra.run.smithi028.stdout:Fetched 54.6 MB in 1s (64.3 MB/s) 2023-11-28T19:29:43.724 INFO:teuthology.orchestra.run.smithi131.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2023-11-28T19:29:43.832 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package flex. 2023-11-28T19:29:43.923 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138139 files and directories currently installed.) 2023-11-28T19:29:43.928 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T19:29:43.968 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package bison. 2023-11-28T19:29:43.971 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T19:29:44.041 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 140638 files and directories currently installed.) 2023-11-28T19:29:44.045 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T19:29:44.095 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T19:29:44.513 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T19:29:44.524 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T19:29:44.527 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T19:29:44.571 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T19:29:44.686 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T19:29:44.877 INFO:teuthology.orchestra.run.smithi131.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-11-28T19:29:44.881 INFO:teuthology.orchestra.run.smithi131.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-11-28T19:29:44.881 INFO:teuthology.orchestra.run.smithi131.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.2 [263 kB] 2023-11-28T19:29:44.886 INFO:teuthology.orchestra.run.smithi131.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-11-28T19:29:44.887 INFO:teuthology.orchestra.run.smithi131.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-11-28T19:29:44.895 INFO:teuthology.orchestra.run.smithi131.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.9-0ubuntu0.22.04.1 [141 kB] 2023-11-28T19:29:44.898 INFO:teuthology.orchestra.run.smithi131.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-11-28T19:29:44.907 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package dump. 2023-11-28T19:29:44.913 INFO:teuthology.orchestra.run.smithi131.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-11-28T19:29:44.914 INFO:teuthology.orchestra.run.smithi131.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.12 [2,373 kB] 2023-11-28T19:29:44.921 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T19:29:44.965 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T19:29:45.099 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:29:45.146 INFO:teuthology.orchestra.run.smithi131.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-11-28T19:29:45.219 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package indent. 2023-11-28T19:29:45.229 INFO:teuthology.orchestra.run.smithi131.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.2 [1,094 kB] 2023-11-28T19:29:45.233 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:45.278 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T19:29:45.571 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T19:29:45.585 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T19:29:45.623 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package bison. 2023-11-28T19:29:45.629 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T19:29:45.712 INFO:teuthology.orchestra.run.smithi131.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-11-28T19:29:45.715 INFO:teuthology.orchestra.run.smithi028.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138212 files and directories currently installed.) 2023-11-28T19:29:45.720 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T19:29:45.764 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T19:29:45.844 INFO:teuthology.orchestra.run.smithi131.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-11-28T19:29:45.855 INFO:teuthology.orchestra.run.smithi131.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-11-28T19:29:45.857 INFO:teuthology.orchestra.run.smithi131.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-11-28T19:29:45.858 INFO:teuthology.orchestra.run.smithi131.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-11-28T19:29:45.859 INFO:teuthology.orchestra.run.smithi131.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.9-0ubuntu0.22.04.1 [1,222 kB] 2023-11-28T19:29:45.891 INFO:teuthology.orchestra.run.smithi131.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-11-28T19:29:45.895 INFO:teuthology.orchestra.run.smithi131.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.9-0ubuntu0.22.04.1 [16.1 MB] 2023-11-28T19:29:46.058 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T19:29:46.074 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T19:29:46.133 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T19:29:46.173 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T19:29:46.195 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T19:29:46.231 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T19:29:46.446 INFO:teuthology.orchestra.run.smithi131.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-11-28T19:29:46.521 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T19:29:46.536 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T19:29:46.579 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T19:29:46.610 INFO:teuthology.orchestra.run.smithi131.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-11-28T19:29:46.692 INFO:teuthology.orchestra.run.smithi131.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-11-28T19:29:46.692 INFO:teuthology.orchestra.run.smithi131.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-11-28T19:29:46.694 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package dump. 2023-11-28T19:29:46.717 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T19:29:46.761 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T19:29:46.777 INFO:teuthology.orchestra.run.smithi131.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-11-28T19:29:46.785 INFO:teuthology.orchestra.run.smithi131.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-11-28T19:29:46.933 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T19:29:46.947 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T19:29:46.991 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T19:29:47.048 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package indent. 2023-11-28T19:29:47.070 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:47.114 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T19:29:47.248 INFO:teuthology.orchestra.run.smithi131.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-11-28T19:29:47.250 INFO:teuthology.orchestra.run.smithi131.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-11-28T19:29:47.285 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T19:29:47.300 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T19:29:47.343 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T19:29:47.376 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T19:29:47.397 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T19:29:47.442 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T19:29:47.562 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T19:29:47.577 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T19:29:47.612 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T19:29:47.648 INFO:teuthology.orchestra.run.smithi131.stdout:Preconfiguring packages ... 2023-11-28T19:29:47.745 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T19:29:47.759 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T19:29:47.795 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T19:29:47.801 INFO:teuthology.orchestra.run.smithi131.stdout:Fetched 54.6 MB in 5s (11.0 MB/s) 2023-11-28T19:29:47.932 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T19:29:47.945 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package flex. 2023-11-28T19:29:47.946 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T19:29:47.990 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T19:29:48.030 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138139 files and directories currently installed.) 2023-11-28T19:29:48.035 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-11-28T19:29:48.048 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T19:29:48.070 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T19:29:48.076 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking flex (2.6.4-8build2) ... 2023-11-28T19:29:48.114 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T19:29:48.451 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T19:29:48.474 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T19:29:48.518 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T19:29:48.636 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T19:29:48.737 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T19:29:48.750 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T19:29:48.779 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T19:29:48.815 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.12) over (3.0.2-0ubuntu1.7) ... 2023-11-28T19:29:48.989 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T19:29:49.002 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T19:29:49.039 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T19:29:49.248 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:29:49.345 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T19:29:49.365 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T19:29:49.401 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T19:29:49.409 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T19:29:49.417 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T19:29:49.460 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:29:49.737 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T19:29:49.753 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T19:29:49.795 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:29:50.127 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package bison. 2023-11-28T19:29:50.131 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T19:29:50.146 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T19:29:50.181 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:29:50.218 INFO:teuthology.orchestra.run.smithi131.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138212 files and directories currently installed.) 2023-11-28T19:29:50.223 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-11-28T19:29:50.437 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T19:29:50.559 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T19:29:50.574 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T19:29:50.617 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T19:29:50.928 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-11-28T19:29:50.945 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T19:29:50.950 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-11-28T19:29:50.960 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T19:29:51.011 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T19:29:51.020 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T19:29:51.112 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T19:29:51.134 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T19:29:51.179 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:29:51.339 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T19:29:51.354 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:51.389 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:29:51.398 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T19:29:51.411 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T19:29:51.414 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package dump. 2023-11-28T19:29:51.437 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-11-28T19:29:51.439 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:29:51.489 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking dump (0.4b47-3) ... 2023-11-28T19:29:51.764 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T19:29:51.786 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T19:29:51.801 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package indent. 2023-11-28T19:29:51.823 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:51.842 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:29:51.867 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T19:29:52.128 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-11-28T19:29:52.142 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-11-28T19:29:52.187 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T19:29:52.195 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T19:29:52.218 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T19:29:52.218 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T19:29:52.234 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:52.262 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T19:29:52.276 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:29:52.565 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T19:29:52.587 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T19:29:52.590 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-11-28T19:29:52.595 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T19:29:52.610 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:52.612 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-11-28T19:29:52.634 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T19:29:52.653 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:29:52.665 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T19:29:52.930 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T19:29:52.946 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T19:29:52.976 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-11-28T19:29:52.984 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T19:29:52.989 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:29:52.998 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-11-28T19:29:53.006 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:53.052 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T19:29:53.052 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:29:53.404 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T19:29:53.404 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libfl2:amd64. 2023-11-28T19:29:53.426 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:53.426 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-11-28T19:29:53.470 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:29:53.479 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T19:29:53.526 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T19:29:53.541 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T19:29:53.584 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T19:29:53.756 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T19:29:53.769 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:53.807 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-11-28T19:29:53.816 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:29:53.829 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-11-28T19:29:53.881 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T19:29:53.970 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package modemmanager. 2023-11-28T19:29:53.986 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T19:29:54.028 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:29:54.058 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T19:29:54.071 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T19:29:54.108 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:29:54.184 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libjson-perl. 2023-11-28T19:29:54.206 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-11-28T19:29:54.259 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-11-28T19:29:54.629 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libllvm14:amd64. 2023-11-28T19:29:54.642 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package network-manager. 2023-11-28T19:29:54.651 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2023-11-28T19:29:54.658 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T19:29:54.662 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T19:29:54.684 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T19:29:54.701 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T19:29:54.703 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T19:29:54.729 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T19:29:55.023 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package modemmanager. 2023-11-28T19:29:55.045 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T19:29:55.082 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:29:55.383 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ppp. 2023-11-28T19:29:55.398 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T19:29:55.726 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T19:29:55.738 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package network-manager. 2023-11-28T19:29:55.760 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T19:29:55.804 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T19:29:56.037 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T19:29:56.051 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T19:29:56.087 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T19:29:56.365 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T19:29:56.379 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T19:29:56.420 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package ppp. 2023-11-28T19:29:56.423 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T19:29:56.442 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T19:29:56.532 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-11-28T19:29:56.554 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T19:29:56.607 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:29:56.717 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T19:29:56.732 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T19:29:56.774 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T19:29:56.801 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T19:29:56.851 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libmbim-proxy. 2023-11-28T19:29:56.864 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-11-28T19:29:56.892 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:29:57.193 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T19:29:57.197 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T19:29:57.211 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:57.214 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T19:29:57.220 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-11-28T19:29:57.243 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T19:29:57.259 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T19:29:57.280 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:29:57.286 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:29:57.520 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T19:29:57.542 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T19:29:57.587 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T19:29:57.656 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libndp0:amd64. 2023-11-28T19:29:57.678 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-11-28T19:29:57.722 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T19:29:57.852 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T19:29:57.866 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T19:29:57.910 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T19:29:57.919 INFO:teuthology.orchestra.run.smithi203.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T19:29:57.932 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T19:29:57.950 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking postgresql-common (238) ... 2023-11-28T19:29:57.973 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T19:29:58.050 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libnm0:amd64. 2023-11-28T19:29:58.072 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T19:29:58.117 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T19:29:58.260 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T19:29:58.282 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:58.326 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:29:58.426 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T19:29:58.436 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libpq5:amd64. 2023-11-28T19:29:58.440 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:58.458 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../16-libpq5_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:58.486 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:29:58.502 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:29:58.856 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-11-28T19:29:58.878 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:58.907 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T19:29:58.922 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:29:58.929 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T19:29:58.991 INFO:teuthology.orchestra.run.smithi028.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T19:29:59.021 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-common (238) ... 2023-11-28T19:29:59.233 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libqmi-proxy. 2023-11-28T19:29:59.245 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:59.282 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:29:59.481 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T19:29:59.503 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:29:59.526 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-11-28T19:29:59.539 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.12_amd64.deb ... 2023-11-28T19:29:59.541 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:29:59.576 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:29:59.670 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package postgresql. 2023-11-28T19:29:59.685 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T19:29:59.754 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking postgresql (14+238) ... 2023-11-28T19:29:59.997 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T19:30:00.011 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T19:30:00.055 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T19:30:00.105 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-11-28T19:30:00.127 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-11-28T19:30:00.171 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T19:30:00.324 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T19:30:00.339 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T19:30:00.382 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T19:30:00.508 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package modemmanager. 2023-11-28T19:30:00.529 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.2_amd64.deb ... 2023-11-28T19:30:00.633 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:30:00.702 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T19:30:00.716 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T19:30:00.734 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql. 2023-11-28T19:30:00.747 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T19:30:00.752 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T19:30:00.792 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql (14+238) ... 2023-11-28T19:30:01.004 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package tcl. 2023-11-28T19:30:01.019 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T19:30:01.035 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T19:30:01.049 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T19:30:01.067 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T19:30:01.086 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T19:30:01.330 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T19:30:01.353 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T19:30:01.388 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T19:30:01.449 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T19:30:01.457 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package network-manager. 2023-11-28T19:30:01.463 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T19:30:01.479 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-11-28T19:30:01.507 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T19:30:01.532 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-11-28T19:30:01.674 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T19:30:01.697 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T19:30:01.740 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T19:30:01.879 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T19:30:01.892 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T19:30:02.011 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T19:30:02.200 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package ppp. 2023-11-28T19:30:02.221 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package tcl. 2023-11-28T19:30:02.221 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-11-28T19:30:02.244 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T19:30:02.383 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T19:30:02.415 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T19:30:02.430 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T19:30:02.482 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T19:30:02.518 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T19:30:02.807 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T19:30:02.846 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package pptp-linux. 2023-11-28T19:30:02.856 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T19:30:02.868 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-11-28T19:30:02.878 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T19:30:02.912 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-11-28T19:30:02.922 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T19:30:03.013 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T19:30:03.166 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package network-manager-pptp. 2023-11-28T19:30:03.172 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T19:30:03.178 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-11-28T19:30:03.215 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-11-28T19:30:03.260 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T19:30:03.283 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T19:30:03.302 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:30:03.327 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T19:30:03.424 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T19:30:03.485 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-client-common. 2023-11-28T19:30:03.498 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-11-28T19:30:03.526 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-client-common (238) ... 2023-11-28T19:30:03.575 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T19:30:03.701 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:30:03.730 INFO:teuthology.orchestra.run.smithi028.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T19:30:03.753 INFO:teuthology.orchestra.run.smithi028.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T19:30:03.804 INFO:teuthology.orchestra.run.smithi028.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T19:30:03.830 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-client-14. 2023-11-28T19:30:03.852 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../27-postgresql-client-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:30:03.961 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:30:04.065 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T19:30:04.269 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T19:30:04.404 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T19:30:04.530 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:30:04.619 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-common. 2023-11-28T19:30:04.641 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-11-28T19:30:04.656 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T19:30:04.704 INFO:teuthology.orchestra.run.smithi131.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-11-28T19:30:04.705 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T19:30:04.742 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-common (238) ... 2023-11-28T19:30:04.782 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T19:30:04.807 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T19:30:04.908 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:30:05.211 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-14. 2023-11-28T19:30:05.218 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T19:30:05.219 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T19:30:05.233 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../29-postgresql-14_14.9-0ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:30:05.280 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:30:05.445 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T19:30:05.531 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T19:30:05.919 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T19:30:05.923 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T19:30:05.923 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T19:30:06.053 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:30:06.170 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T19:30:06.272 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T19:30:06.381 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T19:30:06.475 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T19:30:06.598 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T19:30:06.601 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:30:06.639 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql. 2023-11-28T19:30:06.652 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-11-28T19:30:06.697 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql (14+238) ... 2023-11-28T19:30:06.724 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T19:30:06.727 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T19:30:06.836 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T19:30:06.941 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-client. 2023-11-28T19:30:06.955 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T19:30:06.955 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-11-28T19:30:06.991 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-client (14+238) ... 2023-11-28T19:30:07.080 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T19:30:07.206 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T19:30:07.235 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package postgresql-contrib. 2023-11-28T19:30:07.248 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-11-28T19:30:07.285 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking postgresql-contrib (14+238) ... 2023-11-28T19:30:07.421 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T19:30:07.522 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T19:30:07.587 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package tcl8.6. 2023-11-28T19:30:07.610 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-11-28T19:30:07.617 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T19:30:07.654 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T19:30:07.682 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:30:07.808 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T19:30:07.940 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package tcl. 2023-11-28T19:30:07.959 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T19:30:07.963 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-11-28T19:30:08.012 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-11-28T19:30:08.085 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T19:30:08.211 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T19:30:08.301 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T19:30:08.303 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T19:30:08.360 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package wpasupplicant. 2023-11-28T19:30:08.383 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-11-28T19:30:08.388 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T19:30:08.426 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T19:30:08.438 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T19:30:08.489 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T19:30:08.531 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T19:30:08.598 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:30:08.649 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T19:30:08.724 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T19:30:08.774 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:30:08.815 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-11-28T19:30:08.837 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-11-28T19:30:08.850 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T19:30:08.881 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-11-28T19:30:08.934 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T19:30:08.968 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T19:30:09.077 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T19:30:09.102 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T19:30:09.167 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T19:30:09.228 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T19:30:09.228 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T19:30:09.285 INFO:teuthology.orchestra.run.smithi131.stdout:Selecting previously unselected package usb-modeswitch. 2023-11-28T19:30:09.307 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-11-28T19:30:09.355 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T19:30:09.359 INFO:teuthology.orchestra.run.smithi131.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T19:30:09.531 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T19:30:09.653 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-client-common (238) ... 2023-11-28T19:30:09.657 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:30:09.783 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T19:30:09.843 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:09.843 INFO:teuthology.orchestra.run.smithi203.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T19:30:09.844 INFO:teuthology.orchestra.run.smithi203.stdout:which means they are currently configured by ifupdown: 2023-11-28T19:30:09.844 INFO:teuthology.orchestra.run.smithi203.stdout:- enp3s0f1 2023-11-28T19:30:09.844 INFO:teuthology.orchestra.run.smithi203.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T19:30:09.844 INFO:teuthology.orchestra.run.smithi203.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T19:30:09.844 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:09.858 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up flex (2.6.4-8build2) ... 2023-11-28T19:30:09.943 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T19:30:09.959 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-11-28T19:30:09.976 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T19:30:10.052 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T19:30:10.085 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libpq5:amd64 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:30:10.211 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-11-28T19:30:10.337 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-11-28T19:30:10.397 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T19:30:10.463 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-client-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:30:10.580 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:10.580 INFO:teuthology.orchestra.run.smithi028.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T19:30:10.580 INFO:teuthology.orchestra.run.smithi028.stdout:which means they are currently configured by ifupdown: 2023-11-28T19:30:10.580 INFO:teuthology.orchestra.run.smithi028.stdout:- ens1f0 2023-11-28T19:30:10.581 INFO:teuthology.orchestra.run.smithi028.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T19:30:10.581 INFO:teuthology.orchestra.run.smithi028.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T19:30:10.581 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:10.693 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T19:30:10.800 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T19:30:10.928 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-11-28T19:30:11.010 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-11-28T19:30:11.064 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T19:30:11.437 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T19:30:11.452 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T19:30:11.453 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-11-28T19:30:11.480 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:30:11.615 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T19:30:11.766 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T19:30:11.892 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up postgresql-common (238) ... 2023-11-28T19:30:12.031 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:30:12.038 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-11-28T19:30:12.165 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T19:30:12.173 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.12) ... 2023-11-28T19:30:12.291 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T19:30:12.299 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-11-28T19:30:12.416 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-11-28T19:30:12.417 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-common (238) ... 2023-11-28T19:30:12.534 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-11-28T19:30:12.660 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-11-28T19:30:12.786 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-11-28T19:30:13.099 INFO:teuthology.orchestra.run.smithi203.stdout:Adding user postgres to group ssl-cert 2023-11-28T19:30:13.374 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:13.374 INFO:teuthology.orchestra.run.smithi203.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T19:30:13.467 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2023-11-28T19:30:13.584 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up dump (0.4b47-3) ... 2023-11-28T19:30:13.643 INFO:teuthology.orchestra.run.smithi203.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T19:30:13.644 INFO:teuthology.orchestra.run.smithi203.stdout:Removing obsolete dictionary files: 2023-11-28T19:30:13.678 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-11-28T19:30:13.744 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:30:13.856 INFO:teuthology.orchestra.run.smithi028.stdout:Adding user postgres to group ssl-cert 2023-11-28T19:30:13.870 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-11-28T19:30:13.997 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up tcl (8.6.11+1build2) ... 2023-11-28T19:30:14.048 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:14.049 INFO:teuthology.orchestra.run.smithi028.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T19:30:14.131 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libjson-perl (4.04000-1) ... 2023-11-28T19:30:14.246 INFO:teuthology.orchestra.run.smithi028.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T19:30:14.246 INFO:teuthology.orchestra.run.smithi028.stdout:Removing obsolete dictionary files: 2023-11-28T19:30:14.257 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-11-28T19:30:14.347 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-11-28T19:30:14.349 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T19:30:14.467 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2023-11-28T19:30:14.585 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-11-28T19:30:14.761 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-11-28T19:30:14.887 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:30:14.894 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:30:14.906 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T19:30:15.013 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-11-28T19:30:15.181 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-client (14+238) ... 2023-11-28T19:30:15.235 INFO:teuthology.orchestra.run.smithi203.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T19:30:15.255 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T19:30:15.299 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-11-28T19:30:15.314 INFO:teuthology.orchestra.run.smithi203.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T19:30:15.314 INFO:teuthology.orchestra.run.smithi203.stdout:This user must also own the server process. 2023-11-28T19:30:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:15.314 INFO:teuthology.orchestra.run.smithi203.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T19:30:15.314 INFO:teuthology.orchestra.run.smithi203.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T19:30:15.314 INFO:teuthology.orchestra.run.smithi203.stdout:The default text search configuration will be set to "english". 2023-11-28T19:30:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:15.314 INFO:teuthology.orchestra.run.smithi203.stdout:Data page checksums are disabled. 2023-11-28T19:30:15.314 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:15.315 INFO:teuthology.orchestra.run.smithi203.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T19:30:15.315 INFO:teuthology.orchestra.run.smithi203.stdout:creating subdirectories ... ok 2023-11-28T19:30:15.315 INFO:teuthology.orchestra.run.smithi203.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T19:30:15.340 INFO:teuthology.orchestra.run.smithi203.stdout:selecting default max_connections ... 100 2023-11-28T19:30:15.370 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:30:15.374 INFO:teuthology.orchestra.run.smithi203.stdout:selecting default shared_buffers ... 128MB 2023-11-28T19:30:15.388 INFO:teuthology.orchestra.run.smithi203.stdout:selecting default time zone ... Etc/UTC 2023-11-28T19:30:15.389 INFO:teuthology.orchestra.run.smithi203.stdout:creating configuration files ... ok 2023-11-28T19:30:15.558 INFO:teuthology.orchestra.run.smithi203.stdout:running bootstrap script ... ok 2023-11-28T19:30:15.713 INFO:teuthology.orchestra.run.smithi028.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T19:30:15.729 INFO:teuthology.orchestra.run.smithi028.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T19:30:15.770 INFO:teuthology.orchestra.run.smithi028.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T19:30:15.771 INFO:teuthology.orchestra.run.smithi028.stdout:This user must also own the server process. 2023-11-28T19:30:15.771 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:15.771 INFO:teuthology.orchestra.run.smithi028.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T19:30:15.771 INFO:teuthology.orchestra.run.smithi028.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T19:30:15.771 INFO:teuthology.orchestra.run.smithi028.stdout:The default text search configuration will be set to "english". 2023-11-28T19:30:15.771 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:15.771 INFO:teuthology.orchestra.run.smithi028.stdout:Data page checksums are disabled. 2023-11-28T19:30:15.771 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:15.771 INFO:teuthology.orchestra.run.smithi028.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T19:30:15.771 INFO:teuthology.orchestra.run.smithi028.stdout:creating subdirectories ... ok 2023-11-28T19:30:15.771 INFO:teuthology.orchestra.run.smithi028.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T19:30:15.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:15.773 INFO:teuthology.orchestra.run.smithi131.stdout:The following network interfaces were found in /etc/network/interfaces 2023-11-28T19:30:15.773 INFO:teuthology.orchestra.run.smithi131.stdout:which means they are currently configured by ifupdown: 2023-11-28T19:30:15.773 INFO:teuthology.orchestra.run.smithi131.stdout:- enp3s0f1 2023-11-28T19:30:15.773 INFO:teuthology.orchestra.run.smithi131.stdout:If you want to manage those interfaces with NetworkManager instead 2023-11-28T19:30:15.773 INFO:teuthology.orchestra.run.smithi131.stdout:remove their configuration from /etc/network/interfaces. 2023-11-28T19:30:15.773 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:15.787 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default max_connections ... 100 2023-11-28T19:30:15.807 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default shared_buffers ... 128MB 2023-11-28T19:30:15.816 INFO:teuthology.orchestra.run.smithi028.stdout:selecting default time zone ... Etc/UTC 2023-11-28T19:30:15.817 INFO:teuthology.orchestra.run.smithi028.stdout:creating configuration files ... ok 2023-11-28T19:30:15.889 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-11-28T19:30:15.934 INFO:teuthology.orchestra.run.smithi028.stdout:running bootstrap script ... ok 2023-11-28T19:30:16.185 INFO:teuthology.orchestra.run.smithi203.stdout:performing post-bootstrap initialization ... ok 2023-11-28T19:30:16.230 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-11-28T19:30:16.581 INFO:teuthology.orchestra.run.smithi028.stdout:performing post-bootstrap initialization ... ok 2023-11-28T19:30:16.627 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-11-28T19:30:16.840 INFO:teuthology.orchestra.run.smithi203.stdout:syncing data to disk ... ok 2023-11-28T19:30:17.177 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-11-28T19:30:17.315 INFO:teuthology.orchestra.run.smithi028.stdout:syncing data to disk ... ok 2023-11-28T19:30:17.328 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-11-28T19:30:17.348 INFO:teuthology.orchestra.run.smithi203.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T19:30:17.454 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-11-28T19:30:17.589 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-common (238) ... 2023-11-28T19:30:17.733 INFO:teuthology.orchestra.run.smithi028.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T19:30:18.521 INFO:teuthology.orchestra.run.smithi131.stdout:Adding user postgres to group ssl-cert 2023-11-28T19:30:18.706 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:18.706 INFO:teuthology.orchestra.run.smithi131.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-11-28T19:30:18.912 INFO:teuthology.orchestra.run.smithi131.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-11-28T19:30:18.912 INFO:teuthology.orchestra.run.smithi131.stdout:Removing obsolete dictionary files: 2023-11-28T19:30:19.472 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-11-28T19:30:19.891 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-14 (14.9-0ubuntu0.22.04.1) ... 2023-11-28T19:30:20.226 INFO:teuthology.orchestra.run.smithi131.stdout:Creating new PostgreSQL cluster 14/main ... 2023-11-28T19:30:20.255 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-11-28T19:30:20.294 INFO:teuthology.orchestra.run.smithi131.stdout:The files belonging to this database system will be owned by user "postgres". 2023-11-28T19:30:20.294 INFO:teuthology.orchestra.run.smithi131.stdout:This user must also own the server process. 2023-11-28T19:30:20.294 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:20.294 INFO:teuthology.orchestra.run.smithi131.stdout:The database cluster will be initialized with locale "en_US". 2023-11-28T19:30:20.295 INFO:teuthology.orchestra.run.smithi131.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-11-28T19:30:20.295 INFO:teuthology.orchestra.run.smithi131.stdout:The default text search configuration will be set to "english". 2023-11-28T19:30:20.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:20.295 INFO:teuthology.orchestra.run.smithi131.stdout:Data page checksums are disabled. 2023-11-28T19:30:20.295 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:20.295 INFO:teuthology.orchestra.run.smithi131.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-11-28T19:30:20.295 INFO:teuthology.orchestra.run.smithi131.stdout:creating subdirectories ... ok 2023-11-28T19:30:20.295 INFO:teuthology.orchestra.run.smithi131.stdout:selecting dynamic shared memory implementation ... posix 2023-11-28T19:30:20.310 INFO:teuthology.orchestra.run.smithi131.stdout:selecting default max_connections ... 100 2023-11-28T19:30:20.329 INFO:teuthology.orchestra.run.smithi131.stdout:selecting default shared_buffers ... 128MB 2023-11-28T19:30:20.338 INFO:teuthology.orchestra.run.smithi131.stdout:selecting default time zone ... Etc/UTC 2023-11-28T19:30:20.339 INFO:teuthology.orchestra.run.smithi131.stdout:creating configuration files ... ok 2023-11-28T19:30:20.385 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:30:20.450 INFO:teuthology.orchestra.run.smithi131.stdout:running bootstrap script ... ok 2023-11-28T19:30:20.529 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:30:20.535 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T19:30:20.645 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up postgresql (14+238) ... 2023-11-28T19:30:20.669 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T19:30:20.754 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:30:20.804 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up postgresql (14+238) ... 2023-11-28T19:30:20.871 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:30:20.930 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:30:21.056 INFO:teuthology.orchestra.run.smithi028.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:30:21.077 INFO:teuthology.orchestra.run.smithi131.stdout:performing post-bootstrap initialization ... ok 2023-11-28T19:30:21.165 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T19:30:21.166 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T19:30:21.320 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T19:30:21.320 INFO:teuthology.orchestra.run.smithi028.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T19:30:21.869 INFO:teuthology.orchestra.run.smithi131.stdout:syncing data to disk ... ok 2023-11-28T19:30:21.949 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T19:30:21.961 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T19:30:22.282 INFO:teuthology.orchestra.run.smithi131.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-11-28T19:30:22.286 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T19:30:22.293 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T19:30:22.478 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T19:30:22.504 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T19:30:23.874 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T19:30:23.974 INFO:teuthology.orchestra.run.smithi028.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T19:30:24.466 INFO:teuthology.orchestra.run.smithi028.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T19:30:24.470 DEBUG:teuthology.parallel:result is None 2023-11-28T19:30:24.499 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T19:30:24.679 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T19:30:25.106 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:30:25.207 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql-contrib (14+238) ... 2023-11-28T19:30:25.333 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up postgresql (14+238) ... 2023-11-28T19:30:25.404 INFO:teuthology.orchestra.run.smithi203.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T19:30:25.408 DEBUG:teuthology.parallel:result is None 2023-11-28T19:30:25.459 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-11-28T19:30:25.585 INFO:teuthology.orchestra.run.smithi131.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.2) ... 2023-11-28T19:30:25.840 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T19:30:25.840 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-11-28T19:30:26.447 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-11-28T19:30:26.741 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T19:30:26.892 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T19:30:28.262 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T19:30:28.370 INFO:teuthology.orchestra.run.smithi131.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T19:30:28.889 INFO:teuthology.orchestra.run.smithi131.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-11-28T19:30:28.893 DEBUG:teuthology.parallel:result is None 2023-11-28T19:30:28.893 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T19:30:29.036 DEBUG:teuthology.orchestra.run.smithi028:> dpkg-query -W -f '${Version}' ceph 2023-11-28T19:30:29.057 INFO:teuthology.orchestra.run.smithi028.stdout:18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:30:29.058 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:30:29.058 INFO:teuthology.task.install:The correct ceph version 18.0.0-7520-g43dd94c1-1jammy is installed. 2023-11-28T19:30:29.059 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T19:30:29.279 DEBUG:teuthology.orchestra.run.smithi131:> dpkg-query -W -f '${Version}' ceph 2023-11-28T19:30:29.299 INFO:teuthology.orchestra.run.smithi131.stdout:18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:30:29.299 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:30:29.299 INFO:teuthology.task.install:The correct ceph version 18.0.0-7520-g43dd94c1-1jammy is installed. 2023-11-28T19:30:29.299 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=43dd94c190073cf16cff1e711dd7f5a7b1cbc883 2023-11-28T19:30:29.435 DEBUG:teuthology.orchestra.run.smithi203:> dpkg-query -W -f '${Version}' ceph 2023-11-28T19:30:29.459 INFO:teuthology.orchestra.run.smithi203.stdout:18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:30:29.459 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-7520-g43dd94c1-1jammy 2023-11-28T19:30:29.459 INFO:teuthology.task.install:The correct ceph version 18.0.0-7520-g43dd94c1-1jammy is installed. 2023-11-28T19:30:29.459 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-11-28T19:30:29.460 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:30:29.460 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T19:30:29.475 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:30:29.475 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T19:30:29.489 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:30:29.489 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-11-28T19:30:29.527 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-11-28T19:30:29.528 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:30:29.528 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T19:30:29.542 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T19:30:29.595 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:30:29.595 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T19:30:29.609 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T19:30:29.661 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:30:29.662 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/daemon-helper 2023-11-28T19:30:29.683 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-11-28T19:30:29.751 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-11-28T19:30:29.751 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:30:29.751 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T19:30:29.765 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T19:30:29.819 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:30:29.819 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T19:30:29.832 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T19:30:29.885 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:30:29.886 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/adjust-ulimits 2023-11-28T19:30:29.907 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-11-28T19:30:29.974 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-11-28T19:30:29.974 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:30:29.974 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T19:30:29.988 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T19:30:30.043 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:30:30.044 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T19:30:30.059 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T19:30:30.118 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:30:30.118 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/stdin-killer 2023-11-28T19:30:30.140 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-11-28T19:30:30.207 INFO:teuthology.run_tasks:Running task ceph... 2023-11-28T19:30:30.278 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-11-28T19:30:30.279 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 777 /var/log/ceph 2023-11-28T19:30:30.281 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2023-11-28T19:30:30.284 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 777 /var/log/ceph 2023-11-28T19:30:30.305 INFO:tasks.ceph:Disabling ceph logrotate... 2023-11-28T19:30:30.306 DEBUG:teuthology.orchestra.run.smithi028:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T19:30:30.337 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T19:30:30.344 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/logrotate.d/ceph 2023-11-28T19:30:30.370 INFO:tasks.ceph:Creating extra log directories... 2023-11-28T19:30:30.370 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T19:30:30.393 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T19:30:30.400 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-11-28T19:30:30.446 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-11-28T19:30:30.446 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-11-28T19:30:30.446 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-11-28T19:30:30.447 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:30:30.447 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T19:30:30.453 DEBUG:teuthology.orchestra.run.smithi028:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T19:30:30.531 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:30:30.531 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T19:30:30.538 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T19:30:30.611 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:30:30.611 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-11-28T19:30:30.621 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-11-28T19:30:30.718 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-11-28T19:30:30.718 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-11-28T19:30:30.718 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi/7469560', 'branch': 'wip-vshankar-testing-20231127.102914', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/{0-client 1-tests/fscrypt-common}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7469560', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-11-28_06:29:14-fs-wip-vshankar-testing-20231127.102914-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20231127.102914'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, 'kclient': {'syntax': 'v2'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20231127.102914', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 150, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 8377, 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'sleep_before_teardown': 0, 'subset': '462/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20231127.102914', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi028.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFD0UqFdgaeYHmKtCuxFRFq4UfYsI2HjxUOyex8iH5Ynbnh3HoCRnhnRw4elCuiK6M6V/Y+D9KEoBlCQv+rqAIg=', 'smithi131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDB28tW1sgttDOzf7fivMRb+Fz5baJsZ273ewCM+cLg/NJ75vdEEXt7RFi/gHwstO7eFM5k0P1FKS3bEtDKZFY8=', 'smithi203.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBqiX2kl6JtCwVrIaTnZhuqWwq5odcom7EN36WIz4d4O8kQZrNjq/Se/7RrqHbA9EEuWpcsDA6SRU9zO3zYTn0E='}, 'task': None, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': '8247bbb5b470f7e2a1f3eefcc16e24cf1338f606'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '43dd94c190073cf16cff1e711dd7f5a7b1cbc883', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end', 'if not is_kupstream() then reject() end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5ae09a5cc7064ca2bf994df19f3006b79794789a', 'timestamp': '2023-11-28_06:29:14', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-11-28T19:30:30.719 DEBUG:teuthology.orchestra.run.smithi028:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T19:30:30.721 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T19:30:30.726 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-11-28T19:30:30.735 DEBUG:teuthology.orchestra.run.smithi028:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T19:30:36.053 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T19:30:36.057 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m0777 -- /var/run/ceph 2023-11-28T19:30:36.080 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:30:36.081 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T19:30:36.114 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T19:30:36.115 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_1 2023-11-28T19:30:36.160 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T19:30:36.160 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:30:36.160 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 867 Links: 1 2023-11-28T19:30:36.161 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:30:36.161 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2023-11-28 19:23:23.702573322 +0000 2023-11-28T19:30:36.161 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2023-11-28 19:23:23.302576894 +0000 2023-11-28T19:30:36.161 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2023-11-28 19:23:23.302576894 +0000 2023-11-28T19:30:36.161 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: - 2023-11-28T19:30:36.161 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T19:30:36.218 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2023-11-28T19:30:36.218 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2023-11-28T19:30:36.219 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000296124 s, 1.7 MB/s 2023-11-28T19:30:36.220 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T19:30:36.269 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_2 2023-11-28T19:30:36.316 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T19:30:36.316 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:30:36.316 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 885 Links: 1 2023-11-28T19:30:36.316 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:30:36.316 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2023-11-28 19:23:24.290568070 +0000 2023-11-28T19:30:36.316 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2023-11-28 19:23:23.930571285 +0000 2023-11-28T19:30:36.316 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2023-11-28 19:23:23.930571285 +0000 2023-11-28T19:30:36.316 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: - 2023-11-28T19:30:36.317 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T19:30:36.371 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2023-11-28T19:30:36.371 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2023-11-28T19:30:36.371 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000353681 s, 1.4 MB/s 2023-11-28T19:30:36.372 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T19:30:36.421 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_3 2023-11-28T19:30:36.468 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T19:30:36.468 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:30:36.468 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 896 Links: 1 2023-11-28T19:30:36.468 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:30:36.468 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2023-11-28 19:23:24.886562746 +0000 2023-11-28T19:30:36.468 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2023-11-28 19:23:24.514566069 +0000 2023-11-28T19:30:36.468 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2023-11-28 19:23:24.514566069 +0000 2023-11-28T19:30:36.468 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: - 2023-11-28T19:30:36.469 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T19:30:36.522 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2023-11-28T19:30:36.523 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2023-11-28T19:30:36.523 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.00022267 s, 2.3 MB/s 2023-11-28T19:30:36.524 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T19:30:36.573 DEBUG:teuthology.orchestra.run.smithi028:> stat /dev/vg_nvme/lv_4 2023-11-28T19:30:36.620 INFO:teuthology.orchestra.run.smithi028.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T19:30:36.620 INFO:teuthology.orchestra.run.smithi028.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:30:36.620 INFO:teuthology.orchestra.run.smithi028.stdout:Device: 5h/5d Inode: 911 Links: 1 2023-11-28T19:30:36.621 INFO:teuthology.orchestra.run.smithi028.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:30:36.621 INFO:teuthology.orchestra.run.smithi028.stdout:Access: 2023-11-28 19:23:25.474557494 +0000 2023-11-28T19:30:36.621 INFO:teuthology.orchestra.run.smithi028.stdout:Modify: 2023-11-28 19:23:25.122560638 +0000 2023-11-28T19:30:36.621 INFO:teuthology.orchestra.run.smithi028.stdout:Change: 2023-11-28 19:23:25.122560638 +0000 2023-11-28T19:30:36.621 INFO:teuthology.orchestra.run.smithi028.stdout: Birth: - 2023-11-28T19:30:36.622 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T19:30:36.675 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records in 2023-11-28T19:30:36.675 INFO:teuthology.orchestra.run.smithi028.stderr:1+0 records out 2023-11-28T19:30:36.675 INFO:teuthology.orchestra.run.smithi028.stderr:512 bytes copied, 0.000343434 s, 1.5 MB/s 2023-11-28T19:30:36.677 DEBUG:teuthology.orchestra.run.smithi028:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T19:30:36.726 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T19:30:36.726 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:30:36.726 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2023-11-28T19:30:36.732 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-11-28T19:30:36.732 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2023-11-28T19:30:36.780 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-11-28T19:30:36.780 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:30:36.780 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 887 Links: 1 2023-11-28T19:30:36.780 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:30:36.781 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-11-28 19:23:23.602269935 +0000 2023-11-28T19:30:36.781 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-11-28 19:23:23.206273472 +0000 2023-11-28T19:30:36.781 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-11-28 19:23:23.206273472 +0000 2023-11-28T19:30:36.781 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-11-28T19:30:36.781 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-11-28T19:30:36.834 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-11-28T19:30:36.834 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-11-28T19:30:36.834 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000584895 s, 875 kB/s 2023-11-28T19:30:36.835 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-11-28T19:30:36.884 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2023-11-28T19:30:36.939 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-11-28T19:30:36.939 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:30:36.939 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 896 Links: 1 2023-11-28T19:30:36.940 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:30:36.940 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-11-28 19:23:24.250264147 +0000 2023-11-28T19:30:36.940 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-11-28 19:23:23.846267754 +0000 2023-11-28T19:30:36.940 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-11-28 19:23:23.846267754 +0000 2023-11-28T19:30:36.941 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-11-28T19:30:36.941 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-11-28T19:30:36.993 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-11-28T19:30:36.994 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-11-28T19:30:36.994 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000493382 s, 1.0 MB/s 2023-11-28T19:30:36.995 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-11-28T19:30:37.044 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2023-11-28T19:30:37.095 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-11-28T19:30:37.095 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:30:37.095 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 920 Links: 1 2023-11-28T19:30:37.095 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:30:37.095 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-11-28 19:23:24.894258393 +0000 2023-11-28T19:30:37.095 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-11-28 19:23:24.498261932 +0000 2023-11-28T19:30:37.095 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-11-28 19:23:24.498261932 +0000 2023-11-28T19:30:37.096 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-11-28T19:30:37.096 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-11-28T19:30:37.153 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-11-28T19:30:37.153 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-11-28T19:30:37.153 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000491669 s, 1.0 MB/s 2023-11-28T19:30:37.154 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-11-28T19:30:37.209 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2023-11-28T19:30:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-11-28T19:30:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-11-28T19:30:37.255 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 933 Links: 1 2023-11-28T19:30:37.255 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-11-28T19:30:37.255 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2023-11-28 19:23:25.486253106 +0000 2023-11-28T19:30:37.255 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2023-11-28 19:23:25.122256358 +0000 2023-11-28T19:30:37.255 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2023-11-28 19:23:25.122256358 +0000 2023-11-28T19:30:37.255 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2023-11-28T19:30:37.256 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-11-28T19:30:37.310 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2023-11-28T19:30:37.310 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2023-11-28T19:30:37.310 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000520565 s, 984 kB/s 2023-11-28T19:30:37.311 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-11-28T19:30:37.360 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T19:30:37.361 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T19:30:37.361 INFO:tasks.ceph:Generating config... 2023-11-28T19:30:37.363 INFO:tasks.ceph:[client] client mount timeout = 600 2023-11-28T19:30:37.363 INFO:tasks.ceph:[client] debug client = 20 2023-11-28T19:30:37.363 INFO:tasks.ceph:[client] debug ms = 1 2023-11-28T19:30:37.363 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-11-28T19:30:37.363 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-11-28T19:30:37.363 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-11-28T19:30:37.364 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-11-28T19:30:37.364 INFO:tasks.ceph:[mds] debug mds = 20 2023-11-28T19:30:37.364 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-11-28T19:30:37.364 INFO:tasks.ceph:[mds] debug ms = 1 2023-11-28T19:30:37.364 INFO:tasks.ceph:[mds] mds debug frag = True 2023-11-28T19:30:37.364 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-11-28T19:30:37.364 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-11-28T19:30:37.364 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-11-28T19:30:37.364 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-11-28T19:30:37.364 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-11-28T19:30:37.364 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-11-28T19:30:37.364 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-11-28T19:30:37.364 INFO:tasks.ceph:[mgr] debug ms = 1 2023-11-28T19:30:37.365 INFO:tasks.ceph:[mon] debug mon = 20 2023-11-28T19:30:37.365 INFO:tasks.ceph:[mon] debug ms = 1 2023-11-28T19:30:37.365 INFO:tasks.ceph:[mon] debug paxos = 20 2023-11-28T19:30:37.365 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-11-28T19:30:37.365 INFO:tasks.ceph:[osd] bdev async discard = True 2023-11-28T19:30:37.365 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-11-28T19:30:37.365 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-11-28T19:30:37.365 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-11-28T19:30:37.365 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-11-28T19:30:37.365 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-11-28T19:30:37.365 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-11-28T19:30:37.365 INFO:tasks.ceph:[osd] debug ms = 1 2023-11-28T19:30:37.366 INFO:tasks.ceph:[osd] debug osd = 20 2023-11-28T19:30:37.366 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-11-28T19:30:37.366 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-11-28T19:30:37.366 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-11-28T19:30:37.366 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-11-28T19:30:37.366 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-11-28T19:30:37.366 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-11-28T19:30:37.366 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-11-28T19:30:37.367 INFO:tasks.ceph:Setting up mon.a... 2023-11-28T19:30:37.367 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-11-28T19:30:37.401 INFO:teuthology.orchestra.run.smithi028.stdout:creating /etc/ceph/ceph.keyring 2023-11-28T19:30:37.416 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-11-28T19:30:37.498 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T19:30:37.552 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.28'), ('mon.b', '172.21.15.131'), ('mon.c', '[v2:172.21.15.131:3301,v1:172.21.15.131:6790]')] 2023-11-28T19:30:37.552 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.28,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]', 'mon pg warn min per osd': 0, 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-11-28T19:30:37.553 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:30:37.553 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T19:30:37.600 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.28 --add b 172.21.15.131 --addv c '[v2:172.21.15.131:3301,v1:172.21.15.131:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:30:37.691 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:30:37.691 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: generated fsid ae116b99-23bb-451b-9ddc-fdb049a33145 2023-11-28T19:30:37.691 INFO:teuthology.orchestra.run.smithi028.stdout:setting min_mon_release = pacific 2023-11-28T19:30:37.692 INFO:teuthology.orchestra.run.smithi028.stdout:epoch 0 2023-11-28T19:30:37.692 INFO:teuthology.orchestra.run.smithi028.stdout:fsid ae116b99-23bb-451b-9ddc-fdb049a33145 2023-11-28T19:30:37.692 INFO:teuthology.orchestra.run.smithi028.stdout:last_changed 2023-11-28T19:30:37.694716+0000 2023-11-28T19:30:37.692 INFO:teuthology.orchestra.run.smithi028.stdout:created 2023-11-28T19:30:37.694716+0000 2023-11-28T19:30:37.692 INFO:teuthology.orchestra.run.smithi028.stdout:min_mon_release 16 (pacific) 2023-11-28T19:30:37.692 INFO:teuthology.orchestra.run.smithi028.stdout:election_strategy: 1 2023-11-28T19:30:37.692 INFO:teuthology.orchestra.run.smithi028.stdout:0: [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] mon.a 2023-11-28T19:30:37.692 INFO:teuthology.orchestra.run.smithi028.stdout:1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.b 2023-11-28T19:30:37.692 INFO:teuthology.orchestra.run.smithi028.stdout:2: [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] mon.c 2023-11-28T19:30:37.693 INFO:teuthology.orchestra.run.smithi028.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-11-28T19:30:37.694 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-11-28T19:30:37.699 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ae116b99-23bb-451b-9ddc-fdb049a33145... 2023-11-28T19:30:37.700 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T19:30:37.745 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T19:30:37.748 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-11-28T19:30:37.773 INFO:teuthology.orchestra.run.smithi028.stdout:[global] 2023-11-28T19:30:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: chdir = "" 2023-11-28T19:30:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T19:30:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: auth supported = cephx 2023-11-28T19:30:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.773 INFO:teuthology.orchestra.run.smithi028.stdout: filestore xattr use omap = true 2023-11-28T19:30:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: mon clock drift allowed = 1.000 2023-11-28T19:30:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: osd crush chooseleaf type = 0 2023-11-28T19:30:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: auth debug = true 2023-11-28T19:30:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on old message = true 2023-11-28T19:30:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on bug = true 2023-11-28T19:30:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T19:30:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: mon pg warn max object skew = 0 2023-11-28T19:30:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.774 INFO:teuthology.orchestra.run.smithi028.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T19:30:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T19:30:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default size = 2 2023-11-28T19:30:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow primary affinity = true 2023-11-28T19:30:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd allow pg remap = true 2023-11-28T19:30:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on legacy crush tunables = false 2023-11-28T19:30:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on crush straw calc version zero = false 2023-11-28T19:30:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on no sortbitwise = false 2023-11-28T19:30:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on osd down out interval zero = false 2023-11-28T19:30:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: mon warn on too few osds = false 2023-11-28T19:30:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T19:30:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T19:30:37.775 INFO:teuthology.orchestra.run.smithi028.stdout: mon_allow_pool_size_one = true 2023-11-28T19:30:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T19:30:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: osd default data pool replay window = 5 2023-11-28T19:30:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: mon allow pool delete = true 2023-11-28T19:30:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: mon cluster log file level = debug 2023-11-28T19:30:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: debug asserts on shutdown = true 2023-11-28T19:30:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: mon health detail to clog = false 2023-11-28T19:30:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: mon host = "172.21.15.28,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2023-11-28T19:30:37.776 INFO:teuthology.orchestra.run.smithi028.stdout: mon pg warn min per osd = 0 2023-11-28T19:30:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: ms die on skipped message = False 2023-11-28T19:30:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: fsid = ae116b99-23bb-451b-9ddc-fdb049a33145 2023-11-28T19:30:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.777 INFO:teuthology.orchestra.run.smithi028.stdout:[osd] 2023-11-28T19:30:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: osd journal size = 100 2023-11-28T19:30:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub load threshold = 5.0 2023-11-28T19:30:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: osd scrub max interval = 600 2023-11-28T19:30:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: osd mclock profile = high_recovery_ops 2023-11-28T19:30:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: osd recover clone overlap = true 2023-11-28T19:30:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: osd recovery max chunk = 1048576 2023-11-28T19:30:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.777 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug shutdown = true 2023-11-28T19:30:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug op order = true 2023-11-28T19:30:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug verify stray on activate = true 2023-11-28T19:30:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug trim objects = true 2023-11-28T19:30:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: osd open classes on start = true 2023-11-28T19:30:37.778 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug pg log writeout = true 2023-11-28T19:30:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: osd deep scrub update digest min age = 30 2023-11-28T19:30:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: osd map max advance = 10 2023-11-28T19:30:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: journal zero on create = true 2023-11-28T19:30:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: filestore ondisk finisher threads = 3 2023-11-28T19:30:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: filestore apply finisher threads = 3 2023-11-28T19:30:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: bdev debug aio = true 2023-11-28T19:30:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: osd debug misdirected ops = true 2023-11-28T19:30:37.779 INFO:teuthology.orchestra.run.smithi028.stdout: bdev async discard = True 2023-11-28T19:30:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: bdev enable discard = True 2023-11-28T19:30:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore allocator = bitmap 2023-11-28T19:30:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore block size = 96636764160 2023-11-28T19:30:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: bluestore fsck on mount = True 2023-11-28T19:30:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluefs = 1/20 2023-11-28T19:30:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: debug bluestore = 1/20 2023-11-28T19:30:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-11-28T19:30:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: debug osd = 20 2023-11-28T19:30:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: debug rocksdb = 4/10 2023-11-28T19:30:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T19:30:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd full ratio = 0.9 2023-11-28T19:30:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd nearfull ratio = 0.8 2023-11-28T19:30:37.780 INFO:teuthology.orchestra.run.smithi028.stdout: osd failsafe full ratio = 0.95 2023-11-28T19:30:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: osd objectstore = bluestore 2023-11-28T19:30:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: osd op complaint time = 180 2023-11-28T19:30:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.781 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr] 2023-11-28T19:30:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-11-28T19:30:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: debug mgr = 20 2023-11-28T19:30:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2023-11-28T19:30:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2023-11-28T19:30:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2023-11-28T19:30:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2023-11-28T19:30:37.781 INFO:teuthology.orchestra.run.smithi028.stdout: mgr/telemetry/nag = false 2023-11-28T19:30:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.782 INFO:teuthology.orchestra.run.smithi028.stdout:[mon] 2023-11-28T19:30:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-11-28T19:30:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: debug mon = 20 2023-11-28T19:30:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: debug paxos = 20 2023-11-28T19:30:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: debug auth = 20 2023-11-28T19:30:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: mon data avail warn = 5 2023-11-28T19:30:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: mon mgr mkfs grace = 240 2023-11-28T19:30:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min pgs per osd = 4 2023-11-28T19:30:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd reporter subtree level = osd 2023-11-28T19:30:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: mon osd prime pg temp = true 2023-11-28T19:30:37.782 INFO:teuthology.orchestra.run.smithi028.stdout: mon reweight min bytes per osd = 10 2023-11-28T19:30:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T19:30:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T19:30:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T19:30:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T19:30:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T19:30:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T19:30:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: # 1m isn't quite enough 2023-11-28T19:30:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: mon_down_mkfs_grace = 2m 2023-11-28T19:30:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.783 INFO:teuthology.orchestra.run.smithi028.stdout: mon_warn_on_filestore_osds = false 2023-11-28T19:30:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: mon op complaint time = 120 2023-11-28T19:30:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:30:37.784 INFO:teuthology.orchestra.run.smithi028.stdout:[client] 2023-11-28T19:30:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: rgw cache enabled = true 2023-11-28T19:30:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable ops log = true 2023-11-28T19:30:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: rgw enable usage log = true 2023-11-28T19:30:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T19:30:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T19:30:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: client mount timeout = 600 2023-11-28T19:30:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: debug client = 20 2023-11-28T19:30:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-11-28T19:30:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: rados mon op timeout = 900 2023-11-28T19:30:37.784 INFO:teuthology.orchestra.run.smithi028.stdout: rados osd op timeout = 900 2023-11-28T19:30:37.785 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.a] 2023-11-28T19:30:37.785 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.b] 2023-11-28T19:30:37.785 INFO:teuthology.orchestra.run.smithi028.stdout:[mon.c] 2023-11-28T19:30:37.785 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.a] 2023-11-28T19:30:37.785 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.c] 2023-11-28T19:30:37.785 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.b] 2023-11-28T19:30:37.785 INFO:teuthology.orchestra.run.smithi028.stdout:[mds] 2023-11-28T19:30:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: debug mds = 20 2023-11-28T19:30:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: debug mds balancer = 20 2023-11-28T19:30:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: debug ms = 1 2023-11-28T19:30:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: mds debug frag = True 2023-11-28T19:30:37.785 INFO:teuthology.orchestra.run.smithi028.stdout: mds debug scatterstat = True 2023-11-28T19:30:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: mds op complaint time = 180 2023-11-28T19:30:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: mds verify scatter = True 2023-11-28T19:30:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: osd op complaint time = 180 2023-11-28T19:30:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: rados mon op timeout = 900 2023-11-28T19:30:37.786 INFO:teuthology.orchestra.run.smithi028.stdout: rados osd op timeout = 900 2023-11-28T19:30:37.787 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2023-11-28T19:30:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2023-11-28T19:30:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T19:30:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2023-11-28T19:30:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2023-11-28T19:30:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2023-11-28T19:30:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2023-11-28T19:30:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2023-11-28T19:30:37.788 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2023-11-28T19:30:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2023-11-28T19:30:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T19:30:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2023-11-28T19:30:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.789 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T19:30:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T19:30:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2023-11-28T19:30:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2023-11-28T19:30:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2023-11-28T19:30:37.790 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2023-11-28T19:30:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2023-11-28T19:30:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2023-11-28T19:30:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2023-11-28T19:30:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2023-11-28T19:30:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T19:30:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T19:30:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2023-11-28T19:30:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T19:30:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2023-11-28T19:30:37.791 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2023-11-28T19:30:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.792 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2023-11-28T19:30:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2023-11-28T19:30:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2023-11-28T19:30:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.28,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2023-11-28T19:30:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn min per osd = 0 2023-11-28T19:30:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on skipped message = False 2023-11-28T19:30:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = ae116b99-23bb-451b-9ddc-fdb049a33145 2023-11-28T19:30:37.793 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.793 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2023-11-28T19:30:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2023-11-28T19:30:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2023-11-28T19:30:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2023-11-28T19:30:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2023-11-28T19:30:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2023-11-28T19:30:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2023-11-28T19:30:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2023-11-28T19:30:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2023-11-28T19:30:37.794 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2023-11-28T19:30:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug trim objects = true 2023-11-28T19:30:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2023-11-28T19:30:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2023-11-28T19:30:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2023-11-28T19:30:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2023-11-28T19:30:37.795 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2023-11-28T19:30:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2023-11-28T19:30:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2023-11-28T19:30:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2023-11-28T19:30:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2023-11-28T19:30:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: bdev async discard = True 2023-11-28T19:30:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: bdev enable discard = True 2023-11-28T19:30:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore allocator = bitmap 2023-11-28T19:30:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2023-11-28T19:30:37.796 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2023-11-28T19:30:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 1/20 2023-11-28T19:30:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 1/20 2023-11-28T19:30:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-11-28T19:30:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2023-11-28T19:30:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 4/10 2023-11-28T19:30:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T19:30:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2023-11-28T19:30:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2023-11-28T19:30:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2023-11-28T19:30:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2023-11-28T19:30:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2023-11-28T19:30:37.797 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.798 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2023-11-28T19:30:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-11-28T19:30:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2023-11-28T19:30:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2023-11-28T19:30:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2023-11-28T19:30:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2023-11-28T19:30:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2023-11-28T19:30:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2023-11-28T19:30:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.798 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2023-11-28T19:30:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-11-28T19:30:37.798 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2023-11-28T19:30:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2023-11-28T19:30:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2023-11-28T19:30:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2023-11-28T19:30:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2023-11-28T19:30:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2023-11-28T19:30:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2023-11-28T19:30:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2023-11-28T19:30:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2023-11-28T19:30:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T19:30:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T19:30:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T19:30:37.799 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T19:30:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T19:30:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T19:30:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2023-11-28T19:30:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2023-11-28T19:30:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2023-11-28T19:30:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: mon op complaint time = 120 2023-11-28T19:30:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: 2023-11-28T19:30:37.800 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2023-11-28T19:30:37.800 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2023-11-28T19:30:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2023-11-28T19:30:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2023-11-28T19:30:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T19:30:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T19:30:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: client mount timeout = 600 2023-11-28T19:30:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2023-11-28T19:30:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-11-28T19:30:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2023-11-28T19:30:37.801 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2023-11-28T19:30:37.801 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2023-11-28T19:30:37.801 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2023-11-28T19:30:37.801 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2023-11-28T19:30:37.802 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2023-11-28T19:30:37.802 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2023-11-28T19:30:37.802 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2023-11-28T19:30:37.802 INFO:teuthology.orchestra.run.smithi131.stdout:[mds] 2023-11-28T19:30:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds = 20 2023-11-28T19:30:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds balancer = 20 2023-11-28T19:30:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2023-11-28T19:30:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug frag = True 2023-11-28T19:30:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug scatterstat = True 2023-11-28T19:30:37.802 INFO:teuthology.orchestra.run.smithi131.stdout: mds op complaint time = 180 2023-11-28T19:30:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: mds verify scatter = True 2023-11-28T19:30:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2023-11-28T19:30:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2023-11-28T19:30:37.803 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2023-11-28T19:30:37.803 INFO:teuthology.orchestra.run.smithi203.stdout:[global] 2023-11-28T19:30:37.803 INFO:teuthology.orchestra.run.smithi203.stdout: chdir = "" 2023-11-28T19:30:37.804 INFO:teuthology.orchestra.run.smithi203.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-11-28T19:30:37.804 INFO:teuthology.orchestra.run.smithi203.stdout: auth supported = cephx 2023-11-28T19:30:37.804 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.804 INFO:teuthology.orchestra.run.smithi203.stdout: filestore xattr use omap = true 2023-11-28T19:30:37.804 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.804 INFO:teuthology.orchestra.run.smithi203.stdout: mon clock drift allowed = 1.000 2023-11-28T19:30:37.804 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.804 INFO:teuthology.orchestra.run.smithi203.stdout: osd crush chooseleaf type = 0 2023-11-28T19:30:37.804 INFO:teuthology.orchestra.run.smithi203.stdout: auth debug = true 2023-11-28T19:30:37.804 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.804 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on old message = true 2023-11-28T19:30:37.804 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on bug = true 2023-11-28T19:30:37.804 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.805 INFO:teuthology.orchestra.run.smithi203.stdout: mon max pg per osd = 10000 # >= luminous 2023-11-28T19:30:37.805 INFO:teuthology.orchestra.run.smithi203.stdout: mon pg warn max object skew = 0 2023-11-28T19:30:37.805 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.805 INFO:teuthology.orchestra.run.smithi203.stdout: # disable pg_autoscaler by default for new pools 2023-11-28T19:30:37.805 INFO:teuthology.orchestra.run.smithi203.stdout: osd_pool_default_pg_autoscale_mode = off 2023-11-28T19:30:37.805 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.805 INFO:teuthology.orchestra.run.smithi203.stdout: osd pool default size = 2 2023-11-28T19:30:37.805 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.805 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd allow primary affinity = true 2023-11-28T19:30:37.805 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd allow pg remap = true 2023-11-28T19:30:37.805 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on legacy crush tunables = false 2023-11-28T19:30:37.805 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on crush straw calc version zero = false 2023-11-28T19:30:37.806 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on no sortbitwise = false 2023-11-28T19:30:37.806 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on osd down out interval zero = false 2023-11-28T19:30:37.806 INFO:teuthology.orchestra.run.smithi203.stdout: mon warn on too few osds = false 2023-11-28T19:30:37.806 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-11-28T19:30:37.806 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_pool_no_redundancy = false 2023-11-28T19:30:37.806 INFO:teuthology.orchestra.run.smithi203.stdout: mon_allow_pool_size_one = true 2023-11-28T19:30:37.806 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.806 INFO:teuthology.orchestra.run.smithi203.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-11-28T19:30:37.806 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.806 INFO:teuthology.orchestra.run.smithi203.stdout: osd default data pool replay window = 5 2023-11-28T19:30:37.806 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.807 INFO:teuthology.orchestra.run.smithi203.stdout: mon allow pool delete = true 2023-11-28T19:30:37.807 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.807 INFO:teuthology.orchestra.run.smithi203.stdout: mon cluster log file level = debug 2023-11-28T19:30:37.807 INFO:teuthology.orchestra.run.smithi203.stdout: debug asserts on shutdown = true 2023-11-28T19:30:37.807 INFO:teuthology.orchestra.run.smithi203.stdout: mon health detail to clog = false 2023-11-28T19:30:37.807 INFO:teuthology.orchestra.run.smithi203.stdout: mon host = "172.21.15.28,172.21.15.131,[v2:172.21.15.131:3301,v1:172.21.15.131:6790]" 2023-11-28T19:30:37.807 INFO:teuthology.orchestra.run.smithi203.stdout: mon pg warn min per osd = 0 2023-11-28T19:30:37.807 INFO:teuthology.orchestra.run.smithi203.stdout: ms die on skipped message = False 2023-11-28T19:30:37.807 INFO:teuthology.orchestra.run.smithi203.stdout: fsid = ae116b99-23bb-451b-9ddc-fdb049a33145 2023-11-28T19:30:37.807 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.807 INFO:teuthology.orchestra.run.smithi203.stdout:[osd] 2023-11-28T19:30:37.807 INFO:teuthology.orchestra.run.smithi203.stdout: osd journal size = 100 2023-11-28T19:30:37.807 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.808 INFO:teuthology.orchestra.run.smithi203.stdout: osd scrub load threshold = 5.0 2023-11-28T19:30:37.808 INFO:teuthology.orchestra.run.smithi203.stdout: osd scrub max interval = 600 2023-11-28T19:30:37.808 INFO:teuthology.orchestra.run.smithi203.stdout: osd mclock profile = high_recovery_ops 2023-11-28T19:30:37.808 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.808 INFO:teuthology.orchestra.run.smithi203.stdout: osd recover clone overlap = true 2023-11-28T19:30:37.808 INFO:teuthology.orchestra.run.smithi203.stdout: osd recovery max chunk = 1048576 2023-11-28T19:30:37.808 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.808 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug shutdown = true 2023-11-28T19:30:37.808 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug op order = true 2023-11-28T19:30:37.808 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug verify stray on activate = true 2023-11-28T19:30:37.808 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug trim objects = true 2023-11-28T19:30:37.808 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.809 INFO:teuthology.orchestra.run.smithi203.stdout: osd open classes on start = true 2023-11-28T19:30:37.809 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug pg log writeout = true 2023-11-28T19:30:37.809 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.809 INFO:teuthology.orchestra.run.smithi203.stdout: osd deep scrub update digest min age = 30 2023-11-28T19:30:37.809 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.809 INFO:teuthology.orchestra.run.smithi203.stdout: osd map max advance = 10 2023-11-28T19:30:37.809 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.809 INFO:teuthology.orchestra.run.smithi203.stdout: journal zero on create = true 2023-11-28T19:30:37.809 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.809 INFO:teuthology.orchestra.run.smithi203.stdout: filestore ondisk finisher threads = 3 2023-11-28T19:30:37.809 INFO:teuthology.orchestra.run.smithi203.stdout: filestore apply finisher threads = 3 2023-11-28T19:30:37.809 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.809 INFO:teuthology.orchestra.run.smithi203.stdout: bdev debug aio = true 2023-11-28T19:30:37.810 INFO:teuthology.orchestra.run.smithi203.stdout: osd debug misdirected ops = true 2023-11-28T19:30:37.810 INFO:teuthology.orchestra.run.smithi203.stdout: bdev async discard = True 2023-11-28T19:30:37.810 INFO:teuthology.orchestra.run.smithi203.stdout: bdev enable discard = True 2023-11-28T19:30:37.810 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore allocator = bitmap 2023-11-28T19:30:37.810 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore block size = 96636764160 2023-11-28T19:30:37.810 INFO:teuthology.orchestra.run.smithi203.stdout: bluestore fsck on mount = True 2023-11-28T19:30:37.810 INFO:teuthology.orchestra.run.smithi203.stdout: debug bluefs = 1/20 2023-11-28T19:30:37.810 INFO:teuthology.orchestra.run.smithi203.stdout: debug bluestore = 1/20 2023-11-28T19:30:37.810 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2023-11-28T19:30:37.810 INFO:teuthology.orchestra.run.smithi203.stdout: debug osd = 20 2023-11-28T19:30:37.810 INFO:teuthology.orchestra.run.smithi203.stdout: debug rocksdb = 4/10 2023-11-28T19:30:37.811 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd backfillfull_ratio = 0.85 2023-11-28T19:30:37.811 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd full ratio = 0.9 2023-11-28T19:30:37.811 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd nearfull ratio = 0.8 2023-11-28T19:30:37.811 INFO:teuthology.orchestra.run.smithi203.stdout: osd failsafe full ratio = 0.95 2023-11-28T19:30:37.811 INFO:teuthology.orchestra.run.smithi203.stdout: osd objectstore = bluestore 2023-11-28T19:30:37.811 INFO:teuthology.orchestra.run.smithi203.stdout: osd op complaint time = 180 2023-11-28T19:30:37.811 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.811 INFO:teuthology.orchestra.run.smithi203.stdout:[mgr] 2023-11-28T19:30:37.811 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2023-11-28T19:30:37.811 INFO:teuthology.orchestra.run.smithi203.stdout: debug mgr = 20 2023-11-28T19:30:37.811 INFO:teuthology.orchestra.run.smithi203.stdout: debug mon = 20 2023-11-28T19:30:37.811 INFO:teuthology.orchestra.run.smithi203.stdout: debug auth = 20 2023-11-28T19:30:37.811 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min pgs per osd = 4 2023-11-28T19:30:37.812 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min bytes per osd = 10 2023-11-28T19:30:37.812 INFO:teuthology.orchestra.run.smithi203.stdout: mgr/telemetry/nag = false 2023-11-28T19:30:37.812 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.812 INFO:teuthology.orchestra.run.smithi203.stdout:[mon] 2023-11-28T19:30:37.812 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2023-11-28T19:30:37.812 INFO:teuthology.orchestra.run.smithi203.stdout: debug mon = 20 2023-11-28T19:30:37.812 INFO:teuthology.orchestra.run.smithi203.stdout: debug paxos = 20 2023-11-28T19:30:37.812 INFO:teuthology.orchestra.run.smithi203.stdout: debug auth = 20 2023-11-28T19:30:37.812 INFO:teuthology.orchestra.run.smithi203.stdout: mon data avail warn = 5 2023-11-28T19:30:37.812 INFO:teuthology.orchestra.run.smithi203.stdout: mon mgr mkfs grace = 240 2023-11-28T19:30:37.812 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min pgs per osd = 4 2023-11-28T19:30:37.812 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd reporter subtree level = osd 2023-11-28T19:30:37.813 INFO:teuthology.orchestra.run.smithi203.stdout: mon osd prime pg temp = true 2023-11-28T19:30:37.813 INFO:teuthology.orchestra.run.smithi203.stdout: mon reweight min bytes per osd = 10 2023-11-28T19:30:37.813 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.813 INFO:teuthology.orchestra.run.smithi203.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-11-28T19:30:37.813 INFO:teuthology.orchestra.run.smithi203.stdout: auth mon ticket ttl = 660 # 11m 2023-11-28T19:30:37.813 INFO:teuthology.orchestra.run.smithi203.stdout: auth service ticket ttl = 240 # 4m 2023-11-28T19:30:37.813 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.813 INFO:teuthology.orchestra.run.smithi203.stdout: # don't complain about insecure global_id in the test suite 2023-11-28T19:30:37.813 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-11-28T19:30:37.813 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-11-28T19:30:37.813 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.813 INFO:teuthology.orchestra.run.smithi203.stdout: # 1m isn't quite enough 2023-11-28T19:30:37.813 INFO:teuthology.orchestra.run.smithi203.stdout: mon_down_mkfs_grace = 2m 2023-11-28T19:30:37.814 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.814 INFO:teuthology.orchestra.run.smithi203.stdout: mon_warn_on_filestore_osds = false 2023-11-28T19:30:37.814 INFO:teuthology.orchestra.run.smithi203.stdout: mon op complaint time = 120 2023-11-28T19:30:37.814 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:30:37.814 INFO:teuthology.orchestra.run.smithi203.stdout:[client] 2023-11-28T19:30:37.814 INFO:teuthology.orchestra.run.smithi203.stdout: rgw cache enabled = true 2023-11-28T19:30:37.814 INFO:teuthology.orchestra.run.smithi203.stdout: rgw enable ops log = true 2023-11-28T19:30:37.814 INFO:teuthology.orchestra.run.smithi203.stdout: rgw enable usage log = true 2023-11-28T19:30:37.814 INFO:teuthology.orchestra.run.smithi203.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-11-28T19:30:37.814 INFO:teuthology.orchestra.run.smithi203.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-11-28T19:30:37.814 INFO:teuthology.orchestra.run.smithi203.stdout: client mount timeout = 600 2023-11-28T19:30:37.814 INFO:teuthology.orchestra.run.smithi203.stdout: debug client = 20 2023-11-28T19:30:37.814 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2023-11-28T19:30:37.814 INFO:teuthology.orchestra.run.smithi203.stdout: rados mon op timeout = 900 2023-11-28T19:30:37.815 INFO:teuthology.orchestra.run.smithi203.stdout: rados osd op timeout = 900 2023-11-28T19:30:37.815 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.a] 2023-11-28T19:30:37.815 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.b] 2023-11-28T19:30:37.815 INFO:teuthology.orchestra.run.smithi203.stdout:[mon.c] 2023-11-28T19:30:37.815 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.a] 2023-11-28T19:30:37.815 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.c] 2023-11-28T19:30:37.815 INFO:teuthology.orchestra.run.smithi203.stdout:[mds.b] 2023-11-28T19:30:37.815 INFO:teuthology.orchestra.run.smithi203.stdout:[mds] 2023-11-28T19:30:37.815 INFO:teuthology.orchestra.run.smithi203.stdout: debug mds = 20 2023-11-28T19:30:37.815 INFO:teuthology.orchestra.run.smithi203.stdout: debug mds balancer = 20 2023-11-28T19:30:37.816 INFO:teuthology.orchestra.run.smithi203.stdout: debug ms = 1 2023-11-28T19:30:37.816 INFO:teuthology.orchestra.run.smithi203.stdout: mds debug frag = True 2023-11-28T19:30:37.816 INFO:teuthology.orchestra.run.smithi203.stdout: mds debug scatterstat = True 2023-11-28T19:30:37.816 INFO:teuthology.orchestra.run.smithi203.stdout: mds op complaint time = 180 2023-11-28T19:30:37.816 INFO:teuthology.orchestra.run.smithi203.stdout: mds verify scatter = True 2023-11-28T19:30:37.816 INFO:teuthology.orchestra.run.smithi203.stdout: osd op complaint time = 180 2023-11-28T19:30:37.816 INFO:teuthology.orchestra.run.smithi203.stdout: rados mon op timeout = 900 2023-11-28T19:30:37.816 INFO:teuthology.orchestra.run.smithi203.stdout: rados osd op timeout = 900 2023-11-28T19:30:37.817 INFO:tasks.ceph:Creating admin key on mon.a... 2023-11-28T19:30:37.817 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-11-28T19:30:37.876 INFO:tasks.ceph:Copying monmap to all nodes... 2023-11-28T19:30:37.876 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:30:37.876 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-11-28T19:30:37.881 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:30:37.881 DEBUG:teuthology.orchestra.run.smithi028:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-11-28T19:30:37.932 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi028.front.sepia.ceph.com 2023-11-28T19:30:37.932 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:30:37.932 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T19:30:37.932 DEBUG:teuthology.orchestra.run.smithi028:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T19:30:38.001 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:30:38.001 DEBUG:teuthology.orchestra.run.smithi028:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:30:38.048 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2023-11-28T19:30:38.048 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:30:38.048 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T19:30:38.048 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T19:30:38.071 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:30:38.071 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:30:38.119 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi203.front.sepia.ceph.com 2023-11-28T19:30:38.119 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:30:38.119 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.keyring 2023-11-28T19:30:38.119 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-11-28T19:30:38.154 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:30:38.154 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:30:38.206 INFO:tasks.ceph:Setting up mon nodes... 2023-11-28T19:30:38.206 INFO:tasks.ceph:Setting up mgr nodes... 2023-11-28T19:30:38.206 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T19:30:38.250 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-11-28T19:30:38.254 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T19:30:38.297 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-11-28T19:30:38.311 INFO:tasks.ceph:Setting up mds nodes... 2023-11-28T19:30:38.311 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T19:30:38.354 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-11-28T19:30:38.356 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-11-28T19:30:38.412 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T19:30:38.497 INFO:teuthology.orchestra.run.smithi028.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-11-28T19:30:38.500 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-11-28T19:30:38.560 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T19:30:38.605 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-11-28T19:30:38.608 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-11-28T19:30:38.662 INFO:tasks.ceph_client:Setting up client nodes... 2023-11-28T19:30:38.662 DEBUG:teuthology.orchestra.run.smithi203:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-11-28T19:30:38.709 INFO:teuthology.orchestra.run.smithi203.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-11-28T19:30:38.744 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-11-28T19:30:38.745 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi028.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-11-28T19:30:38.745 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-11-28T19:30:38.759 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T19:30:38.759 INFO:tasks.ceph:role: osd.0 2023-11-28T19:30:38.759 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com 2023-11-28T19:30:38.759 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T19:30:38.816 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:30:38.816 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:30:38.816 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:30:38.816 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:30:38.816 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:30:38.816 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:30:38.817 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:30:38.817 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:30:38.817 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:30:38.817 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:30:38.841 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2023-11-28T19:30:38.844 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2023-11-28T19:30:38.844 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-11-28T19:30:38.904 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-11-28T19:30:38.960 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:30:38.960 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:30:38.961 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-11-28T19:30:39.018 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T19:30:39.018 INFO:tasks.ceph:role: osd.1 2023-11-28T19:30:39.018 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi028.front.sepia.ceph.com 2023-11-28T19:30:39.019 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T19:30:39.071 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:30:39.071 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:30:39.071 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:30:39.071 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:30:39.071 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:30:39.071 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:30:39.071 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:30:39.072 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:30:39.072 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:30:39.072 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:30:39.095 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2023-11-28T19:30:39.096 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2023-11-28T19:30:39.096 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-11-28T19:30:39.161 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-11-28T19:30:39.213 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:30:39.213 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:30:39.214 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-11-28T19:30:39.268 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T19:30:39.268 INFO:tasks.ceph:role: osd.2 2023-11-28T19:30:39.268 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi028.front.sepia.ceph.com 2023-11-28T19:30:39.268 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T19:30:39.323 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:30:39.324 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:30:39.324 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:30:39.324 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:30:39.324 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:30:39.324 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:30:39.324 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:30:39.324 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:30:39.324 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:30:39.324 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:30:39.347 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2023-11-28T19:30:39.348 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2023-11-28T19:30:39.349 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-11-28T19:30:39.411 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-11-28T19:30:39.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:30:39.468 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:30:39.469 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-11-28T19:30:39.521 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-11-28T19:30:39.521 INFO:tasks.ceph:role: osd.3 2023-11-28T19:30:39.521 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi028.front.sepia.ceph.com 2023-11-28T19:30:39.521 DEBUG:teuthology.orchestra.run.smithi028:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T19:30:39.575 INFO:teuthology.orchestra.run.smithi028.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:30:39.575 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:30:39.575 INFO:teuthology.orchestra.run.smithi028.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:30:39.575 INFO:teuthology.orchestra.run.smithi028.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:30:39.575 INFO:teuthology.orchestra.run.smithi028.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:30:39.575 INFO:teuthology.orchestra.run.smithi028.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:30:39.576 INFO:teuthology.orchestra.run.smithi028.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:30:39.576 INFO:teuthology.orchestra.run.smithi028.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:30:39.576 INFO:teuthology.orchestra.run.smithi028.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:30:39.576 INFO:teuthology.orchestra.run.smithi028.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:30:39.599 INFO:teuthology.orchestra.run.smithi028.stdout:Discarding blocks...Done. 2023-11-28T19:30:39.601 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi028.front.sepia.ceph.com -o noatime 2023-11-28T19:30:39.602 DEBUG:teuthology.orchestra.run.smithi028:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-11-28T19:30:39.658 DEBUG:teuthology.orchestra.run.smithi028:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-11-28T19:30:39.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:30:39.711 INFO:teuthology.orchestra.run.smithi028.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:30:39.711 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:30:39.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:39.819+0000 7f5b9c6ee640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-11-28T19:30:39.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:39.819+0000 7f5b9c6ee640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-11-28T19:30:39.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:39.819+0000 7f5b9c6ee640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T19:30:39.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:39.819+0000 7f5b9c6ee640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T19:30:39.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:39.819+0000 7f5b9c6ee640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-11-28T19:30:39.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:39.819+0000 7f5b9c6ee640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-11-28T19:30:42.847 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-11-28T19:30:42.862 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:30:42.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:42.943+0000 7f677a623640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-11-28T19:30:42.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:42.943+0000 7f677a623640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-11-28T19:30:42.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:42.943+0000 7f677a623640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T19:30:42.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:42.943+0000 7f677a623640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T19:30:42.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:42.943+0000 7f677a623640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-11-28T19:30:42.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:42.943+0000 7f677a623640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-11-28T19:30:45.951 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-11-28T19:30:46.012 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:30:46.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:46.095+0000 7f58691dc640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-11-28T19:30:46.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:46.095+0000 7f58691dc640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-11-28T19:30:46.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:46.095+0000 7f58691dc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T19:30:46.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:46.095+0000 7f58691dc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T19:30:46.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:46.095+0000 7f58691dc640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-11-28T19:30:46.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:46.095+0000 7f58691dc640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-11-28T19:30:49.105 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-11-28T19:30:49.161 DEBUG:teuthology.orchestra.run.smithi028:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:30:49.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:49.242+0000 7f70332a1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-11-28T19:30:49.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:49.242+0000 7f70332a1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-11-28T19:30:49.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:49.242+0000 7f70332a1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T19:30:49.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:49.242+0000 7f70332a1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T19:30:49.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:49.242+0000 7f70332a1640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-11-28T19:30:49.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:30:49.242+0000 7f70332a1640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-11-28T19:30:52.245 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-11-28T19:30:52.302 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-11-28T19:30:52.316 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T19:30:52.317 INFO:tasks.ceph:role: osd.4 2023-11-28T19:30:52.317 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com 2023-11-28T19:30:52.317 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-11-28T19:30:52.379 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:30:52.380 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:30:52.380 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:30:52.380 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:30:52.380 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:30:52.380 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:30:52.381 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:30:52.381 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:30:52.381 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:30:52.381 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:30:52.833 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-11-28T19:30:52.835 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-11-28T19:30:52.835 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-11-28T19:30:52.931 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-11-28T19:30:52.942 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:30:52.942 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:30:52.943 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-11-28T19:30:52.998 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T19:30:52.998 INFO:tasks.ceph:role: osd.5 2023-11-28T19:30:52.998 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com 2023-11-28T19:30:52.998 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-11-28T19:30:53.063 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:30:53.063 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:30:53.063 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:30:53.063 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:30:53.063 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:30:53.063 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:30:53.064 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:30:53.064 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:30:53.064 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:30:53.064 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:30:53.528 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-11-28T19:30:53.530 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-11-28T19:30:53.530 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-11-28T19:30:53.672 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-11-28T19:30:53.684 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:30:53.684 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:30:53.684 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-11-28T19:30:53.738 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T19:30:53.738 INFO:tasks.ceph:role: osd.6 2023-11-28T19:30:53.739 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com 2023-11-28T19:30:53.739 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-11-28T19:30:53.804 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:30:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:30:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:30:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:30:53.804 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:30:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:30:53.804 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:30:53.804 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:30:53.804 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:30:53.804 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:30:54.298 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-11-28T19:30:54.300 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-11-28T19:30:54.300 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-11-28T19:30:54.467 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-11-28T19:30:54.477 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:30:54.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:30:54.479 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-11-28T19:30:54.534 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-11-28T19:30:54.534 INFO:tasks.ceph:role: osd.7 2023-11-28T19:30:54.534 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com 2023-11-28T19:30:54.535 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-11-28T19:30:54.598 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-11-28T19:30:54.599 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2023-11-28T19:30:54.599 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-11-28T19:30:54.599 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-11-28T19:30:54.599 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-11-28T19:30:54.599 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2023-11-28T19:30:54.599 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-11-28T19:30:54.599 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-11-28T19:30:54.599 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-11-28T19:30:54.599 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-11-28T19:30:55.034 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2023-11-28T19:30:55.036 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2023-11-28T19:30:55.036 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-11-28T19:30:55.131 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-11-28T19:30:55.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:30:55.143 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: /sbin/restorecon: command not found 2023-11-28T19:30:55.143 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:30:55.250 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:30:55.249+0000 7f989a481640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-11-28T19:30:55.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:30:55.253+0000 7f989a481640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-11-28T19:30:55.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:30:55.253+0000 7f989a481640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T19:30:55.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:30:55.253+0000 7f989a481640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T19:30:55.254 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:30:55.253+0000 7f989a481640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-11-28T19:30:55.255 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:30:55.257+0000 7f989a481640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-11-28T19:30:58.261 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-11-28T19:30:58.276 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:30:58.361 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:30:58.361+0000 7fb1604b1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-11-28T19:30:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:30:58.361+0000 7fb1604b1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-11-28T19:30:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:30:58.361+0000 7fb1604b1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T19:30:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:30:58.361+0000 7fb1604b1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T19:30:58.362 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:30:58.361+0000 7fb1604b1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-11-28T19:30:58.363 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:30:58.365+0000 7fb1604b1640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-11-28T19:31:00.721 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:31:00.724 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:31:00.726 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:31:01.404 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-11-28T19:31:01.418 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:31:01.498 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:01.496+0000 7f44344c9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-11-28T19:31:01.499 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:01.496+0000 7f44344c9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-11-28T19:31:01.499 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:01.496+0000 7f44344c9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T19:31:01.499 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:01.496+0000 7f44344c9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T19:31:01.499 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:01.496+0000 7f44344c9640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-11-28T19:31:01.499 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:01.500+0000 7f44344c9640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-11-28T19:31:04.504 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-11-28T19:31:04.562 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:31:04.644 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:04.644+0000 7f325977b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-11-28T19:31:04.644 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:04.644+0000 7f325977b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-11-28T19:31:04.645 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:04.644+0000 7f325977b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T19:31:04.645 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:04.644+0000 7f325977b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T19:31:04.645 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:04.644+0000 7f325977b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-11-28T19:31:04.645 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:04.644+0000 7f325977b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-11-28T19:31:07.648 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-11-28T19:31:07.705 INFO:tasks.ceph:Reading keys from all nodes... 2023-11-28T19:31:07.706 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:31:07.706 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-11-28T19:31:07.722 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:31:07.723 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-11-28T19:31:07.776 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:31:07.776 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-11-28T19:31:07.836 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:31:07.836 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-11-28T19:31:07.892 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:31:07.892 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-11-28T19:31:07.949 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:31:07.949 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-11-28T19:31:08.004 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:31:08.004 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-11-28T19:31:08.060 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:31:08.061 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-11-28T19:31:08.073 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:31:08.074 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-11-28T19:31:08.132 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:31:08.132 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-11-28T19:31:08.188 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:31:08.188 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-11-28T19:31:08.243 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:31:08.243 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-11-28T19:31:08.298 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:31:08.298 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-11-28T19:31:08.352 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:31:08.352 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-11-28T19:31:08.362 INFO:tasks.ceph:Adding keys to all mons... 2023-11-28T19:31:08.362 DEBUG:teuthology.orchestra.run.smithi028:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T19:31:08.364 DEBUG:teuthology.orchestra.run.smithi131:> sudo tee -a /etc/ceph/ceph.keyring 2023-11-28T19:31:08.400 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr.y] 2023-11-28T19:31:08.400 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDeP2ZlKHQhDxAALbbcyw6L6kA8hZsdTtQdbA== 2023-11-28T19:31:08.400 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.a] 2023-11-28T19:31:08.401 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDeP2Zl591MFRAAOxOhZuLA1NWAR1I4Jeiz+Q== 2023-11-28T19:31:08.401 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.c] 2023-11-28T19:31:08.401 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDeP2ZlzfDbHRAAUO+9EmfsNrmSy/+yDI3h/A== 2023-11-28T19:31:08.401 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.0] 2023-11-28T19:31:08.401 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDfP2ZlaWg3MRAAB4RX7CAUPIKnqAOx2vr4Gg== 2023-11-28T19:31:08.401 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.1] 2023-11-28T19:31:08.401 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDiP2ZlzJN0OBAAmk4xsoHz7AYAvBpWR4XMCg== 2023-11-28T19:31:08.401 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.2] 2023-11-28T19:31:08.401 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDmP2ZlQz4PBhAAUalDxk0dgsUmTx3lpNymvw== 2023-11-28T19:31:08.401 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.3] 2023-11-28T19:31:08.402 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDpP2ZleTDGDhAAzMBYQFMyN575crG+dGjWlQ== 2023-11-28T19:31:08.402 INFO:teuthology.orchestra.run.smithi028.stdout:[mgr.x] 2023-11-28T19:31:08.402 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDeP2Zlqr/bERAA+VjORirozyy7qNdSyPcd4g== 2023-11-28T19:31:08.402 INFO:teuthology.orchestra.run.smithi028.stdout:[mds.b] 2023-11-28T19:31:08.402 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDeP2ZlwUpAJBAAtz4e+4IvKfM5l3iPSuDFZQ== 2023-11-28T19:31:08.402 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.4] 2023-11-28T19:31:08.402 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDvP2Zl3goPDxAAf2xEgXaChvM3GLz4SKtGLA== 2023-11-28T19:31:08.403 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.5] 2023-11-28T19:31:08.403 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDyP2ZlGFC3FRAA4AH5bUxN4axp+Jn1YDBRCA== 2023-11-28T19:31:08.403 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.6] 2023-11-28T19:31:08.403 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQD1P2ZlgQnWHRAA1/JtVkEyhJxTgbKAyn+LRQ== 2023-11-28T19:31:08.403 INFO:teuthology.orchestra.run.smithi028.stdout:[osd.7] 2023-11-28T19:31:08.403 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQD4P2Zl4BGCJhAAsH+BFvLtCaecx2MnpxgAJA== 2023-11-28T19:31:08.403 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2023-11-28T19:31:08.403 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDeP2ZlIJB6KhAAD1X87Jdr4Z4RDtIDK8BvXg== 2023-11-28T19:31:08.405 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.y] 2023-11-28T19:31:08.405 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDeP2ZlKHQhDxAALbbcyw6L6kA8hZsdTtQdbA== 2023-11-28T19:31:08.405 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2023-11-28T19:31:08.405 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDeP2Zl591MFRAAOxOhZuLA1NWAR1I4Jeiz+Q== 2023-11-28T19:31:08.405 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2023-11-28T19:31:08.405 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDeP2ZlzfDbHRAAUO+9EmfsNrmSy/+yDI3h/A== 2023-11-28T19:31:08.405 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.0] 2023-11-28T19:31:08.406 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDfP2ZlaWg3MRAAB4RX7CAUPIKnqAOx2vr4Gg== 2023-11-28T19:31:08.406 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.1] 2023-11-28T19:31:08.406 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDiP2ZlzJN0OBAAmk4xsoHz7AYAvBpWR4XMCg== 2023-11-28T19:31:08.406 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.2] 2023-11-28T19:31:08.406 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDmP2ZlQz4PBhAAUalDxk0dgsUmTx3lpNymvw== 2023-11-28T19:31:08.406 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.3] 2023-11-28T19:31:08.406 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDpP2ZleTDGDhAAzMBYQFMyN575crG+dGjWlQ== 2023-11-28T19:31:08.406 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.x] 2023-11-28T19:31:08.407 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDeP2Zlqr/bERAA+VjORirozyy7qNdSyPcd4g== 2023-11-28T19:31:08.407 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2023-11-28T19:31:08.407 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDeP2ZlwUpAJBAAtz4e+4IvKfM5l3iPSuDFZQ== 2023-11-28T19:31:08.407 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.4] 2023-11-28T19:31:08.407 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDvP2Zl3goPDxAAf2xEgXaChvM3GLz4SKtGLA== 2023-11-28T19:31:08.407 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.5] 2023-11-28T19:31:08.407 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDyP2ZlGFC3FRAA4AH5bUxN4axp+Jn1YDBRCA== 2023-11-28T19:31:08.407 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.6] 2023-11-28T19:31:08.407 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQD1P2ZlgQnWHRAA1/JtVkEyhJxTgbKAyn+LRQ== 2023-11-28T19:31:08.407 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.7] 2023-11-28T19:31:08.408 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQD4P2Zl4BGCJhAAsH+BFvLtCaecx2MnpxgAJA== 2023-11-28T19:31:08.408 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2023-11-28T19:31:08.408 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDeP2ZlIJB6KhAAD1X87Jdr4Z4RDtIDK8BvXg== 2023-11-28T19:31:08.409 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T19:31:08.450 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T19:31:08.496 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T19:31:08.499 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T19:31:08.544 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T19:31:08.546 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T19:31:08.633 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:08.636 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:08.676 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:08.722 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:08.764 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:08.810 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:08.855 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:08.857 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:08.939 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T19:31:08.942 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-11-28T19:31:09.023 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T19:31:09.025 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-11-28T19:31:09.115 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:09.117 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:09.161 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:09.163 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:09.246 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:09.249 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:09.330 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:09.333 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-11-28T19:31:09.416 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T19:31:09.422 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-11-28T19:31:09.506 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-11-28T19:31:09.506 DEBUG:teuthology.orchestra.run.smithi028:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-11-28T19:31:09.518 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T19:31:09.613 DEBUG:teuthology.orchestra.run.smithi028:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-11-28T19:31:09.625 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-11-28T19:31:09.639 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T19:31:09.742 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-11-28T19:31:09.755 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-11-28T19:31:09.805 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-11-28T19:31:09.897 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-11-28T19:31:09.908 DEBUG:teuthology.orchestra.run.smithi028:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:31:09.910 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-11-28T19:31:09.957 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-11-28T19:31:09.958 INFO:tasks.ceph.mon.a:Restarting daemon 2023-11-28T19:31:09.958 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-11-28T19:31:09.960 INFO:tasks.ceph.mon.a:Started 2023-11-28T19:31:09.960 INFO:tasks.ceph.mon.b:Restarting daemon 2023-11-28T19:31:09.961 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-11-28T19:31:10.001 INFO:tasks.ceph.mon.b:Started 2023-11-28T19:31:10.001 INFO:tasks.ceph.mon.c:Restarting daemon 2023-11-28T19:31:10.001 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-11-28T19:31:10.004 INFO:tasks.ceph.mon.c:Started 2023-11-28T19:31:10.004 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-11-28T19:31:10.004 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-11-28T19:31:10.005 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-11-28T19:31:10.007 INFO:tasks.ceph.mgr.y:Started 2023-11-28T19:31:10.007 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-11-28T19:31:10.007 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-11-28T19:31:10.010 INFO:tasks.ceph.mgr.x:Started 2023-11-28T19:31:10.010 INFO:tasks.ceph:Setting crush tunables to default 2023-11-28T19:31:10.010 DEBUG:teuthology.orchestra.run.smithi028:> sudo ceph --cluster ceph osd crush tunables default 2023-11-28T19:31:10.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.125+0000 7f0ac2f52640 1 Processor -- start 2023-11-28T19:31:10.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.125+0000 7f0ac2f52640 1 -- start start 2023-11-28T19:31:10.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.125+0000 7f0ac2f52640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:10.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.125+0000 7f0ac2f52640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc0bce60 con 0x7f0abc0bbad0 2023-11-28T19:31:10.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.125+0000 7f0ac2f52640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc0a6b70 con 0x7f0abc06af40 2023-11-28T19:31:10.127 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.125+0000 7f0ac2f52640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0abc0bd5d0 con 0x7f0abc06ab60 2023-11-28T19:31:10.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.125+0000 7f0ac0cee640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:10.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.125+0000 7f0abbfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0abc0bbad0 0x7f0abc0a6040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:43416/0 (socket says 172.21.15.28:43416) 2023-11-28T19:31:10.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.125+0000 7f0ac0cee640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:42706/0 (socket says 172.21.15.28:42706) 2023-11-28T19:31:10.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.125+0000 7f0abbfff640 1 -- 172.21.15.28:0/3351528400 learned_addr learned my addr 172.21.15.28:0/3351528400 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:10.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.125+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 msgr2=0x7f0abc14b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T19:31:10.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.125+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 msgr2=0x7f0abc14b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:10.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.125+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:10.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.125+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T19:31:10.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.329+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:10.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.329+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 msgr2=0x7f0abc14b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T19:31:10.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.329+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 msgr2=0x7f0abc14b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:10.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.329+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:10.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.329+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T19:31:10.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.733+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:10.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.733+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 msgr2=0x7f0abc14b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T19:31:10.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.733+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 msgr2=0x7f0abc14b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:10.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.733+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:10.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:10.733+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T19:31:11.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:11.536+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:11.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:11.536+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 msgr2=0x7f0abc14b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T19:31:11.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:11.536+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 msgr2=0x7f0abc14b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:11.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:11.536+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:11.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:11.536+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T19:31:13.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 msgr2=0x7f0abc14b5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T19:31:13.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0aba7fc640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0abc06ab60 0x7f0abc14b5f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:13.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 >> v1:172.21.15.131:6789/0 conn(0x7f0abc06af40 legacy=0x7f0abc155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:13.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 >> v1:172.21.15.28:6789/0 conn(0x7f0abc0bbad0 legacy=0x7f0abc0a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:13.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0aba7fc640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:13.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0aba7fc640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 0x7f0aa8008650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:13.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0abc0bd5d0 con 0x7f0aa80036f0 2023-11-28T19:31:13.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa8008d70 con 0x7f0aa80061b0 2023-11-28T19:31:13.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:13.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0abbfff640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 0x7f0aa8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:13.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T19:31:13.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:13.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:13.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T19:31:13.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0abbfff640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 msgr2=0x7f0aa8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T19:31:13.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0abbfff640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 msgr2=0x7f0aa8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:13.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0abbfff640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 0x7f0aa8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:13.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.124+0000 7f0abbfff640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 0x7f0aa8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T19:31:13.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.328+0000 7f0abbfff640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 0x7f0aa8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:13.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.328+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:13.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.328+0000 7f0abbfff640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 msgr2=0x7f0aa8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T19:31:13.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.328+0000 7f0abbfff640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 msgr2=0x7f0aa8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:13.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.328+0000 7f0abbfff640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 0x7f0aa8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:13.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.328+0000 7f0abbfff640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 0x7f0aa8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T19:31:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.328+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T19:31:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.328+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.328+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:13.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.328+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T19:31:13.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.732+0000 7f0abbfff640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 0x7f0aa8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:13.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.732+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:13.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.732+0000 7f0abbfff640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 msgr2=0x7f0aa8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T19:31:13.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.732+0000 7f0abbfff640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 msgr2=0x7f0aa8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:13.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.732+0000 7f0abbfff640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 0x7f0aa8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:13.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.732+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T19:31:13.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.732+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:13.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.732+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:13.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.732+0000 7f0abbfff640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 0x7f0aa8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T19:31:13.736 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:13.732+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T19:31:14.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:14.536+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:14.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:14.536+0000 7f0abbfff640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 0x7f0aa8008650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:14.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:14.536+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T19:31:14.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:14.536+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:14.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:14.536+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:14.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:14.536+0000 7f0abbfff640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 msgr2=0x7f0aa8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-11-28T19:31:14.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:14.536+0000 7f0abbfff640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 msgr2=0x7f0aa8008650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:14.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:14.536+0000 7f0abbfff640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 0x7f0aa8008650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:14.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:14.536+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T19:31:14.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:14.536+0000 7f0abbfff640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 0x7f0aa8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T19:31:16.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 msgr2=0x7f0aa8008650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T19:31:16.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0aba7fc640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa80061b0 0x7f0aa8008650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:16.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T19:31:16.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0aba7fc640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:16.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0ac14ef640 1 -- 172.21.15.28:0/3351528400 reap_dead start 2023-11-28T19:31:16.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0aba7fc640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:16.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0aba7fc640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 0x7f0aa800c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:16.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0abc0bff70 con 0x7f0abc0bbad0 2023-11-28T19:31:16.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0abc0bd5d0 con 0x7f0aa8006640 2023-11-28T19:31:16.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa8008d70 con 0x7f0aa80036f0 2023-11-28T19:31:16.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0ac14ef640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 0x7f0aa800c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:16.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:16.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0ac14ef640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 msgr2=0x7f0aa800c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T19:31:16.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0ac14ef640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 msgr2=0x7f0aa800c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:16.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0ac14ef640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 0x7f0aa800c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:16.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T19:31:16.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:16.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:16.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0ac14ef640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 0x7f0aa800c900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T19:31:16.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.124+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T19:31:16.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.328+0000 7f0ac14ef640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 0x7f0aa800c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:16.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.328+0000 7f0ac14ef640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 msgr2=0x7f0aa800c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T19:31:16.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.328+0000 7f0ac14ef640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 msgr2=0x7f0aa800c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:16.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.328+0000 7f0ac14ef640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 0x7f0aa800c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:16.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.328+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:16.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.328+0000 7f0ac14ef640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 0x7f0aa800c900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T19:31:16.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.328+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T19:31:16.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.328+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:16.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.328+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:16.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.328+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T19:31:16.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.732+0000 7f0ac14ef640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 0x7f0aa800c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:16.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.732+0000 7f0ac14ef640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 msgr2=0x7f0aa800c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T19:31:16.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.732+0000 7f0ac14ef640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 msgr2=0x7f0aa800c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:16.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.732+0000 7f0ac14ef640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 0x7f0aa800c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:16.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.732+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:16.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.732+0000 7f0ac14ef640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 0x7f0aa800c900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T19:31:16.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.732+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T19:31:16.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.732+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:16.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.732+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:16.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:16.732+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T19:31:17.537 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:17.536+0000 7f0ac14ef640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 0x7f0aa800c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:17.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:17.536+0000 7f0ac14ef640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 msgr2=0x7f0aa800c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T19:31:17.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:17.536+0000 7f0ac14ef640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 msgr2=0x7f0aa800c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:17.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:17.536+0000 7f0ac14ef640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 0x7f0aa800c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:17.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:17.536+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:17.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:17.536+0000 7f0ac14ef640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 0x7f0aa800c900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T19:31:17.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:17.536+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-11-28T19:31:17.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:17.536+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:17.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:17.536+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:17.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:17.536+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-11-28T19:31:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 msgr2=0x7f0aa8005b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T19:31:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.124+0000 7f0aba7fc640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.131:3300/0 conn(0x7f0aa80036f0 0x7f0aa8005b10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 msgr2=0x7f0aa800c900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T19:31:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.124+0000 7f0aba7fc640 1 --2- 172.21.15.28:0/3351528400 >> v2:172.21.15.28:3300/0 conn(0x7f0aa8006640 0x7f0aa800c900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 >> v1:172.21.15.28:6789/0 conn(0x7f0abc0bbad0 legacy=0x7f0aa800b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.124+0000 7f0aba7fc640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 0x7f0aa800d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa800df10 con 0x7f0aa800dae0 2023-11-28T19:31:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.124+0000 7f0aba7fc640 1 -- 172.21.15.28:0/3351528400 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0bd5d0 con 0x7f0aa800cff0 2023-11-28T19:31:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.124+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 0x7f0aa800d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.128+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 msgr2=0x7f0aa800d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T19:31:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.128+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 msgr2=0x7f0aa800d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.128+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 0x7f0aa800d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.128+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 0x7f0aa800d3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-11-28T19:31:19.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.332+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 0x7f0aa800d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:19.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.332+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 msgr2=0x7f0aa800d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T19:31:19.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.332+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 msgr2=0x7f0aa800d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:19.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.332+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 0x7f0aa800d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:19.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.332+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 0x7f0aa800d3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-11-28T19:31:19.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.736+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 0x7f0aa800d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:19.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.736+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 msgr2=0x7f0aa800d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-11-28T19:31:19.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.736+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 msgr2=0x7f0aa800d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-11-28T19:31:19.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.736+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 0x7f0aa800d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-11-28T19:31:19.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:19.736+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 0x7f0aa800d3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-11-28T19:31:20.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.412+0000 7f0abb7fe640 1 -- 172.21.15.28:0/3351528400 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302820655 0 0) 0x7f0aa800df10 con 0x7f0aa800dae0 2023-11-28T19:31:20.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.412+0000 7f0abb7fe640 1 -- 172.21.15.28:0/3351528400 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0aa4003530 con 0x7f0aa800dae0 2023-11-28T19:31:20.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0abb7fe640 1 -- 172.21.15.28:0/3351528400 <== mon.1 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4136184797 0 0) 0x7f0aa4003530 con 0x7f0aa800dae0 2023-11-28T19:31:20.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0abb7fe640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 msgr2=0x7f0aa800d3d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T19:31:20.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0abb7fe640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa800cff0 0x7f0aa800d3d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:20.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0abb7fe640 1 -- 172.21.15.28:0/3351528400 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa8014a70 con 0x7f0aa800dae0 2023-11-28T19:31:20.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0abb7fe640 1 -- 172.21.15.28:0/3351528400 <== mon.1 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f0ab0007ea0 con 0x7f0aa800dae0 2023-11-28T19:31:20.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0abb7fe640 1 -- 172.21.15.28:0/3351528400 >> v1:172.21.15.131:6789/0 conn(0x7f0aa800dae0 legacy=0x7f0aa8012150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:20.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0ac14ef640 1 -- 172.21.15.28:0/3351528400 reap_dead start 2023-11-28T19:31:20.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0abb7fe640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa4003980 0x7f0aa4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:20.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0abb7fe640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aa40047d0 0x7f0aa4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:20.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0abb7fe640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40052b0 0x7f0aa400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:20.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0abb7fe640 1 -- 172.21.15.28:0/3351528400 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0bd5d0 con 0x7f0aa4003980 2023-11-28T19:31:20.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0abb7fe640 1 -- 172.21.15.28:0/3351528400 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa400c160 con 0x7f0aa40047d0 2023-11-28T19:31:20.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0abb7fe640 1 -- 172.21.15.28:0/3351528400 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa400c320 con 0x7f0aa40052b0 2023-11-28T19:31:20.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa4003980 0x7f0aa4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:20.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0ac14ef640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40052b0 0x7f0aa400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:20.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0abbfff640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aa40047d0 0x7f0aa4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:20.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40052b0 msgr2=0x7f0aa400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:20.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40052b0 0x7f0aa400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:20.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aa40047d0 msgr2=0x7f0aa4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:20.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aa40047d0 0x7f0aa4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:20.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.420+0000 7f0ac0cee640 1 -- 172.21.15.28:0/3351528400 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa4003530 con 0x7f0aa4003980 2023-11-28T19:31:20.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.428+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa4003980 0x7f0aa4003d80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000ee0 tx=0x7f0aac009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b6568240fc8ec1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:20.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.428+0000 7f0abb7fe640 1 -- 172.21.15.28:0/3351528400 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0a7bd0 con 0x7f0aa4003980 2023-11-28T19:31:20.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.428+0000 7f0abb7fe640 1 -- 172.21.15.28:0/3351528400 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac01e040 con 0x7f0aa4003980 2023-11-28T19:31:20.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.428+0000 7f0abb7fe640 1 -- 172.21.15.28:0/3351528400 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0af440 con 0x7f0aa4003980 2023-11-28T19:31:20.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.428+0000 7f0ac2f52640 1 -- 172.21.15.28:0/3351528400 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa4003980 msgr2=0x7f0aa4003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:20.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.428+0000 7f0ac2f52640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa4003980 0x7f0aa4003d80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0aac000ee0 tx=0x7f0aac009650 comp rx=0 tx=0).stop 2023-11-28T19:31:20.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.428+0000 7f0ac2f52640 1 -- 172.21.15.28:0/3351528400 shutdown_connections 2023-11-28T19:31:20.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.428+0000 7f0ac2f52640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40052b0 0x7f0aa400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:20.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.428+0000 7f0ac2f52640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aa40047d0 0x7f0aa4004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:20.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.428+0000 7f0ac2f52640 1 --2- 172.21.15.28:0/3351528400 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa4003980 0x7f0aa4003d80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:20.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.428+0000 7f0ac2f52640 1 -- 172.21.15.28:0/3351528400 >> 172.21.15.28:0/3351528400 conn(0x7f0abc0c0c90 msgr2=0x7f0abc0c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:20.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.428+0000 7f0ac2f52640 1 -- 172.21.15.28:0/3351528400 shutdown_connections 2023-11-28T19:31:20.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.428+0000 7f0ac2f52640 1 -- 172.21.15.28:0/3351528400 wait complete. 2023-11-28T19:31:20.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.432+0000 7f0ac2f52640 1 Processor -- start 2023-11-28T19:31:20.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.432+0000 7f0ac2f52640 1 -- start start 2023-11-28T19:31:20.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac2f52640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa4003980 0x7f0abc0ba5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:20.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac2f52640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40047d0 0x7f0abc1e4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:20.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac2f52640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aa40052b0 0x7f0abc1467a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:20.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac2f52640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc0bab20 con 0x7f0aa4003980 2023-11-28T19:31:20.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac2f52640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc14f990 con 0x7f0aa40052b0 2023-11-28T19:31:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac2f52640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0abc14f430 con 0x7f0aa40047d0 2023-11-28T19:31:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac0cee640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa4003980 0x7f0abc0ba5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac0cee640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa4003980 0x7f0abc0ba5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35470/0 (socket says 172.21.15.28:35470) 2023-11-28T19:31:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac0cee640 1 -- 172.21.15.28:0/2707951617 learned_addr learned my addr 172.21.15.28:0/2707951617 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0abbfff640 1 --2- 172.21.15.28:0/2707951617 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40047d0 0x7f0abc1e4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac14ef640 1 --2- 172.21.15.28:0/2707951617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aa40052b0 0x7f0abc1467a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac0cee640 1 -- 172.21.15.28:0/2707951617 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40047d0 msgr2=0x7f0abc1e4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/2707951617 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40047d0 0x7f0abc1e4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac0cee640 1 -- 172.21.15.28:0/2707951617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aa40052b0 msgr2=0x7f0abc1467a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/2707951617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aa40052b0 0x7f0abc1467a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:20.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac0cee640 1 -- 172.21.15.28:0/2707951617 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0abc14f010 con 0x7f0aa4003980 2023-11-28T19:31:20.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac0cee640 1 --2- 172.21.15.28:0/2707951617 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa4003980 0x7f0abc0ba5e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009480 tx=0x7f0aa4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:20.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ab97fa640 1 -- 172.21.15.28:0/2707951617 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0af640 con 0x7f0aa4003980 2023-11-28T19:31:20.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ab97fa640 1 -- 172.21.15.28:0/2707951617 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aac00c040 con 0x7f0aa4003980 2023-11-28T19:31:20.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ab97fa640 1 -- 172.21.15.28:0/2707951617 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aac0af9e0 con 0x7f0aa4003980 2023-11-28T19:31:20.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac2f52640 1 -- 172.21.15.28:0/2707951617 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0abc14f6b0 con 0x7f0aa4003980 2023-11-28T19:31:20.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ac2f52640 1 -- 172.21.15.28:0/2707951617 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0abc148080 con 0x7f0aa4003980 2023-11-28T19:31:20.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ab97fa640 1 -- 172.21.15.28:0/2707951617 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0aac0b6040 con 0x7f0aa4003980 2023-11-28T19:31:20.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.436+0000 7f0ab97fa640 1 -- 172.21.15.28:0/2707951617 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f0aac0c1a30 con 0x7f0aa4003980 2023-11-28T19:31:20.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.440+0000 7f0ac2f52640 1 -- 172.21.15.28:0/2707951617 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0abc074a90 con 0x7f0aa4003980 2023-11-28T19:31:20.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.440+0000 7f0ab97fa640 1 -- 172.21.15.28:0/2707951617 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0aac0c6060 con 0x7f0aa4003980 2023-11-28T19:31:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.504+0000 7f0ac2f52640 1 -- 172.21.15.28:0/2707951617 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f0abc0bfaa0 con 0x7f0aa4003980 2023-11-28T19:31:20.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.508+0000 7f0ab97fa640 1 -- 172.21.15.28:0/2707951617 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f0aac0cf090 con 0x7f0aa4003980 2023-11-28T19:31:20.510 INFO:teuthology.orchestra.run.smithi028.stderr:adjusted tunables profile to default 2023-11-28T19:31:20.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.508+0000 7f0ac2f52640 1 -- 172.21.15.28:0/2707951617 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa4003980 msgr2=0x7f0abc0ba5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:20.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.508+0000 7f0ac2f52640 1 --2- 172.21.15.28:0/2707951617 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa4003980 0x7f0abc0ba5e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0aac009480 tx=0x7f0aa4005800 comp rx=0 tx=0).stop 2023-11-28T19:31:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.508+0000 7f0ac2f52640 1 -- 172.21.15.28:0/2707951617 shutdown_connections 2023-11-28T19:31:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.508+0000 7f0ac2f52640 1 --2- 172.21.15.28:0/2707951617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0aa40052b0 0x7f0abc1467a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.508+0000 7f0ac2f52640 1 --2- 172.21.15.28:0/2707951617 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0aa40047d0 0x7f0abc1e4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.508+0000 7f0ac2f52640 1 --2- 172.21.15.28:0/2707951617 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0aa4003980 0x7f0abc0ba5e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.508+0000 7f0ac2f52640 1 -- 172.21.15.28:0/2707951617 >> 172.21.15.28:0/2707951617 conn(0x7f0abc0c0c90 msgr2=0x7f0abc0a17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.508+0000 7f0ac2f52640 1 -- 172.21.15.28:0/2707951617 shutdown_connections 2023-11-28T19:31:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:20.508+0000 7f0ac2f52640 1 -- 172.21.15.28:0/2707951617 wait complete. 2023-11-28T19:31:20.531 INFO:tasks.ceph:check_enable_crimson: False 2023-11-28T19:31:20.531 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-11-28T19:31:20.532 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:31:20.532 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-11-28T19:31:20.542 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:31:20.542 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-11-28T19:31:20.594 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:31:20.594 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-11-28T19:31:20.648 DEBUG:teuthology.orchestra.run.smithi028:> set -ex 2023-11-28T19:31:20.649 DEBUG:teuthology.orchestra.run.smithi028:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-11-28T19:31:20.684 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:20.683+0000 7f4dab9e7180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T19:31:20.704 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:31:20.704 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-11-28T19:31:20.718 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:31:20.718 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-11-28T19:31:20.757 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:20.752+0000 7efeb3e66180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-11-28T19:31:20.772 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:31:20.772 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-11-28T19:31:20.828 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2023-11-28T19:31:20.828 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-11-28T19:31:20.884 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 7c2e19c0-083a-4949-8be8-81932073d757 0 2023-11-28T19:31:21.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbda5dc2640 1 Processor -- start 2023-11-28T19:31:21.049 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbda5dc2640 1 -- start start 2023-11-28T19:31:21.050 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbda5dc2640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbda00b71f0 0x7fbda00b3440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbda5dc2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fbda00b3980 0x7fbda0153a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbda5dc2640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda00b3e30 con 0x7fbda006b7f0 2023-11-28T19:31:21.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbda5dc2640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda00b8da0 con 0x7fbda00b3980 2023-11-28T19:31:21.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbda5dc2640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbda00b92f0 con 0x7fbda00b71f0 2023-11-28T19:31:21.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbd9effd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbda00b71f0 0x7fbda00b3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbd9effd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbda00b71f0 0x7fbda00b3440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39842/0 (socket says 172.21.15.131:39842) 2023-11-28T19:31:21.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbd9effd640 1 -- 172.21.15.131:0/4012311160 learned_addr learned my addr 172.21.15.131:0/4012311160 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-11-28T19:31:21.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbd9ffff640 1 --2- 172.21.15.131:0/4012311160 >> v2:172.21.15.28:3300/0 conn(0x7fbda00b3980 0x7fbda0153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbd9effd640 1 -- 172.21.15.131:0/4012311160 >> v2:172.21.15.28:3300/0 conn(0x7fbda00b3980 msgr2=0x7fbda0153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:21.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbd9effd640 1 --2- 172.21.15.131:0/4012311160 >> v2:172.21.15.28:3300/0 conn(0x7fbda00b3980 0x7fbda0153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbd9effd640 1 -- 172.21.15.131:0/4012311160 >> v1:172.21.15.28:6789/0 conn(0x7fbda006b7f0 legacy=0x7fbda01430f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:21.051 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.047+0000 7fbd9effd640 1 -- 172.21.15.131:0/4012311160 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda00b9b10 con 0x7fbda00b71f0 2023-11-28T19:31:21.052 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbd9effd640 1 --2- 172.21.15.131:0/4012311160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda00b71f0 0x7fbda00b3440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbda00ba3b0 tx=0x7fbd9001ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b73e2f8b4a50e9fa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:21.053 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbd9e7fc640 1 -- 172.21.15.131:0/4012311160 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd900a89b0 con 0x7fbda00b71f0 2023-11-28T19:31:21.053 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbd9e7fc640 1 -- 172.21.15.131:0/4012311160 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd900a8b10 con 0x7fbda00b71f0 2023-11-28T19:31:21.053 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbd9e7fc640 1 -- 172.21.15.131:0/4012311160 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd900a8ea0 con 0x7fbda00b71f0 2023-11-28T19:31:21.054 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 -- 172.21.15.131:0/4012311160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda00b71f0 msgr2=0x7fbda00b3440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.054 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 --2- 172.21.15.131:0/4012311160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda00b71f0 0x7fbda00b3440 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fbda00ba3b0 tx=0x7fbd9001ecb0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.054 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 -- 172.21.15.131:0/4012311160 shutdown_connections 2023-11-28T19:31:21.054 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 --2- 172.21.15.131:0/4012311160 >> v2:172.21.15.28:3300/0 conn(0x7fbda00b3980 0x7fbda0153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.054 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 --2- 172.21.15.131:0/4012311160 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda00b71f0 0x7fbda00b3440 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.054 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 -- 172.21.15.131:0/4012311160 >> 172.21.15.131:0/4012311160 conn(0x7fbda006cb90 msgr2=0x7fbda006cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:21.054 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 -- 172.21.15.131:0/4012311160 shutdown_connections 2023-11-28T19:31:21.054 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 -- 172.21.15.131:0/4012311160 wait complete. 2023-11-28T19:31:21.055 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 Processor -- start 2023-11-28T19:31:21.055 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 -- start start 2023-11-28T19:31:21.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda006b7f0 0x7fbda00b64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbda00b3980 0x7fbda00b6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00b71f0 0x7fbda0139910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda0138a60 con 0x7fbda00b3980 2023-11-28T19:31:21.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda0143ba0 con 0x7fbda006b7f0 2023-11-28T19:31:21.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbda5dc2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda01e0e40 con 0x7fbda00b71f0 2023-11-28T19:31:21.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbd9f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda006b7f0 0x7fbda00b64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbd9f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda006b7f0 0x7fbda00b64e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39844/0 (socket says 172.21.15.131:39844) 2023-11-28T19:31:21.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbd9f7fe640 1 -- 172.21.15.131:0/3764354953 learned_addr learned my addr 172.21.15.131:0/3764354953 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-11-28T19:31:21.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.051+0000 7fbd9ffff640 1 --2- 172.21.15.131:0/3764354953 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00b71f0 0x7fbda0139910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.059 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbd9effd640 1 --2- 172.21.15.131:0/3764354953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbda00b3980 0x7fbda00b6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbd9f7fe640 1 -- 172.21.15.131:0/3764354953 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00b71f0 msgr2=0x7fbda0139910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbd9f7fe640 1 --2- 172.21.15.131:0/3764354953 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00b71f0 0x7fbda0139910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbd9f7fe640 1 -- 172.21.15.131:0/3764354953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbda00b3980 msgr2=0x7fbda00b6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbd9f7fe640 1 --2- 172.21.15.131:0/3764354953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbda00b3980 0x7fbda00b6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbd9f7fe640 1 -- 172.21.15.131:0/3764354953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd900094d0 con 0x7fbda006b7f0 2023-11-28T19:31:21.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbd9f7fe640 1 --2- 172.21.15.131:0/3764354953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda006b7f0 0x7fbda00b64e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c480 tx=0x7fbd9400c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:21.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbd87fff640 1 -- 172.21.15.131:0/3764354953 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd94012830 con 0x7fbda006b7f0 2023-11-28T19:31:21.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbd87fff640 1 -- 172.21.15.131:0/3764354953 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd940129b0 con 0x7fbda006b7f0 2023-11-28T19:31:21.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbd87fff640 1 -- 172.21.15.131:0/3764354953 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd94012d60 con 0x7fbda006b7f0 2023-11-28T19:31:21.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbda5dc2640 1 -- 172.21.15.131:0/3764354953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda01e1120 con 0x7fbda006b7f0 2023-11-28T19:31:21.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbda5dc2640 1 -- 172.21.15.131:0/3764354953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda01e16e0 con 0x7fbda006b7f0 2023-11-28T19:31:21.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbd87fff640 1 -- 172.21.15.131:0/3764354953 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fbd9401c760 con 0x7fbda006b7f0 2023-11-28T19:31:21.060 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbd87fff640 1 -- 172.21.15.131:0/3764354953 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7fbd9401b850 con 0x7fbda006b7f0 2023-11-28T19:31:21.061 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.055+0000 7fbda5dc2640 1 -- 172.21.15.131:0/3764354953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda0067a20 con 0x7fbda006b7f0 2023-11-28T19:31:21.064 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.063+0000 7fbd87fff640 1 -- 172.21.15.131:0/3764354953 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fbd9401ba60 con 0x7fbda006b7f0 2023-11-28T19:31:21.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.131+0000 7fbda5dc2640 1 -- 172.21.15.131:0/3764354953 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7c2e19c0-083a-4949-8be8-81932073d757", "id": 0} v 0) v1 -- 0x7fbda00749b0 con 0x7fbda006b7f0 2023-11-28T19:31:21.140 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.139+0000 7fbd87fff640 1 -- 172.21.15.131:0/3764354953 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c2e19c0-083a-4949-8be8-81932073d757", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fbd9401bc00 con 0x7fbda006b7f0 2023-11-28T19:31:21.140 INFO:teuthology.orchestra.run.smithi131.stdout:0 2023-11-28T19:31:21.142 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.139+0000 7fbda5dc2640 1 -- 172.21.15.131:0/3764354953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda006b7f0 msgr2=0x7fbda00b64e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.142 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.139+0000 7fbda5dc2640 1 --2- 172.21.15.131:0/3764354953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda006b7f0 0x7fbda00b64e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fbd9400c480 tx=0x7fbd9400c940 comp rx=0 tx=0).stop 2023-11-28T19:31:21.142 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.139+0000 7fbda5dc2640 1 -- 172.21.15.131:0/3764354953 shutdown_connections 2023-11-28T19:31:21.142 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.139+0000 7fbda5dc2640 1 --2- 172.21.15.131:0/3764354953 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fbda00b71f0 0x7fbda0139910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.142 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.139+0000 7fbda5dc2640 1 --2- 172.21.15.131:0/3764354953 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fbda00b3980 0x7fbda00b6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.142 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.139+0000 7fbda5dc2640 1 --2- 172.21.15.131:0/3764354953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbda006b7f0 0x7fbda00b64e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.142 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.139+0000 7fbda5dc2640 1 -- 172.21.15.131:0/3764354953 >> 172.21.15.131:0/3764354953 conn(0x7fbda006cb90 msgr2=0x7fbda00bba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:21.142 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.139+0000 7fbda5dc2640 1 -- 172.21.15.131:0/3764354953 shutdown_connections 2023-11-28T19:31:21.143 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.139+0000 7fbda5dc2640 1 -- 172.21.15.131:0/3764354953 wait complete. 2023-11-28T19:31:21.158 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 471c9241-1021-4b2d-b0a6-9881e0dbdd05 1 2023-11-28T19:31:21.231 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:21.227+0000 7f4dab9e7180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T19:31:21.274 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.271+0000 7fda1d5b8640 1 Processor -- start 2023-11-28T19:31:21.274 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.271+0000 7fda1d5b8640 1 -- start start 2023-11-28T19:31:21.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.271+0000 7fda1d5b8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fda180bb3d0 0x7fda18145040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.271+0000 7fda1d5b8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda180b43d0 con 0x7fda1806f4d0 2023-11-28T19:31:21.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.271+0000 7fda1d5b8640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda180ba990 con 0x7fda18145580 2023-11-28T19:31:21.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.271+0000 7fda1d5b8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda1814baa0 con 0x7fda180bb3d0 2023-11-28T19:31:21.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.271+0000 7fda177fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fda18145580 0x7fda18155ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:51566/0 (socket says 172.21.15.131:51566) 2023-11-28T19:31:21.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.271+0000 7fda177fe640 1 -- 172.21.15.131:0/2680285211 learned_addr learned my addr 172.21.15.131:0/2680285211 (peer_addr_for_me v1:172.21.15.131:0/0) 2023-11-28T19:31:21.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.271+0000 7fda167fc640 1 --2- 172.21.15.131:0/2680285211 >> v2:172.21.15.28:3300/0 conn(0x7fda180bb3d0 0x7fda18145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.271+0000 7fda15ffb640 1 -- 172.21.15.131:0/2680285211 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 271352048 0 0) 0x7fda180ba990 con 0x7fda18145580 2023-11-28T19:31:21.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.271+0000 7fda15ffb640 1 -- 172.21.15.131:0/2680285211 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda00003530 con 0x7fda18145580 2023-11-28T19:31:21.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 -- 172.21.15.131:0/2680285211 <== mon.1 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1551444771 0 0) 0x7fda00003530 con 0x7fda18145580 2023-11-28T19:31:21.277 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 -- 172.21.15.131:0/2680285211 >> v2:172.21.15.28:3300/0 conn(0x7fda180bb3d0 msgr2=0x7fda18145040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:21.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 --2- 172.21.15.131:0/2680285211 >> v2:172.21.15.28:3300/0 conn(0x7fda180bb3d0 0x7fda18145040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 -- 172.21.15.131:0/2680285211 >> v1:172.21.15.28:6789/0 conn(0x7fda1806f4d0 legacy=0x7fda1814b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 -- 172.21.15.131:0/2680285211 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda180b3e80 con 0x7fda18145580 2023-11-28T19:31:21.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 -- 172.21.15.131:0/2680285211 <== mon.1 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7fda10001a00 con 0x7fda18145580 2023-11-28T19:31:21.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 -- 172.21.15.131:0/2680285211 >> v1:172.21.15.131:6789/0 conn(0x7fda18145580 legacy=0x7fda18155ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 --2- 172.21.15.131:0/2680285211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda00003980 0x7fda00003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 --2- 172.21.15.131:0/2680285211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda000047d0 0x7fda00004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 --2- 172.21.15.131:0/2680285211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda00005190 0x7fda0000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 -- 172.21.15.131:0/2680285211 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1814baa0 con 0x7fda000047d0 2023-11-28T19:31:21.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 -- 172.21.15.131:0/2680285211 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0000c030 con 0x7fda00005190 2023-11-28T19:31:21.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 -- 172.21.15.131:0/2680285211 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0000c1f0 con 0x7fda00003980 2023-11-28T19:31:21.278 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda177fe640 1 --2- 172.21.15.131:0/2680285211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda00005190 0x7fda0000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda16ffd640 1 --2- 172.21.15.131:0/2680285211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda00003980 0x7fda00003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda167fc640 1 --2- 172.21.15.131:0/2680285211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda000047d0 0x7fda00004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda16ffd640 1 -- 172.21.15.131:0/2680285211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda00005190 msgr2=0x7fda0000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:21.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda16ffd640 1 --2- 172.21.15.131:0/2680285211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda00005190 0x7fda0000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda16ffd640 1 -- 172.21.15.131:0/2680285211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda000047d0 msgr2=0x7fda00004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:21.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda16ffd640 1 --2- 172.21.15.131:0/2680285211 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda000047d0 0x7fda00004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda16ffd640 1 -- 172.21.15.131:0/2680285211 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda00003530 con 0x7fda00003980 2023-11-28T19:31:21.279 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda177fe640 1 -- 172.21.15.131:0/2680285211 reap_dead start 2023-11-28T19:31:21.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda16ffd640 1 --2- 172.21.15.131:0/2680285211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda00003980 0x7fda00003da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fda08001780 tx=0x7fda0801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9c0fdbcd3a48fe5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:21.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 -- 172.21.15.131:0/2680285211 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda080a4ea0 con 0x7fda00003980 2023-11-28T19:31:21.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 -- 172.21.15.131:0/2680285211 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda080a7050 con 0x7fda00003980 2023-11-28T19:31:21.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda15ffb640 1 -- 172.21.15.131:0/2680285211 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda08003600 con 0x7fda00003980 2023-11-28T19:31:21.280 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda1d5b8640 1 -- 172.21.15.131:0/2680285211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda00003980 msgr2=0x7fda00003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda1d5b8640 1 --2- 172.21.15.131:0/2680285211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda00003980 0x7fda00003da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fda08001780 tx=0x7fda0801c3e0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda1d5b8640 1 -- 172.21.15.131:0/2680285211 shutdown_connections 2023-11-28T19:31:21.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda1d5b8640 1 --2- 172.21.15.131:0/2680285211 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda00003980 0x7fda00003da0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.275+0000 7fda1d5b8640 1 -- 172.21.15.131:0/2680285211 >> 172.21.15.131:0/2680285211 conn(0x7fda18071400 msgr2=0x7fda18071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:21.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda1d5b8640 1 -- 172.21.15.131:0/2680285211 shutdown_connections 2023-11-28T19:31:21.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda1d5b8640 1 -- 172.21.15.131:0/2680285211 wait complete. 2023-11-28T19:31:21.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda1d5b8640 1 Processor -- start 2023-11-28T19:31:21.281 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda1d5b8640 1 -- start start 2023-11-28T19:31:21.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda1d5b8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda00003980 0x7fda1814a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda1d5b8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda181e0f30 0x7fda181e1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda1d5b8640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda18141350 0x7fda181417d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda1d5b8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1814a6c0 con 0x7fda00003980 2023-11-28T19:31:21.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda1d5b8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda180b90f0 con 0x7fda181e0f30 2023-11-28T19:31:21.285 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda1d5b8640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda181e0aa0 con 0x7fda18141350 2023-11-28T19:31:21.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda167fc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda181e0f30 0x7fda181e1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda167fc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda181e0f30 0x7fda181e1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39850/0 (socket says 172.21.15.131:39850) 2023-11-28T19:31:21.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda167fc640 1 -- 172.21.15.131:0/2406425240 learned_addr learned my addr 172.21.15.131:0/2406425240 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-11-28T19:31:21.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda177fe640 1 --2- 172.21.15.131:0/2406425240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda18141350 0x7fda181417d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda16ffd640 1 --2- 172.21.15.131:0/2406425240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda00003980 0x7fda1814a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda167fc640 1 -- 172.21.15.131:0/2406425240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda18141350 msgr2=0x7fda181417d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda167fc640 1 --2- 172.21.15.131:0/2406425240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda18141350 0x7fda181417d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda167fc640 1 -- 172.21.15.131:0/2406425240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda00003980 msgr2=0x7fda1814a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda167fc640 1 --2- 172.21.15.131:0/2406425240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda00003980 0x7fda1814a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda167fc640 1 -- 172.21.15.131:0/2406425240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda18148820 con 0x7fda181e0f30 2023-11-28T19:31:21.286 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda177fe640 1 --2- 172.21.15.131:0/2406425240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda18141350 0x7fda181417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:31:21.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda167fc640 1 --2- 172.21.15.131:0/2406425240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda181e0f30 0x7fda181e1390 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fda0c010860 tx=0x7fda0c010d20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:21.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fd9ff7fe640 1 -- 172.21.15.131:0/2406425240 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c009650 con 0x7fda181e0f30 2023-11-28T19:31:21.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fd9ff7fe640 1 -- 172.21.15.131:0/2406425240 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda0c00eb00 con 0x7fda181e0f30 2023-11-28T19:31:21.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fd9ff7fe640 1 -- 172.21.15.131:0/2406425240 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0c00eeb0 con 0x7fda181e0f30 2023-11-28T19:31:21.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.279+0000 7fda1d5b8640 1 -- 172.21.15.131:0/2406425240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda181e18d0 con 0x7fda181e0f30 2023-11-28T19:31:21.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.283+0000 7fda1d5b8640 1 -- 172.21.15.131:0/2406425240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda18148aa0 con 0x7fda181e0f30 2023-11-28T19:31:21.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.283+0000 7fd9ff7fe640 1 -- 172.21.15.131:0/2406425240 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fda0c0059a0 con 0x7fda181e0f30 2023-11-28T19:31:21.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.283+0000 7fd9ff7fe640 1 -- 172.21.15.131:0/2406425240 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fda0c01c7b0 con 0x7fda181e0f30 2023-11-28T19:31:21.287 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.283+0000 7fda1d5b8640 1 -- 172.21.15.131:0/2406425240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda18074a90 con 0x7fda181e0f30 2023-11-28T19:31:21.288 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:21.284+0000 7efeb3e66180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-11-28T19:31:21.288 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.283+0000 7fd9ff7fe640 1 -- 172.21.15.131:0/2406425240 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fda0c021020 con 0x7fda181e0f30 2023-11-28T19:31:21.355 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.351+0000 7fda1d5b8640 1 -- 172.21.15.131:0/2406425240 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "471c9241-1021-4b2d-b0a6-9881e0dbdd05", "id": 1} v 0) v1 -- 0x7fda18072180 con 0x7fda181e0f30 2023-11-28T19:31:21.364 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.363+0000 7fd9ff7fe640 1 -- 172.21.15.131:0/2406425240 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "471c9241-1021-4b2d-b0a6-9881e0dbdd05", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fda0c00f040 con 0x7fda181e0f30 2023-11-28T19:31:21.365 INFO:teuthology.orchestra.run.smithi131.stdout:1 2023-11-28T19:31:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.363+0000 7fda1d5b8640 1 -- 172.21.15.131:0/2406425240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda181e0f30 msgr2=0x7fda181e1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.363+0000 7fda1d5b8640 1 --2- 172.21.15.131:0/2406425240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda181e0f30 0x7fda181e1390 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fda0c010860 tx=0x7fda0c010d20 comp rx=0 tx=0).stop 2023-11-28T19:31:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.363+0000 7fda1d5b8640 1 -- 172.21.15.131:0/2406425240 shutdown_connections 2023-11-28T19:31:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.363+0000 7fda1d5b8640 1 --2- 172.21.15.131:0/2406425240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fda18141350 0x7fda181417d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.363+0000 7fda1d5b8640 1 --2- 172.21.15.131:0/2406425240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fda181e0f30 0x7fda181e1390 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.363+0000 7fda1d5b8640 1 --2- 172.21.15.131:0/2406425240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fda00003980 0x7fda1814a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.363+0000 7fda1d5b8640 1 -- 172.21.15.131:0/2406425240 >> 172.21.15.131:0/2406425240 conn(0x7fda18071400 msgr2=0x7fda18143bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.363+0000 7fda1d5b8640 1 -- 172.21.15.131:0/2406425240 shutdown_connections 2023-11-28T19:31:21.366 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.363+0000 7fda1d5b8640 1 -- 172.21.15.131:0/2406425240 wait complete. 2023-11-28T19:31:21.383 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new e67b151c-c6ca-4edd-9314-bbdfc38e7ba0 2 2023-11-28T19:31:21.431 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:21.427+0000 7f4dab9e7180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T19:31:21.467 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:21.464+0000 7efeb3e66180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-11-28T19:31:21.498 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.495+0000 7f37869cc640 1 Processor -- start 2023-11-28T19:31:21.498 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.495+0000 7f37869cc640 1 -- start start 2023-11-28T19:31:21.499 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.495+0000 7f37869cc640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f37800bb2d0 0x7f3780071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.499 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.495+0000 7f37869cc640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37800bb6f0 con 0x7f37800baa30 2023-11-28T19:31:21.499 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.495+0000 7f37869cc640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37801491d0 con 0x7f3780143020 2023-11-28T19:31:21.499 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.495+0000 7f37869cc640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378006f1e0 con 0x7f37800bb2d0 2023-11-28T19:31:21.500 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.495+0000 7f377f7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f37800bb2d0 0x7f3780071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.500 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.495+0000 7f3784f69640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f3780143020 0x7f3780153ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:51582/0 (socket says 172.21.15.131:51582) 2023-11-28T19:31:21.500 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.495+0000 7f3784f69640 1 -- 172.21.15.131:0/4285503498 learned_addr learned my addr 172.21.15.131:0/4285503498 (peer_addr_for_me v1:172.21.15.131:0/0) 2023-11-28T19:31:21.500 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.495+0000 7f377f7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f37800bb2d0 0x7f3780071f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39864/0 (socket says 172.21.15.131:39864) 2023-11-28T19:31:21.500 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.495+0000 7f377f7fe640 1 -- 172.21.15.131:0/4285503498 >> v1:172.21.15.131:6789/0 conn(0x7f3780143020 legacy=0x7f3780153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.500 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.495+0000 7f377f7fe640 1 -- 172.21.15.131:0/4285503498 >> v1:172.21.15.28:6789/0 conn(0x7f37800baa30 legacy=0x7f378006f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.500 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.495+0000 7f377f7fe640 1 -- 172.21.15.131:0/4285503498 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37800b5830 con 0x7f37800bb2d0 2023-11-28T19:31:21.501 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f377f7fe640 1 --2- 172.21.15.131:0/4285503498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37800bb2d0 0x7f3780071f20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3768009740 tx=0x7f376801c340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31599b791e7691e5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:21.501 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f377effd640 1 -- 172.21.15.131:0/4285503498 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37680ad660 con 0x7f37800bb2d0 2023-11-28T19:31:21.501 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f377effd640 1 -- 172.21.15.131:0/4285503498 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37680ad7c0 con 0x7f37800bb2d0 2023-11-28T19:31:21.501 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f377effd640 1 -- 172.21.15.131:0/4285503498 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37680adb50 con 0x7f37800bb2d0 2023-11-28T19:31:21.502 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f37869cc640 1 -- 172.21.15.131:0/4285503498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37800bb2d0 msgr2=0x7f3780071f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.502 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f37869cc640 1 --2- 172.21.15.131:0/4285503498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37800bb2d0 0x7f3780071f20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3768009740 tx=0x7f376801c340 comp rx=0 tx=0).stop 2023-11-28T19:31:21.502 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f37869cc640 1 -- 172.21.15.131:0/4285503498 shutdown_connections 2023-11-28T19:31:21.503 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f37869cc640 1 --2- 172.21.15.131:0/4285503498 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37800bb2d0 0x7f3780071f20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.503 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f37869cc640 1 -- 172.21.15.131:0/4285503498 >> 172.21.15.131:0/4285503498 conn(0x7f3780071400 msgr2=0x7f3780071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:21.503 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f37869cc640 1 -- 172.21.15.131:0/4285503498 shutdown_connections 2023-11-28T19:31:21.503 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f37869cc640 1 -- 172.21.15.131:0/4285503498 wait complete. 2023-11-28T19:31:21.505 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f37869cc640 1 Processor -- start 2023-11-28T19:31:21.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f37869cc640 1 -- start start 2023-11-28T19:31:21.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f37869cc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37800baa30 0x7f378013e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.499+0000 7f37869cc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37800bb2d0 0x7f378014c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f37869cc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3780143020 0x7f378013be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f37869cc640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378013ebe0 con 0x7f37800bb2d0 2023-11-28T19:31:21.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f37869cc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3780146a20 con 0x7f37800baa30 2023-11-28T19:31:21.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f37869cc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378014b960 con 0x7f3780143020 2023-11-28T19:31:21.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37800baa30 0x7f378013e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37800baa30 0x7f378013e6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39866/0 (socket says 172.21.15.131:39866) 2023-11-28T19:31:21.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377ffff640 1 -- 172.21.15.131:0/42811169 learned_addr learned my addr 172.21.15.131:0/42811169 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-11-28T19:31:21.506 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f3784f69640 1 --2- 172.21.15.131:0/42811169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3780143020 0x7f378013be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.507 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377f7fe640 1 --2- 172.21.15.131:0/42811169 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37800bb2d0 0x7f378014c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.507 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377ffff640 1 -- 172.21.15.131:0/42811169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3780143020 msgr2=0x7f378013be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.507 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377ffff640 1 --2- 172.21.15.131:0/42811169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3780143020 0x7f378013be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.507 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377ffff640 1 -- 172.21.15.131:0/42811169 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37800bb2d0 msgr2=0x7f378014c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.507 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377ffff640 1 --2- 172.21.15.131:0/42811169 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37800bb2d0 0x7f378014c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.507 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377ffff640 1 -- 172.21.15.131:0/42811169 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3768009420 con 0x7f37800baa30 2023-11-28T19:31:21.507 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377f7fe640 1 --2- 172.21.15.131:0/42811169 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37800bb2d0 0x7f378014c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:21.507 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377ffff640 1 --2- 172.21.15.131:0/42811169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37800baa30 0x7f378013e6a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f377000c820 tx=0x7f377000cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:21.507 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377cff9640 1 -- 172.21.15.131:0/42811169 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3770003b80 con 0x7f37800baa30 2023-11-28T19:31:21.507 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377cff9640 1 -- 172.21.15.131:0/42811169 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3770003ce0 con 0x7f37800baa30 2023-11-28T19:31:21.507 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377cff9640 1 -- 172.21.15.131:0/42811169 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377000aa90 con 0x7f37800baa30 2023-11-28T19:31:21.507 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f37869cc640 1 -- 172.21.15.131:0/42811169 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37800b9040 con 0x7f37800baa30 2023-11-28T19:31:21.508 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f37869cc640 1 -- 172.21.15.131:0/42811169 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3780146460 con 0x7f37800baa30 2023-11-28T19:31:21.508 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377cff9640 1 -- 172.21.15.131:0/42811169 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f37700050d0 con 0x7f37800baa30 2023-11-28T19:31:21.508 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f37869cc640 1 -- 172.21.15.131:0/42811169 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3780074a90 con 0x7f37800baa30 2023-11-28T19:31:21.508 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.503+0000 7f377cff9640 1 -- 172.21.15.131:0/42811169 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f37700057a0 con 0x7f37800baa30 2023-11-28T19:31:21.509 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.507+0000 7f377cff9640 1 -- 172.21.15.131:0/42811169 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f37800bb6f0 con 0x7f37800baa30 2023-11-28T19:31:21.577 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.575+0000 7f37869cc640 1 -- 172.21.15.131:0/42811169 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e67b151c-c6ca-4edd-9314-bbdfc38e7ba0", "id": 2} v 0) v1 -- 0x7f3780146b60 con 0x7f37800baa30 2023-11-28T19:31:21.584 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.583+0000 7f377cff9640 1 -- 172.21.15.131:0/42811169 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e67b151c-c6ca-4edd-9314-bbdfc38e7ba0", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3770005380 con 0x7f37800baa30 2023-11-28T19:31:21.584 INFO:teuthology.orchestra.run.smithi131.stdout:2 2023-11-28T19:31:21.586 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.583+0000 7f37869cc640 1 -- 172.21.15.131:0/42811169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37800baa30 msgr2=0x7f378013e6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.586 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.583+0000 7f37869cc640 1 --2- 172.21.15.131:0/42811169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37800baa30 0x7f378013e6a0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f377000c820 tx=0x7f377000cce0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.586 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.583+0000 7f37869cc640 1 -- 172.21.15.131:0/42811169 shutdown_connections 2023-11-28T19:31:21.586 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.583+0000 7f37869cc640 1 --2- 172.21.15.131:0/42811169 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3780143020 0x7f378013be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.586 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.583+0000 7f37869cc640 1 --2- 172.21.15.131:0/42811169 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37800bb2d0 0x7f378014c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.586 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.583+0000 7f37869cc640 1 --2- 172.21.15.131:0/42811169 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37800baa30 0x7f378013e6a0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.587 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.583+0000 7f37869cc640 1 -- 172.21.15.131:0/42811169 >> 172.21.15.131:0/42811169 conn(0x7f3780071400 msgr2=0x7f378006e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:21.587 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.583+0000 7f37869cc640 1 -- 172.21.15.131:0/42811169 shutdown_connections 2023-11-28T19:31:21.587 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.583+0000 7f37869cc640 1 -- 172.21.15.131:0/42811169 wait complete. 2023-11-28T19:31:21.600 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 9f551835-7aa2-43ed-8754-c1acb7f717b5 3 2023-11-28T19:31:21.707 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.703+0000 7fdbd54e8640 1 Processor -- start 2023-11-28T19:31:21.707 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.703+0000 7fdbd54e8640 1 -- start start 2023-11-28T19:31:21.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.703+0000 7fdbd54e8640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdbd0145940 0x7fdbd00702b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.703+0000 7fdbd54e8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd00ba440 con 0x7fdbd00b8ed0 2023-11-28T19:31:21.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.703+0000 7fdbd54e8640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd00ba720 con 0x7fdbd00b7a90 2023-11-28T19:31:21.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.703+0000 7fdbd54e8640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd00708d0 con 0x7fdbd0145940 2023-11-28T19:31:21.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.703+0000 7fdbcf7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdbd0145940 0x7fdbd00702b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.708 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.703+0000 7fdbcf7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdbd0145940 0x7fdbd00702b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39872/0 (socket says 172.21.15.131:39872) 2023-11-28T19:31:21.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.703+0000 7fdbcf7fe640 1 -- 172.21.15.131:0/3105491955 learned_addr learned my addr 172.21.15.131:0/3105491955 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-11-28T19:31:21.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbcf7fe640 1 -- 172.21.15.131:0/3105491955 >> v1:172.21.15.131:6789/0 conn(0x7fdbd00b7a90 legacy=0x7fdbd00b87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbcf7fe640 1 -- 172.21.15.131:0/3105491955 >> v1:172.21.15.28:6789/0 conn(0x7fdbd00b8ed0 legacy=0x7fdbd0145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:21.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbce7fc640 1 -- 172.21.15.131:0/3105491955 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1285389010 0 0) 0x7fdbd00ba720 con 0x7fdbd00b7a90 2023-11-28T19:31:21.709 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbcf7fe640 1 -- 172.21.15.131:0/3105491955 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd00baa00 con 0x7fdbd0145940 2023-11-28T19:31:21.711 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbcf7fe640 1 --2- 172.21.15.131:0/3105491955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbd0145940 0x7fdbd00702b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009e50 tx=0x7fdbc801f1c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f121db0e06fe257 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:21.711 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbce7fc640 1 -- 172.21.15.131:0/3105491955 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc80af400 con 0x7fdbd0145940 2023-11-28T19:31:21.711 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbce7fc640 1 -- 172.21.15.131:0/3105491955 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc80ab050 con 0x7fdbd0145940 2023-11-28T19:31:21.711 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbce7fc640 1 -- 172.21.15.131:0/3105491955 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc80af780 con 0x7fdbd0145940 2023-11-28T19:31:21.712 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbd54e8640 1 -- 172.21.15.131:0/3105491955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbd0145940 msgr2=0x7fdbd00702b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.712 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbd54e8640 1 --2- 172.21.15.131:0/3105491955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbd0145940 0x7fdbd00702b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8009e50 tx=0x7fdbc801f1c0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.712 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbd54e8640 1 -- 172.21.15.131:0/3105491955 shutdown_connections 2023-11-28T19:31:21.712 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbd54e8640 1 --2- 172.21.15.131:0/3105491955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbd0145940 0x7fdbd00702b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.712 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbd54e8640 1 -- 172.21.15.131:0/3105491955 >> 172.21.15.131:0/3105491955 conn(0x7fdbd006e7f0 msgr2=0x7fdbd006b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:21.712 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbd54e8640 1 -- 172.21.15.131:0/3105491955 shutdown_connections 2023-11-28T19:31:21.712 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.707+0000 7fdbd54e8640 1 -- 172.21.15.131:0/3105491955 wait complete. 2023-11-28T19:31:21.717 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbd54e8640 1 Processor -- start 2023-11-28T19:31:21.717 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbd54e8640 1 -- start start 2023-11-28T19:31:21.717 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbd54e8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbd00b7a90 0x7fdbd01d3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.717 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbd54e8640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbd0145940 0x7fdbd01d2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.717 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbd54e8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbd01e0dc0 0x7fdbd01e1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.717 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbd54e8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd01d2a60 con 0x7fdbd01e0dc0 2023-11-28T19:31:21.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbd54e8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd01d1720 con 0x7fdbd00b7a90 2023-11-28T19:31:21.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbd54e8640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd01d1f80 con 0x7fdbd0145940 2023-11-28T19:31:21.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbceffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbd00b7a90 0x7fdbd01d3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbc7fff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbd0145940 0x7fdbd01d2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbceffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbd00b7a90 0x7fdbd01d3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39888/0 (socket says 172.21.15.131:39888) 2023-11-28T19:31:21.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbceffd640 1 -- 172.21.15.131:0/2549097561 learned_addr learned my addr 172.21.15.131:0/2549097561 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-11-28T19:31:21.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbcf7fe640 1 --2- 172.21.15.131:0/2549097561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbd01e0dc0 0x7fdbd01e1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbceffd640 1 -- 172.21.15.131:0/2549097561 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbd0145940 msgr2=0x7fdbd01d2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbceffd640 1 --2- 172.21.15.131:0/2549097561 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbd0145940 0x7fdbd01d2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbceffd640 1 -- 172.21.15.131:0/2549097561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbd01e0dc0 msgr2=0x7fdbd01e1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbceffd640 1 --2- 172.21.15.131:0/2549097561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbd01e0dc0 0x7fdbd01e1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.718 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbceffd640 1 -- 172.21.15.131:0/2549097561 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc8009b30 con 0x7fdbd00b7a90 2023-11-28T19:31:21.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbc7fff640 1 --2- 172.21.15.131:0/2549097561 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbd0145940 0x7fdbd01d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:31:21.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbceffd640 1 --2- 172.21.15.131:0/2549097561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbd00b7a90 0x7fdbd01d3540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000c4d0 tx=0x7fdbc000c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:21.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbc77fe640 1 -- 172.21.15.131:0/2549097561 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc0005480 con 0x7fdbd00b7a90 2023-11-28T19:31:21.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbc77fe640 1 -- 172.21.15.131:0/2549097561 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc0003600 con 0x7fdbd00b7a90 2023-11-28T19:31:21.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbd54e8640 1 -- 172.21.15.131:0/2549097561 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd01e1790 con 0x7fdbd00b7a90 2023-11-28T19:31:21.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbc77fe640 1 -- 172.21.15.131:0/2549097561 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc00039b0 con 0x7fdbd00b7a90 2023-11-28T19:31:21.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbd54e8640 1 -- 172.21.15.131:0/2549097561 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd014bfe0 con 0x7fdbd00b7a90 2023-11-28T19:31:21.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbc77fe640 1 -- 172.21.15.131:0/2549097561 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdbc001c440 con 0x7fdbd00b7a90 2023-11-28T19:31:21.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbc77fe640 1 -- 172.21.15.131:0/2549097561 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fdbc0012890 con 0x7fdbd00b7a90 2023-11-28T19:31:21.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.711+0000 7fdbd54e8640 1 -- 172.21.15.131:0/2549097561 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd01d31a0 con 0x7fdbd00b7a90 2023-11-28T19:31:21.719 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.715+0000 7fdbc77fe640 1 -- 172.21.15.131:0/2549097561 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fdbd01d31a0 con 0x7fdbd00b7a90 2023-11-28T19:31:21.780 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.779+0000 7fdbd54e8640 1 -- 172.21.15.131:0/2549097561 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9f551835-7aa2-43ed-8754-c1acb7f717b5", "id": 3} v 0) v1 -- 0x7fdbd0074a90 con 0x7fdbd00b7a90 2023-11-28T19:31:21.785 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.783+0000 7fdbc77fe640 1 -- 172.21.15.131:0/2549097561 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f551835-7aa2-43ed-8754-c1acb7f717b5", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdbc0017070 con 0x7fdbd00b7a90 2023-11-28T19:31:21.786 INFO:teuthology.orchestra.run.smithi131.stdout:3 2023-11-28T19:31:21.787 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.783+0000 7fdbd54e8640 1 -- 172.21.15.131:0/2549097561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbd00b7a90 msgr2=0x7fdbd01d3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.787 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.783+0000 7fdbd54e8640 1 --2- 172.21.15.131:0/2549097561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbd00b7a90 0x7fdbd01d3540 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdbc000c4d0 tx=0x7fdbc000c990 comp rx=0 tx=0).stop 2023-11-28T19:31:21.787 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.783+0000 7fdbd54e8640 1 -- 172.21.15.131:0/2549097561 shutdown_connections 2023-11-28T19:31:21.788 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.783+0000 7fdbd54e8640 1 --2- 172.21.15.131:0/2549097561 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbd01e0dc0 0x7fdbd01e1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.788 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.783+0000 7fdbd54e8640 1 --2- 172.21.15.131:0/2549097561 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbd0145940 0x7fdbd01d2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.788 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.783+0000 7fdbd54e8640 1 --2- 172.21.15.131:0/2549097561 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbd00b7a90 0x7fdbd01d3540 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.788 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.783+0000 7fdbd54e8640 1 -- 172.21.15.131:0/2549097561 >> 172.21.15.131:0/2549097561 conn(0x7fdbd006e7f0 msgr2=0x7fdbd00b6550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:21.788 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.783+0000 7fdbd54e8640 1 -- 172.21.15.131:0/2549097561 shutdown_connections 2023-11-28T19:31:21.788 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.783+0000 7fdbd54e8640 1 -- 172.21.15.131:0/2549097561 wait complete. 2023-11-28T19:31:21.807 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 704110d8-2b94-4f9a-b657-15390cc62a7c 4 2023-11-28T19:31:21.914 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.911+0000 7f4efc54e640 1 Processor -- start 2023-11-28T19:31:21.915 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.911+0000 7f4efc54e640 1 -- start start 2023-11-28T19:31:21.917 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.911+0000 7f4efc54e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4ef40baa30 0x7f4ef40bb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.917 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.911+0000 7f4efc54e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef4072340 con 0x7f4ef4143020 2023-11-28T19:31:21.918 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.911+0000 7f4efc54e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef41491d0 con 0x7f4ef4071f20 2023-11-28T19:31:21.918 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.911+0000 7f4efc54e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef406f1e0 con 0x7f4ef40baa30 2023-11-28T19:31:21.918 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.911+0000 7f4ef9ae9640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f4ef4071f20 0x7f4ef406f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46278/0 (socket says 172.21.15.131:46278) 2023-11-28T19:31:21.918 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.911+0000 7f4ef9ae9640 1 -- 172.21.15.131:0/326457539 learned_addr learned my addr 172.21.15.131:0/326457539 (peer_addr_for_me v1:172.21.15.131:0/0) 2023-11-28T19:31:21.918 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.911+0000 7f4efa2ea640 1 --2- 172.21.15.131:0/326457539 >> v2:172.21.15.28:3300/0 conn(0x7f4ef40baa30 0x7f4ef40bb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.918 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.911+0000 7f4ef92e8640 1 -- 172.21.15.131:0/326457539 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1453625786 0 0) 0x7f4ef41491d0 con 0x7f4ef4071f20 2023-11-28T19:31:21.918 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef92e8640 1 -- 172.21.15.131:0/326457539 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ee0003530 con 0x7f4ef4071f20 2023-11-28T19:31:21.918 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef92e8640 1 -- 172.21.15.131:0/326457539 <== mon.1 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2869283602 0 0) 0x7f4ee0003530 con 0x7f4ef4071f20 2023-11-28T19:31:21.918 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef92e8640 1 -- 172.21.15.131:0/326457539 >> v2:172.21.15.28:3300/0 conn(0x7f4ef40baa30 msgr2=0x7f4ef40bb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:21.918 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef92e8640 1 --2- 172.21.15.131:0/326457539 >> v2:172.21.15.28:3300/0 conn(0x7f4ef40baa30 0x7f4ef40bb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef92e8640 1 -- 172.21.15.131:0/326457539 >> v1:172.21.15.28:6789/0 conn(0x7f4ef4143020 legacy=0x7f4ef4153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef92e8640 1 -- 172.21.15.131:0/326457539 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef40b5830 con 0x7f4ef4071f20 2023-11-28T19:31:21.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef92e8640 1 -- 172.21.15.131:0/326457539 <== mon.1 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f4ef0001680 con 0x7f4ef4071f20 2023-11-28T19:31:21.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef92e8640 1 -- 172.21.15.131:0/326457539 >> v1:172.21.15.131:6789/0 conn(0x7f4ef4071f20 legacy=0x7f4ef406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef92e8640 1 --2- 172.21.15.131:0/326457539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee0003980 0x7f4ee0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef92e8640 1 --2- 172.21.15.131:0/326457539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee00047d0 0x7f4ee0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef92e8640 1 --2- 172.21.15.131:0/326457539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ee0005190 0x7f4ee000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef92e8640 1 -- 172.21.15.131:0/326457539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef406f1e0 con 0x7f4ee0005190 2023-11-28T19:31:21.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef92e8640 1 -- 172.21.15.131:0/326457539 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee000c040 con 0x7f4ee0003980 2023-11-28T19:31:21.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef92e8640 1 -- 172.21.15.131:0/326457539 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee000c200 con 0x7f4ee00047d0 2023-11-28T19:31:21.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4efa2ea640 1 --2- 172.21.15.131:0/326457539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee0003980 0x7f4ee0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.919 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4ef9ae9640 1 --2- 172.21.15.131:0/326457539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee00047d0 0x7f4ee0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.920 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4efaaeb640 1 --2- 172.21.15.131:0/326457539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ee0005190 0x7f4ee000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.920 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4efa2ea640 1 -- 172.21.15.131:0/326457539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee00047d0 msgr2=0x7f4ee0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:21.920 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4efa2ea640 1 --2- 172.21.15.131:0/326457539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ee00047d0 0x7f4ee0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.920 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4efa2ea640 1 -- 172.21.15.131:0/326457539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ee0005190 msgr2=0x7f4ee000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:21.920 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4efa2ea640 1 --2- 172.21.15.131:0/326457539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ee0005190 0x7f4ee000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.920 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4efa2ea640 1 -- 172.21.15.131:0/326457539 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ee0003530 con 0x7f4ee0003980 2023-11-28T19:31:21.920 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.915+0000 7f4efaaeb640 1 -- 172.21.15.131:0/326457539 reap_dead start 2023-11-28T19:31:21.922 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efa2ea640 1 --2- 172.21.15.131:0/326457539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee0003980 0x7f4ee0003da0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009ae0 tx=0x7f4ee801ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93f781c26cf573b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:21.922 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ef92e8640 1 -- 172.21.15.131:0/326457539 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee80a5640 con 0x7f4ee0003980 2023-11-28T19:31:21.922 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ef92e8640 1 -- 172.21.15.131:0/326457539 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee80a57a0 con 0x7f4ee0003980 2023-11-28T19:31:21.922 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ef92e8640 1 -- 172.21.15.131:0/326457539 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee80a5b50 con 0x7f4ee0003980 2023-11-28T19:31:21.922 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 -- 172.21.15.131:0/326457539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee0003980 msgr2=0x7f4ee0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.922 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 --2- 172.21.15.131:0/326457539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee0003980 0x7f4ee0003da0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4ee8009ae0 tx=0x7f4ee801ca50 comp rx=0 tx=0).stop 2023-11-28T19:31:21.922 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 -- 172.21.15.131:0/326457539 shutdown_connections 2023-11-28T19:31:21.923 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 --2- 172.21.15.131:0/326457539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee0003980 0x7f4ee0003da0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.923 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 -- 172.21.15.131:0/326457539 >> 172.21.15.131:0/326457539 conn(0x7f4ef4071400 msgr2=0x7f4ef4071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:21.923 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 -- 172.21.15.131:0/326457539 shutdown_connections 2023-11-28T19:31:21.923 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 -- 172.21.15.131:0/326457539 wait complete. 2023-11-28T19:31:21.923 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 Processor -- start 2023-11-28T19:31:21.923 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 -- start start 2023-11-28T19:31:21.925 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ee0003980 0x7f4ef40b6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.925 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ef40b61c0 0x7f4ef413f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.925 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ef41e24a0 0x7f4ef41e2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:21.925 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef413fde0 con 0x7f4ee0003980 2023-11-28T19:31:21.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef41d5420 con 0x7f4ef41e24a0 2023-11-28T19:31:21.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef41e2e90 con 0x7f4ef40b61c0 2023-11-28T19:31:21.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ef9ae9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ef40b61c0 0x7f4ef413f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efaaeb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ef41e24a0 0x7f4ef41e2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ef9ae9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ef40b61c0 0x7f4ef413f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:48956/0 (socket says 172.21.15.131:48956) 2023-11-28T19:31:21.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efaaeb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ef41e24a0 0x7f4ef41e2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35448/0 (socket says 172.21.15.131:35448) 2023-11-28T19:31:21.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ef9ae9640 1 -- 172.21.15.131:0/249587931 learned_addr learned my addr 172.21.15.131:0/249587931 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-11-28T19:31:21.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efa2ea640 1 --2- 172.21.15.131:0/249587931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ee0003980 0x7f4ef40b6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:21.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ef9ae9640 1 -- 172.21.15.131:0/249587931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ef41e24a0 msgr2=0x7f4ef41e2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ef9ae9640 1 --2- 172.21.15.131:0/249587931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ef41e24a0 0x7f4ef41e2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ef9ae9640 1 -- 172.21.15.131:0/249587931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ee0003980 msgr2=0x7f4ef40b6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.926 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ef9ae9640 1 --2- 172.21.15.131:0/249587931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ee0003980 0x7f4ef40b6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ef9ae9640 1 -- 172.21.15.131:0/249587931 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef41d4b80 con 0x7f4ef40b61c0 2023-11-28T19:31:21.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efaaeb640 1 --2- 172.21.15.131:0/249587931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ef41e24a0 0x7f4ef41e2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:31:21.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ef9ae9640 1 --2- 172.21.15.131:0/249587931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ef40b61c0 0x7f4ef413f8a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0007290 tx=0x7f4ef0007750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:21.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ee6ffd640 1 -- 172.21.15.131:0/249587931 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef000f8c0 con 0x7f4ef40b61c0 2023-11-28T19:31:21.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ee6ffd640 1 -- 172.21.15.131:0/249587931 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef000fa60 con 0x7f4ef40b61c0 2023-11-28T19:31:21.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 -- 172.21.15.131:0/249587931 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ef41d4e60 con 0x7f4ef40b61c0 2023-11-28T19:31:21.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ee6ffd640 1 -- 172.21.15.131:0/249587931 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef000fe10 con 0x7f4ef40b61c0 2023-11-28T19:31:21.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4efc54e640 1 -- 172.21.15.131:0/249587931 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef41d2870 con 0x7f4ef40b61c0 2023-11-28T19:31:21.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ee6ffd640 1 -- 172.21.15.131:0/249587931 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4ef001d760 con 0x7f4ef40b61c0 2023-11-28T19:31:21.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.919+0000 7f4ee6ffd640 1 -- 172.21.15.131:0/249587931 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f4ef0013bd0 con 0x7f4ef40b61c0 2023-11-28T19:31:21.927 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.923+0000 7f4efc54e640 1 -- 172.21.15.131:0/249587931 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef41e21c0 con 0x7f4ef40b61c0 2023-11-28T19:31:21.928 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.923+0000 7f4ee6ffd640 1 -- 172.21.15.131:0/249587931 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f4ef41e21c0 con 0x7f4ef40b61c0 2023-11-28T19:31:21.991 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.987+0000 7f4efc54e640 1 -- 172.21.15.131:0/249587931 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "704110d8-2b94-4f9a-b657-15390cc62a7c", "id": 4} v 0) v1 -- 0x7f4ef4149ee0 con 0x7f4ef40b61c0 2023-11-28T19:31:21.996 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.995+0000 7f4ee6ffd640 1 -- 172.21.15.131:0/249587931 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "704110d8-2b94-4f9a-b657-15390cc62a7c", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4ef001dba0 con 0x7f4ef40b61c0 2023-11-28T19:31:21.996 INFO:teuthology.orchestra.run.smithi131.stdout:4 2023-11-28T19:31:21.997 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.995+0000 7f4efc54e640 1 -- 172.21.15.131:0/249587931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ef40b61c0 msgr2=0x7f4ef413f8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:21.997 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.995+0000 7f4efc54e640 1 --2- 172.21.15.131:0/249587931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ef40b61c0 0x7f4ef413f8a0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4ef0007290 tx=0x7f4ef0007750 comp rx=0 tx=0).stop 2023-11-28T19:31:21.998 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.995+0000 7f4efc54e640 1 -- 172.21.15.131:0/249587931 shutdown_connections 2023-11-28T19:31:21.998 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.995+0000 7f4efc54e640 1 --2- 172.21.15.131:0/249587931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ef41e24a0 0x7f4ef41e2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.998 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.995+0000 7f4efc54e640 1 --2- 172.21.15.131:0/249587931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4ef40b61c0 0x7f4ef413f8a0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.998 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.995+0000 7f4efc54e640 1 --2- 172.21.15.131:0/249587931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4ee0003980 0x7f4ef40b6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:21.998 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.995+0000 7f4efc54e640 1 -- 172.21.15.131:0/249587931 >> 172.21.15.131:0/249587931 conn(0x7f4ef4071400 msgr2=0x7f4ef406e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:21.998 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.995+0000 7f4efc54e640 1 -- 172.21.15.131:0/249587931 shutdown_connections 2023-11-28T19:31:21.998 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:21.995+0000 7f4efc54e640 1 -- 172.21.15.131:0/249587931 wait complete. 2023-11-28T19:31:22.012 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new f4e1867f-6cc0-4017-b594-969b1f146bf1 5 2023-11-28T19:31:22.041 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:22.039+0000 7f4dab9e7180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T19:31:22.059 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:22.056+0000 7efeb3e66180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-11-28T19:31:22.097 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:22.095+0000 7f4dab9e7180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T19:31:22.115 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:22.112+0000 7efeb3e66180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-11-28T19:31:22.122 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661c3bc640 1 Processor -- start 2023-11-28T19:31:22.122 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661c3bc640 1 -- start start 2023-11-28T19:31:22.124 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661c3bc640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f66140ba4d0 0x7f661414c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.124 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661c3bc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140ba8b0 0x7f66141496e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.124 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661c3bc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f6614149c20 0x7f661406a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.124 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661c3bc640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661414cd40 con 0x7f6614149c20 2023-11-28T19:31:22.124 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661c3bc640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f661414a050 con 0x7f66140ba4d0 2023-11-28T19:31:22.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661c3bc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f661414cf40 con 0x7f66140ba8b0 2023-11-28T19:31:22.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661a158640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f66140ba4d0 0x7f661414c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f6619957640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140ba8b0 0x7f66141496e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.125 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661a158640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f66140ba4d0 0x7f661414c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35452/0 (socket says 172.21.15.131:35452) 2023-11-28T19:31:22.126 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661a158640 1 -- 172.21.15.131:0/1252653987 learned_addr learned my addr 172.21.15.131:0/1252653987 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-11-28T19:31:22.126 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661a959640 1 --2- 172.21.15.131:0/1252653987 >> v2:172.21.15.28:3300/0 conn(0x7f6614149c20 0x7f661406a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.126 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661a158640 1 -- 172.21.15.131:0/1252653987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140ba8b0 msgr2=0x7f66141496e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:22.126 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661a158640 1 --2- 172.21.15.131:0/1252653987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140ba8b0 0x7f66141496e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.126 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661a158640 1 -- 172.21.15.131:0/1252653987 >> v2:172.21.15.28:3300/0 conn(0x7f6614149c20 msgr2=0x7f661406a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:22.127 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661a158640 1 --2- 172.21.15.131:0/1252653987 >> v2:172.21.15.28:3300/0 conn(0x7f6614149c20 0x7f661406a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.127 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.119+0000 7f661a158640 1 -- 172.21.15.131:0/1252653987 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661414d220 con 0x7f66140ba4d0 2023-11-28T19:31:22.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f661a158640 1 --2- 172.21.15.131:0/1252653987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66140ba4d0 0x7f661414c800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f661406c360 tx=0x7f661001c240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=146364a1c13a5365 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:22.131 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f6619156640 1 -- 172.21.15.131:0/1252653987 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100ab600 con 0x7f66140ba4d0 2023-11-28T19:31:22.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f6619156640 1 -- 172.21.15.131:0/1252653987 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66100a7050 con 0x7f66140ba4d0 2023-11-28T19:31:22.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f6619156640 1 -- 172.21.15.131:0/1252653987 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100ab980 con 0x7f66140ba4d0 2023-11-28T19:31:22.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f661c3bc640 1 -- 172.21.15.131:0/1252653987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66140ba4d0 msgr2=0x7f661414c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f661c3bc640 1 --2- 172.21.15.131:0/1252653987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66140ba4d0 0x7f661414c800 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f661406c360 tx=0x7f661001c240 comp rx=0 tx=0).stop 2023-11-28T19:31:22.132 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f661c3bc640 1 -- 172.21.15.131:0/1252653987 shutdown_connections 2023-11-28T19:31:22.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f661c3bc640 1 --2- 172.21.15.131:0/1252653987 >> v2:172.21.15.28:3300/0 conn(0x7f6614149c20 0x7f661406a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f661c3bc640 1 --2- 172.21.15.131:0/1252653987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140ba8b0 0x7f66141496e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f661c3bc640 1 --2- 172.21.15.131:0/1252653987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66140ba4d0 0x7f661414c800 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f661c3bc640 1 -- 172.21.15.131:0/1252653987 >> 172.21.15.131:0/1252653987 conn(0x7f661406e7f0 msgr2=0x7f661406b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:22.133 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f661c3bc640 1 -- 172.21.15.131:0/1252653987 shutdown_connections 2023-11-28T19:31:22.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f661c3bc640 1 -- 172.21.15.131:0/1252653987 wait complete. 2023-11-28T19:31:22.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f661c3bc640 1 Processor -- start 2023-11-28T19:31:22.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f661c3bc640 1 -- start start 2023-11-28T19:31:22.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f661c3bc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66140ba4d0 0x7f66141e3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.134 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.123+0000 7f661c3bc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140ba8b0 0x7f661413a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661c3bc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6614149c20 0x7f66141dfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661c3bc640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6614144300 con 0x7f6614149c20 2023-11-28T19:31:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661c3bc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f661413aa40 con 0x7f66140ba4d0 2023-11-28T19:31:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661c3bc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6614134c50 con 0x7f66140ba8b0 2023-11-28T19:31:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661a158640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66140ba4d0 0x7f66141e3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.135 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f6619957640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140ba8b0 0x7f661413a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661a158640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66140ba4d0 0x7f66141e3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35462/0 (socket says 172.21.15.131:35462) 2023-11-28T19:31:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661a158640 1 -- 172.21.15.131:0/4106839205 learned_addr learned my addr 172.21.15.131:0/4106839205 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-11-28T19:31:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661a959640 1 --2- 172.21.15.131:0/4106839205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6614149c20 0x7f66141dfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661a158640 1 -- 172.21.15.131:0/4106839205 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140ba8b0 msgr2=0x7f661413a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.136 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661a158640 1 --2- 172.21.15.131:0/4106839205 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140ba8b0 0x7f661413a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661a158640 1 -- 172.21.15.131:0/4106839205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6614149c20 msgr2=0x7f66141dfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661a158640 1 --2- 172.21.15.131:0/4106839205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6614149c20 0x7f66141dfe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661a158640 1 -- 172.21.15.131:0/4106839205 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66100094d0 con 0x7f66140ba4d0 2023-11-28T19:31:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661a959640 1 --2- 172.21.15.131:0/4106839205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6614149c20 0x7f66141dfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661a158640 1 --2- 172.21.15.131:0/4106839205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66140ba4d0 0x7f66141e3f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f661001a8f0 tx=0x7f6610018fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:22.137 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f660affd640 1 -- 172.21.15.131:0/4106839205 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100b4420 con 0x7f66140ba4d0 2023-11-28T19:31:22.138 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f660affd640 1 -- 172.21.15.131:0/4106839205 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66100b4580 con 0x7f66140ba4d0 2023-11-28T19:31:22.138 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661c3bc640 1 -- 172.21.15.131:0/4106839205 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6614144fc0 con 0x7f66140ba4d0 2023-11-28T19:31:22.138 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f660affd640 1 -- 172.21.15.131:0/4106839205 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66100b48f0 con 0x7f66140ba4d0 2023-11-28T19:31:22.138 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661c3bc640 1 -- 172.21.15.131:0/4106839205 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66141e3440 con 0x7f66140ba4d0 2023-11-28T19:31:22.138 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f660affd640 1 -- 172.21.15.131:0/4106839205 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f66100b2070 con 0x7f66140ba4d0 2023-11-28T19:31:22.139 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f660affd640 1 -- 172.21.15.131:0/4106839205 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f66100b3940 con 0x7f66140ba4d0 2023-11-28T19:31:22.139 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f661c3bc640 1 -- 172.21.15.131:0/4106839205 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6614074a90 con 0x7f66140ba4d0 2023-11-28T19:31:22.139 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.127+0000 7f660affd640 1 -- 172.21.15.131:0/4106839205 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f66100ba070 con 0x7f66140ba4d0 2023-11-28T19:31:22.153 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:22.151+0000 7f4dab9e7180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T19:31:22.170 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:22.168+0000 7efeb3e66180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-11-28T19:31:22.195 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.191+0000 7f661c3bc640 1 -- 172.21.15.131:0/4106839205 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd new", "uuid": "f4e1867f-6cc0-4017-b594-969b1f146bf1", "id": 5} v 0) v1 -- 0x7f66140b6150 con 0x7f66140ba4d0 2023-11-28T19:31:22.200 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.199+0000 7f660affd640 1 -- 172.21.15.131:0/4106839205 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f4e1867f-6cc0-4017-b594-969b1f146bf1", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f66100b0070 con 0x7f66140ba4d0 2023-11-28T19:31:22.201 INFO:teuthology.orchestra.run.smithi131.stdout:5 2023-11-28T19:31:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.199+0000 7f661c3bc640 1 -- 172.21.15.131:0/4106839205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66140ba4d0 msgr2=0x7f66141e3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.199+0000 7f661c3bc640 1 --2- 172.21.15.131:0/4106839205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66140ba4d0 0x7f66141e3f20 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f661001a8f0 tx=0x7f6610018fe0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.202 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.199+0000 7f661c3bc640 1 -- 172.21.15.131:0/4106839205 shutdown_connections 2023-11-28T19:31:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.199+0000 7f661c3bc640 1 --2- 172.21.15.131:0/4106839205 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6614149c20 0x7f66141dfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.199+0000 7f661c3bc640 1 --2- 172.21.15.131:0/4106839205 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140ba8b0 0x7f661413a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.199+0000 7f661c3bc640 1 --2- 172.21.15.131:0/4106839205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66140ba4d0 0x7f66141e3f20 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.203 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.199+0000 7f661c3bc640 1 -- 172.21.15.131:0/4106839205 >> 172.21.15.131:0/4106839205 conn(0x7f661406e7f0 msgr2=0x7f66140b7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.199+0000 7f661c3bc640 1 -- 172.21.15.131:0/4106839205 shutdown_connections 2023-11-28T19:31:22.205 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.199+0000 7f661c3bc640 1 -- 172.21.15.131:0/4106839205 wait complete. 2023-11-28T19:31:22.216 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new d3038de4-3fa3-4d8c-b08f-5d0efbe6e467 6 2023-11-28T19:31:22.233 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:22.231+0000 7f4dab9e7180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T19:31:22.251 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:22.248+0000 7efeb3e66180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-11-28T19:31:22.287 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:22.283+0000 7f4dab9e7180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T19:31:22.305 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:22.304+0000 7efeb3e66180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-11-28T19:31:22.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.339+0000 7fe2ac7ff640 1 Processor -- start 2023-11-28T19:31:22.343 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.339+0000 7fe2ac7ff640 1 -- start start 2023-11-28T19:31:22.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.339+0000 7fe2ac7ff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe2a40bb2d0 0x7fe2a4071f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.339+0000 7fe2ac7ff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe2a4143020 0x7fe2a4143490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.339+0000 7fe2ac7ff640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2a40bb6f0 con 0x7fe2a40baa30 2023-11-28T19:31:22.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.339+0000 7fe2ac7ff640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a406f1e0 con 0x7fe2a40bb2d0 2023-11-28T19:31:22.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.339+0000 7fe2ac7ff640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2a41491d0 con 0x7fe2a4143020 2023-11-28T19:31:22.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.339+0000 7fe2aad9c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe2a4143020 0x7fe2a4143490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.344 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.339+0000 7fe2aad9c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe2a4143020 0x7fe2a4143490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35474/0 (socket says 172.21.15.131:35474) 2023-11-28T19:31:22.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.339+0000 7fe2aad9c640 1 -- 172.21.15.131:0/264795595 learned_addr learned my addr 172.21.15.131:0/264795595 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-11-28T19:31:22.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2a9d9a640 1 --2- 172.21.15.131:0/264795595 >> v2:172.21.15.28:3300/0 conn(0x7fe2a40bb2d0 0x7fe2a4071f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2aad9c640 1 -- 172.21.15.131:0/264795595 >> v2:172.21.15.28:3300/0 conn(0x7fe2a40bb2d0 msgr2=0x7fe2a4071f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:22.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2aad9c640 1 --2- 172.21.15.131:0/264795595 >> v2:172.21.15.28:3300/0 conn(0x7fe2a40bb2d0 0x7fe2a4071f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2aad9c640 1 -- 172.21.15.131:0/264795595 >> v1:172.21.15.28:6789/0 conn(0x7fe2a40baa30 legacy=0x7fe2a406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:22.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2aad9c640 1 -- 172.21.15.131:0/264795595 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2a40b5830 con 0x7fe2a4143020 2023-11-28T19:31:22.345 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2a9d9a640 1 --2- 172.21.15.131:0/264795595 >> v2:172.21.15.28:3300/0 conn(0x7fe2a40bb2d0 0x7fe2a4071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:22.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2aad9c640 1 --2- 172.21.15.131:0/264795595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a4143020 0x7fe2a4143490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4072720 tx=0x7fe29c01f180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96bcc3ee2ad6149b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:22.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2a9599640 1 -- 172.21.15.131:0/264795595 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c0af400 con 0x7fe2a4143020 2023-11-28T19:31:22.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2a9599640 1 -- 172.21.15.131:0/264795595 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c0ab050 con 0x7fe2a4143020 2023-11-28T19:31:22.346 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2a9599640 1 -- 172.21.15.131:0/264795595 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c0af780 con 0x7fe2a4143020 2023-11-28T19:31:22.347 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2ac7ff640 1 -- 172.21.15.131:0/264795595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a4143020 msgr2=0x7fe2a4143490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.347 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2ac7ff640 1 --2- 172.21.15.131:0/264795595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a4143020 0x7fe2a4143490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe2a4072720 tx=0x7fe29c01f180 comp rx=0 tx=0).stop 2023-11-28T19:31:22.347 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2ac7ff640 1 -- 172.21.15.131:0/264795595 shutdown_connections 2023-11-28T19:31:22.347 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2ac7ff640 1 --2- 172.21.15.131:0/264795595 >> v2:172.21.15.28:3300/0 conn(0x7fe2a40bb2d0 0x7fe2a4071f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.348 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2ac7ff640 1 --2- 172.21.15.131:0/264795595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a4143020 0x7fe2a4143490 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.348 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2ac7ff640 1 -- 172.21.15.131:0/264795595 >> 172.21.15.131:0/264795595 conn(0x7fe2a4071400 msgr2=0x7fe2a4071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:22.348 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2ac7ff640 1 -- 172.21.15.131:0/264795595 shutdown_connections 2023-11-28T19:31:22.348 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.343+0000 7fe2ac7ff640 1 -- 172.21.15.131:0/264795595 wait complete. 2023-11-28T19:31:22.350 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2ac7ff640 1 Processor -- start 2023-11-28T19:31:22.350 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2ac7ff640 1 -- start start 2023-11-28T19:31:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2ac7ff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2a40baa30 0x7fe2a4144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2ac7ff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a40bb2d0 0x7fe2a413e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2ac7ff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a4143020 0x7fe2a414a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2ac7ff640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a413e620 con 0x7fe2a40baa30 2023-11-28T19:31:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2ac7ff640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a41452a0 con 0x7fe2a40bb2d0 2023-11-28T19:31:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2ac7ff640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2a4143dc0 con 0x7fe2a4143020 2023-11-28T19:31:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2a9d9a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a40bb2d0 0x7fe2a413e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2aad9c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a4143020 0x7fe2a414a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2a9d9a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a40bb2d0 0x7fe2a413e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:35476/0 (socket says 172.21.15.131:35476) 2023-11-28T19:31:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2a9d9a640 1 -- 172.21.15.131:0/782950826 learned_addr learned my addr 172.21.15.131:0/782950826 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-11-28T19:31:22.351 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2aa59b640 1 --2- 172.21.15.131:0/782950826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2a40baa30 0x7fe2a4144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2aad9c640 1 -- 172.21.15.131:0/782950826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a40bb2d0 msgr2=0x7fe2a413e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2aad9c640 1 --2- 172.21.15.131:0/782950826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a40bb2d0 0x7fe2a413e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2aad9c640 1 -- 172.21.15.131:0/782950826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2a40baa30 msgr2=0x7fe2a4144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2aad9c640 1 --2- 172.21.15.131:0/782950826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2a40baa30 0x7fe2a4144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2aad9c640 1 -- 172.21.15.131:0/782950826 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe29c009b30 con 0x7fe2a4143020 2023-11-28T19:31:22.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2a9d9a640 1 --2- 172.21.15.131:0/782950826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a40bb2d0 0x7fe2a413e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:31:22.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2aa59b640 1 --2- 172.21.15.131:0/782950826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2a40baa30 0x7fe2a4144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:31:22.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2aad9c640 1 --2- 172.21.15.131:0/782950826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a4143020 0x7fe2a414a320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0ae000 tx=0x7fe29c01bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:22.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe296ffd640 1 -- 172.21.15.131:0/782950826 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c0afe40 con 0x7fe2a4143020 2023-11-28T19:31:22.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe296ffd640 1 -- 172.21.15.131:0/782950826 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe29c009510 con 0x7fe2a4143020 2023-11-28T19:31:22.352 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2ac7ff640 1 -- 172.21.15.131:0/782950826 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2a41440a0 con 0x7fe2a4143020 2023-11-28T19:31:22.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe296ffd640 1 -- 172.21.15.131:0/782950826 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe29c0ba660 con 0x7fe2a4143020 2023-11-28T19:31:22.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2ac7ff640 1 -- 172.21.15.131:0/782950826 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2a413e800 con 0x7fe2a4143020 2023-11-28T19:31:22.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe296ffd640 1 -- 172.21.15.131:0/782950826 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fe29c0b6040 con 0x7fe2a4143020 2023-11-28T19:31:22.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe296ffd640 1 -- 172.21.15.131:0/782950826 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fe29c0c3d10 con 0x7fe2a4143020 2023-11-28T19:31:22.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.347+0000 7fe2ac7ff640 1 -- 172.21.15.131:0/782950826 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2a4074a90 con 0x7fe2a4143020 2023-11-28T19:31:22.353 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.351+0000 7fe296ffd640 1 -- 172.21.15.131:0/782950826 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fe29c0c8060 con 0x7fe2a4143020 2023-11-28T19:31:22.368 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:22.367+0000 7f4dab9e7180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T19:31:22.386 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:22.384+0000 7efeb3e66180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-11-28T19:31:22.418 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.415+0000 7fe2ac7ff640 1 -- 172.21.15.131:0/782950826 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d3038de4-3fa3-4d8c-b08f-5d0efbe6e467", "id": 6} v 0) v1 -- 0x7fe2a4145c50 con 0x7fe2a4143020 2023-11-28T19:31:22.421 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:22.419+0000 7f4dab9e7180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T19:31:22.423 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.419+0000 7fe296ffd640 1 -- 172.21.15.131:0/782950826 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d3038de4-3fa3-4d8c-b08f-5d0efbe6e467", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fe29c0be070 con 0x7fe2a4143020 2023-11-28T19:31:22.423 INFO:teuthology.orchestra.run.smithi131.stdout:6 2023-11-28T19:31:22.425 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.423+0000 7fe2ac7ff640 1 -- 172.21.15.131:0/782950826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a4143020 msgr2=0x7fe2a414a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.425 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.423+0000 7fe2ac7ff640 1 --2- 172.21.15.131:0/782950826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a4143020 0x7fe2a414a320 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fe29c0ae000 tx=0x7fe29c01bf20 comp rx=0 tx=0).stop 2023-11-28T19:31:22.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.423+0000 7fe2ac7ff640 1 -- 172.21.15.131:0/782950826 shutdown_connections 2023-11-28T19:31:22.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.423+0000 7fe2ac7ff640 1 --2- 172.21.15.131:0/782950826 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe2a4143020 0x7fe2a414a320 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.423+0000 7fe2ac7ff640 1 --2- 172.21.15.131:0/782950826 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2a40bb2d0 0x7fe2a413e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.423+0000 7fe2ac7ff640 1 --2- 172.21.15.131:0/782950826 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2a40baa30 0x7fe2a4144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.423+0000 7fe2ac7ff640 1 -- 172.21.15.131:0/782950826 >> 172.21.15.131:0/782950826 conn(0x7fe2a4071400 msgr2=0x7fe2a406e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:22.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.423+0000 7fe2ac7ff640 1 -- 172.21.15.131:0/782950826 shutdown_connections 2023-11-28T19:31:22.426 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.423+0000 7fe2ac7ff640 1 -- 172.21.15.131:0/782950826 wait complete. 2023-11-28T19:31:22.442 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:22.440+0000 7efeb3e66180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-11-28T19:31:22.446 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd new 542040e3-4f8c-4a46-83bf-33a8f0964140 7 2023-11-28T19:31:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.559+0000 7fcc1f896640 1 Processor -- start 2023-11-28T19:31:22.563 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.559+0000 7fcc1f896640 1 -- start start 2023-11-28T19:31:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.559+0000 7fcc1f896640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcc1806f4d0 0x7fcc1814b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.559+0000 7fcc1f896640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc180bb3d0 0x7fcc18145040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.564 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.559+0000 7fcc1f896640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc180b43d0 con 0x7fcc18145580 2023-11-28T19:31:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.559+0000 7fcc1f896640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc180ba990 con 0x7fcc1806f4d0 2023-11-28T19:31:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.559+0000 7fcc1f896640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc180b3e80 con 0x7fcc180bb3d0 2023-11-28T19:31:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1ce31640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc180bb3d0 0x7fcc18145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1de33640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fcc18145580 0x7fcc1814e910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46282/0 (socket says 172.21.15.131:46282) 2023-11-28T19:31:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1de33640 1 -- 172.21.15.131:0/1776351533 learned_addr learned my addr 172.21.15.131:0/1776351533 (peer_addr_for_me v1:172.21.15.131:0/0) 2023-11-28T19:31:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1d632640 1 --2- 172.21.15.131:0/1776351533 >> v2:172.21.15.28:3300/0 conn(0x7fcc1806f4d0 0x7fcc1814b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc0ffff640 1 -- 172.21.15.131:0/1776351533 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474582921 0 0) 0x7fcc180b43d0 con 0x7fcc18145580 2023-11-28T19:31:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1ce31640 1 -- 172.21.15.131:0/1776351533 >> v2:172.21.15.28:3300/0 conn(0x7fcc1806f4d0 msgr2=0x7fcc1814b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1ce31640 1 --2- 172.21.15.131:0/1776351533 >> v2:172.21.15.28:3300/0 conn(0x7fcc1806f4d0 0x7fcc1814b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1ce31640 1 -- 172.21.15.131:0/1776351533 >> v1:172.21.15.131:6789/0 conn(0x7fcc18145580 legacy=0x7fcc1814e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.565 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1ce31640 1 -- 172.21.15.131:0/1776351533 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc180670d0 con 0x7fcc180bb3d0 2023-11-28T19:31:22.566 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1ce31640 1 --2- 172.21.15.131:0/1776351533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc180bb3d0 0x7fcc18145040 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcc080097c0 tx=0x7fcc0801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9552d4a00cc1baf6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:22.567 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc0ffff640 1 -- 172.21.15.131:0/1776351533 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc080ab600 con 0x7fcc180bb3d0 2023-11-28T19:31:22.567 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc0ffff640 1 -- 172.21.15.131:0/1776351533 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc080a7050 con 0x7fcc180bb3d0 2023-11-28T19:31:22.567 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc0ffff640 1 -- 172.21.15.131:0/1776351533 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc080ab980 con 0x7fcc180bb3d0 2023-11-28T19:31:22.568 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1f896640 1 -- 172.21.15.131:0/1776351533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc180bb3d0 msgr2=0x7fcc18145040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.568 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1f896640 1 --2- 172.21.15.131:0/1776351533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc180bb3d0 0x7fcc18145040 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fcc080097c0 tx=0x7fcc0801c3f0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.568 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1f896640 1 -- 172.21.15.131:0/1776351533 shutdown_connections 2023-11-28T19:31:22.568 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1f896640 1 --2- 172.21.15.131:0/1776351533 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc180bb3d0 0x7fcc18145040 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.568 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1f896640 1 --2- 172.21.15.131:0/1776351533 >> v2:172.21.15.28:3300/0 conn(0x7fcc1806f4d0 0x7fcc1814b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.568 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1f896640 1 -- 172.21.15.131:0/1776351533 >> 172.21.15.131:0/1776351533 conn(0x7fcc18071400 msgr2=0x7fcc18071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:22.568 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1f896640 1 -- 172.21.15.131:0/1776351533 shutdown_connections 2023-11-28T19:31:22.568 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.563+0000 7fcc1f896640 1 -- 172.21.15.131:0/1776351533 wait complete. 2023-11-28T19:31:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1f896640 1 Processor -- start 2023-11-28T19:31:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1f896640 1 -- start start 2023-11-28T19:31:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1f896640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc1806f4d0 0x7fcc181494d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1f896640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc180bb3d0 0x7fcc1814a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1f896640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc18145580 0x7fcc181e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.571 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1f896640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc181e3be0 con 0x7fcc18145580 2023-11-28T19:31:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1f896640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc18149a10 con 0x7fcc180bb3d0 2023-11-28T19:31:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1f896640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc18148760 con 0x7fcc1806f4d0 2023-11-28T19:31:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1d632640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc1806f4d0 0x7fcc181494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1ce31640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc180bb3d0 0x7fcc1814a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1d632640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc1806f4d0 0x7fcc181494d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.131:49010/0 (socket says 172.21.15.131:49010) 2023-11-28T19:31:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1d632640 1 -- 172.21.15.131:0/4107911931 learned_addr learned my addr 172.21.15.131:0/4107911931 (peer_addr_for_me v2:172.21.15.131:0/0) 2023-11-28T19:31:22.572 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1de33640 1 --2- 172.21.15.131:0/4107911931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc18145580 0x7fcc181e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1d632640 1 -- 172.21.15.131:0/4107911931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc180bb3d0 msgr2=0x7fcc1814a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1d632640 1 --2- 172.21.15.131:0/4107911931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc180bb3d0 0x7fcc1814a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1d632640 1 -- 172.21.15.131:0/4107911931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc18145580 msgr2=0x7fcc181e40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1d632640 1 --2- 172.21.15.131:0/4107911931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc18145580 0x7fcc181e40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1d632640 1 -- 172.21.15.131:0/4107911931 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc08009420 con 0x7fcc1806f4d0 2023-11-28T19:31:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1ce31640 1 --2- 172.21.15.131:0/4107911931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc180bb3d0 0x7fcc1814a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:31:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1d632640 1 --2- 172.21.15.131:0/4107911931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc1806f4d0 0x7fcc181494d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400d800 tx=0x7fcc1400dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc0dffb640 1 -- 172.21.15.131:0/4107911931 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400b6c0 con 0x7fcc1806f4d0 2023-11-28T19:31:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc0dffb640 1 -- 172.21.15.131:0/4107911931 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc1400b820 con 0x7fcc1806f4d0 2023-11-28T19:31:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1f896640 1 -- 172.21.15.131:0/4107911931 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc18148a40 con 0x7fcc1806f4d0 2023-11-28T19:31:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc0dffb640 1 -- 172.21.15.131:0/4107911931 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc1400bb90 con 0x7fcc1806f4d0 2023-11-28T19:31:22.573 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1f896640 1 -- 172.21.15.131:0/4107911931 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc1814a980 con 0x7fcc1806f4d0 2023-11-28T19:31:22.574 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc0dffb640 1 -- 172.21.15.131:0/4107911931 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fcc1401e460 con 0x7fcc1806f4d0 2023-11-28T19:31:22.574 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc0dffb640 1 -- 172.21.15.131:0/4107911931 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fcc14014c20 con 0x7fcc1806f4d0 2023-11-28T19:31:22.574 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.567+0000 7fcc1f896640 1 -- 172.21.15.131:0/4107911931 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc18148590 con 0x7fcc1806f4d0 2023-11-28T19:31:22.574 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.571+0000 7fcc0dffb640 1 -- 172.21.15.131:0/4107911931 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fcc140145c0 con 0x7fcc1806f4d0 2023-11-28T19:31:22.574 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:22.571+0000 7f4dab9e7180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T19:31:22.588 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:22.584+0000 7efeb3e66180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-11-28T19:31:22.635 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:22.631+0000 7f4dab9e7180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T19:31:22.640 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.639+0000 7fcc1f896640 1 -- 172.21.15.131:0/4107911931 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd new", "uuid": "542040e3-4f8c-4a46-83bf-33a8f0964140", "id": 7} v 0) v1 -- 0x7fcc18074a90 con 0x7fcc1806f4d0 2023-11-28T19:31:22.646 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.643+0000 7fcc0dffb640 1 -- 172.21.15.131:0/4107911931 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "542040e3-4f8c-4a46-83bf-33a8f0964140", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcc14014760 con 0x7fcc1806f4d0 2023-11-28T19:31:22.646 INFO:teuthology.orchestra.run.smithi131.stdout:7 2023-11-28T19:31:22.647 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.643+0000 7fcc1f896640 1 -- 172.21.15.131:0/4107911931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc1806f4d0 msgr2=0x7fcc181494d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.648 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.643+0000 7fcc1f896640 1 --2- 172.21.15.131:0/4107911931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc1806f4d0 0x7fcc181494d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fcc1400d800 tx=0x7fcc1400dcc0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.648 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.643+0000 7fcc1f896640 1 -- 172.21.15.131:0/4107911931 shutdown_connections 2023-11-28T19:31:22.648 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.643+0000 7fcc1f896640 1 --2- 172.21.15.131:0/4107911931 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcc18145580 0x7fcc181e40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.648 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.643+0000 7fcc1f896640 1 --2- 172.21.15.131:0/4107911931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc180bb3d0 0x7fcc1814a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.648 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.643+0000 7fcc1f896640 1 --2- 172.21.15.131:0/4107911931 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcc1806f4d0 0x7fcc181494d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.648 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.643+0000 7fcc1f896640 1 -- 172.21.15.131:0/4107911931 >> 172.21.15.131:0/4107911931 conn(0x7fcc18071400 msgr2=0x7fcc18143e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:22.648 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.643+0000 7fcc1f896640 1 -- 172.21.15.131:0/4107911931 shutdown_connections 2023-11-28T19:31:22.648 INFO:teuthology.orchestra.run.smithi131.stderr:2023-11-28T19:31:22.643+0000 7fcc1f896640 1 -- 172.21.15.131:0/4107911931 wait complete. 2023-11-28T19:31:22.651 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:22.648+0000 7efeb3e66180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-11-28T19:31:22.663 INFO:tasks.ceph.osd.0:Restarting daemon 2023-11-28T19:31:22.663 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-11-28T19:31:22.665 INFO:tasks.ceph.osd.0:Started 2023-11-28T19:31:22.666 INFO:tasks.ceph.osd.1:Restarting daemon 2023-11-28T19:31:22.666 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-11-28T19:31:22.668 INFO:tasks.ceph.osd.1:Started 2023-11-28T19:31:22.668 INFO:tasks.ceph.osd.2:Restarting daemon 2023-11-28T19:31:22.668 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-11-28T19:31:22.671 INFO:tasks.ceph.osd.2:Started 2023-11-28T19:31:22.671 INFO:tasks.ceph.osd.3:Restarting daemon 2023-11-28T19:31:22.671 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-11-28T19:31:22.673 INFO:tasks.ceph.osd.3:Started 2023-11-28T19:31:22.674 INFO:tasks.ceph.osd.4:Restarting daemon 2023-11-28T19:31:22.674 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-11-28T19:31:22.676 INFO:tasks.ceph.osd.4:Started 2023-11-28T19:31:22.676 INFO:tasks.ceph.osd.5:Restarting daemon 2023-11-28T19:31:22.676 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-11-28T19:31:22.678 INFO:tasks.ceph.osd.5:Started 2023-11-28T19:31:22.678 INFO:tasks.ceph.osd.6:Restarting daemon 2023-11-28T19:31:22.678 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-11-28T19:31:22.681 INFO:tasks.ceph.osd.6:Started 2023-11-28T19:31:22.681 INFO:tasks.ceph.osd.7:Restarting daemon 2023-11-28T19:31:22.682 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-11-28T19:31:22.684 INFO:tasks.ceph.osd.7:Started 2023-11-28T19:31:22.685 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:22.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25ac983640 1 Processor -- start 2023-11-28T19:31:22.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25ac983640 1 -- start start 2023-11-28T19:31:22.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25ac983640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f25a80bb380 0x7f25a80b7d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25ac983640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f25a80b8280 0x7f25a8153b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25ac983640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a8149ce0 con 0x7f25a80b8db0 2023-11-28T19:31:22.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25ac983640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a806e610 con 0x7f25a80bb380 2023-11-28T19:31:22.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25ac983640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a81493f0 con 0x7f25a80b8280 2023-11-28T19:31:22.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25a5d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f25a80bb380 0x7f25a80b7d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25a5d9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f25a80bb380 0x7f25a80b7d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35508/0 (socket says 172.21.15.28:35508) 2023-11-28T19:31:22.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25a5d9b640 1 -- 172.21.15.28:0/1891946278 learned_addr learned my addr 172.21.15.28:0/1891946278 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:22.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25a6d9d640 1 --2- 172.21.15.28:0/1891946278 >> v2:172.21.15.131:3300/0 conn(0x7f25a80b8280 0x7f25a8153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25a5d9b640 1 -- 172.21.15.28:0/1891946278 >> v2:172.21.15.131:3300/0 conn(0x7f25a80b8280 msgr2=0x7f25a8153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:22.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25a5d9b640 1 --2- 172.21.15.28:0/1891946278 >> v2:172.21.15.131:3300/0 conn(0x7f25a80b8280 0x7f25a8153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25a5d9b640 1 -- 172.21.15.28:0/1891946278 >> v1:172.21.15.131:6789/0 conn(0x7f25a80b8db0 legacy=0x7f25a806df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25a5d9b640 1 -- 172.21.15.28:0/1891946278 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8149690 con 0x7f25a80bb380 2023-11-28T19:31:22.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.804+0000 7f25a559a640 1 -- 172.21.15.28:0/1891946278 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3475321661 0 0) 0x7f25a8149ce0 con 0x7f25a80b8db0 2023-11-28T19:31:22.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.808+0000 7f25a5d9b640 1 --2- 172.21.15.28:0/1891946278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25a80bb380 0x7f25a80b7d40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f25a80b60a0 tx=0x7f259801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4212de94c15b9ecc server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.808+0000 7f25a559a640 1 -- 172.21.15.28:0/1891946278 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980ab660 con 0x7f25a80bb380 2023-11-28T19:31:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.808+0000 7f25a559a640 1 -- 172.21.15.28:0/1891946278 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25980ab7c0 con 0x7f25a80bb380 2023-11-28T19:31:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.808+0000 7f25a559a640 1 -- 172.21.15.28:0/1891946278 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980abb50 con 0x7f25a80bb380 2023-11-28T19:31:22.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.808+0000 7f25ac983640 1 -- 172.21.15.28:0/1891946278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25a80bb380 msgr2=0x7f25a80b7d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.808+0000 7f25ac983640 1 --2- 172.21.15.28:0/1891946278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25a80bb380 0x7f25a80b7d40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f25a80b60a0 tx=0x7f259801c440 comp rx=0 tx=0).stop 2023-11-28T19:31:22.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.808+0000 7f25ac983640 1 -- 172.21.15.28:0/1891946278 shutdown_connections 2023-11-28T19:31:22.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.808+0000 7f25ac983640 1 --2- 172.21.15.28:0/1891946278 >> v2:172.21.15.131:3300/0 conn(0x7f25a80b8280 0x7f25a8153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.808+0000 7f25ac983640 1 --2- 172.21.15.28:0/1891946278 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25a80bb380 0x7f25a80b7d40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.808+0000 7f25ac983640 1 -- 172.21.15.28:0/1891946278 >> 172.21.15.28:0/1891946278 conn(0x7f25a80bed00 msgr2=0x7f25a80bf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:22.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.808+0000 7f25ac983640 1 -- 172.21.15.28:0/1891946278 shutdown_connections 2023-11-28T19:31:22.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.808+0000 7f25ac983640 1 -- 172.21.15.28:0/1891946278 wait complete. 2023-11-28T19:31:22.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.808+0000 7f25ac983640 1 Processor -- start 2023-11-28T19:31:22.813 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.808+0000 7f25ac983640 1 -- start start 2023-11-28T19:31:22.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25ac983640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25a80b8280 0x7f25a80bce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25ac983640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25a80b8db0 0x7f25a806b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25ac983640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25a80bb380 0x7f25a806bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:22.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25ac983640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a80bd3c0 con 0x7f25a80bb380 2023-11-28T19:31:22.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25ac983640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a8132a60 con 0x7f25a80b8db0 2023-11-28T19:31:22.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25ac983640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a8132cb0 con 0x7f25a80b8280 2023-11-28T19:31:22.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25a6d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25a80bb380 0x7f25a806bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25a6d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25a80bb380 0x7f25a806bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35522/0 (socket says 172.21.15.28:35522) 2023-11-28T19:31:22.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25a6d9d640 1 -- 172.21.15.28:0/3596276307 learned_addr learned my addr 172.21.15.28:0/3596276307 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:22.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25a5d9b640 1 --2- 172.21.15.28:0/3596276307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25a80b8db0 0x7f25a806b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25a659c640 1 --2- 172.21.15.28:0/3596276307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25a80b8280 0x7f25a80bce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:22.815 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25a6d9d640 1 -- 172.21.15.28:0/3596276307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25a80b8280 msgr2=0x7f25a80bce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25a6d9d640 1 --2- 172.21.15.28:0/3596276307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25a80b8280 0x7f25a80bce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25a6d9d640 1 -- 172.21.15.28:0/3596276307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25a80b8db0 msgr2=0x7f25a806b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25a6d9d640 1 --2- 172.21.15.28:0/3596276307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25a80b8db0 0x7f25a806b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25a6d9d640 1 -- 172.21.15.28:0/3596276307 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25980094d0 con 0x7f25a80bb380 2023-11-28T19:31:22.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25a659c640 1 --2- 172.21.15.28:0/3596276307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25a80b8280 0x7f25a80bce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:31:22.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25a6d9d640 1 --2- 172.21.15.28:0/3596276307 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25a80bb380 0x7f25a806bd80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f25a000ef90 tx=0x7f25a000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:22.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f2596ffd640 1 -- 172.21.15.28:0/3596276307 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0009ca0 con 0x7f25a80bb380 2023-11-28T19:31:22.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f2596ffd640 1 -- 172.21.15.28:0/3596276307 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a000f040 con 0x7f25a80bb380 2023-11-28T19:31:22.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25ac983640 1 -- 172.21.15.28:0/3596276307 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a8152fb0 con 0x7f25a80bb380 2023-11-28T19:31:22.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f2596ffd640 1 -- 172.21.15.28:0/3596276307 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a00146c0 con 0x7f25a80bb380 2023-11-28T19:31:22.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25ac983640 1 -- 172.21.15.28:0/3596276307 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a80bea90 con 0x7f25a80bb380 2023-11-28T19:31:22.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f2596ffd640 1 -- 172.21.15.28:0/3596276307 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f25a0014b20 con 0x7f25a80bb380 2023-11-28T19:31:22.816 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f2596ffd640 1 -- 172.21.15.28:0/3596276307 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f25a001dcc0 con 0x7f25a80bb380 2023-11-28T19:31:22.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.812+0000 7f25ac983640 1 -- 172.21.15.28:0/3596276307 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a8133640 con 0x7f25a80bb380 2023-11-28T19:31:22.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.820+0000 7f2596ffd640 1 -- 172.21.15.28:0/3596276307 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f25a003bce0 con 0x7f25a80bb380 2023-11-28T19:31:22.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.876+0000 7f25ac983640 1 -- 172.21.15.28:0/3596276307 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25a8074a90 con 0x7f25a80bb380 2023-11-28T19:31:22.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.880+0000 7f2596ffd640 1 -- 172.21.15.28:0/3596276307 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f25a002a070 con 0x7f25a80bb380 2023-11-28T19:31:22.882 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:22.882 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":10,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:22.643528+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:22.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.880+0000 7f25ac983640 1 -- 172.21.15.28:0/3596276307 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25a80bb380 msgr2=0x7f25a806bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:22.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.880+0000 7f25ac983640 1 --2- 172.21.15.28:0/3596276307 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25a80bb380 0x7f25a806bd80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f25a000ef90 tx=0x7f25a000c490 comp rx=0 tx=0).stop 2023-11-28T19:31:22.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.880+0000 7f25ac983640 1 -- 172.21.15.28:0/3596276307 shutdown_connections 2023-11-28T19:31:22.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.880+0000 7f25ac983640 1 --2- 172.21.15.28:0/3596276307 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25a80bb380 0x7f25a806bd80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.880+0000 7f25ac983640 1 --2- 172.21.15.28:0/3596276307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f25a80b8db0 0x7f25a806b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.880+0000 7f25ac983640 1 --2- 172.21.15.28:0/3596276307 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25a80b8280 0x7f25a80bce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:22.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.880+0000 7f25ac983640 1 -- 172.21.15.28:0/3596276307 >> 172.21.15.28:0/3596276307 conn(0x7f25a80bed00 msgr2=0x7f25a8148320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:22.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.880+0000 7f25ac983640 1 -- 172.21.15.28:0/3596276307 shutdown_connections 2023-11-28T19:31:22.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:22.880+0000 7f25ac983640 1 -- 172.21.15.28:0/3596276307 wait complete. 2023-11-28T19:31:22.899 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-11-28T19:31:22.899 INFO:tasks.ceph:Waiting for OSDs to come up 2023-11-28T19:31:23.284 INFO:tasks.ceph.mgr.x.smithi131.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T19:31:23.284 INFO:tasks.ceph.mgr.x.smithi131.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T19:31:23.284 INFO:tasks.ceph.mgr.x.smithi131.stderr: from numpy import show_config as show_numpy_config 2023-11-28T19:31:23.297 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-11-28T19:31:23.295+0000 7f2195bab640 -1 Falling back to public interface 2023-11-28T19:31:23.298 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-11-28T19:31:23.295+0000 7fb3400e5640 -1 Falling back to public interface 2023-11-28T19:31:23.311 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-11-28T19:31:23.308+0000 7f75e16be640 -1 Falling back to public interface 2023-11-28T19:31:23.311 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-11-28T19:31:23.308+0000 7fc01e919640 -1 Falling back to public interface 2023-11-28T19:31:23.312 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-11-28T19:31:23.311+0000 7faeb339b640 -1 Falling back to public interface 2023-11-28T19:31:23.322 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:23.319+0000 7f4dab9e7180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T19:31:23.324 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-11-28T19:31:23.323+0000 7f23bf907640 -1 Falling back to public interface 2023-11-28T19:31:23.326 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-11-28T19:31:23.324+0000 7f96cbe94640 -1 Falling back to public interface 2023-11-28T19:31:23.326 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-11-28T19:31:23.324+0000 7fb9e59c3640 -1 Falling back to public interface 2023-11-28T19:31:23.365 INFO:tasks.ceph.mgr.y.smithi028.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-11-28T19:31:23.365 INFO:tasks.ceph.mgr.y.smithi028.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-11-28T19:31:23.365 INFO:tasks.ceph.mgr.y.smithi028.stderr: from numpy import show_config as show_numpy_config 2023-11-28T19:31:23.404 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:23.400+0000 7efeb3e66180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-11-28T19:31:23.448 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:23.443+0000 7f4dab9e7180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T19:31:23.548 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:23.544+0000 7efeb3e66180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-11-28T19:31:23.607 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:23.603+0000 7f4dab9e7180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T19:31:23.676 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:23.671+0000 7f4dab9e7180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T19:31:23.705 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:23.711 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:23.708+0000 7efeb3e66180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-11-28T19:31:23.784 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:23.780+0000 7efeb3e66180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-11-28T19:31:23.806 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:23.803+0000 7f4dab9e7180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T19:31:23.817 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee3e9d640 1 Processor -- start 2023-11-28T19:31:23.817 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee3e9d640 1 -- start start 2023-11-28T19:31:23.818 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee3e9d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc143440 0x7f0edc070c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:23.818 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee3e9d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0edc0666e0 0x7f0edc153a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:23.818 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee3e9d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0edc0702f0 con 0x7f0edc0662a0 2023-11-28T19:31:23.818 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee3e9d640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0edc06bcf0 con 0x7f0edc0666e0 2023-11-28T19:31:23.818 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee3e9d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc143820 con 0x7f0edc143440 2023-11-28T19:31:23.819 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee243a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0edc0666e0 0x7f0edc153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:23.819 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee1c39640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc143440 0x7f0edc070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:23.819 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee1c39640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc143440 0x7f0edc070c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:54304/0 (socket says 172.21.15.28:54304) 2023-11-28T19:31:23.820 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee243a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0edc0666e0 0x7f0edc153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:46938/0 (socket says 172.21.15.28:46938) 2023-11-28T19:31:23.820 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee1c39640 1 -- 172.21.15.28:0/791463055 learned_addr learned my addr 172.21.15.28:0/791463055 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:23.820 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee1438640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f0edc0662a0 0x7f0edc14c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:55696/0 (socket says 172.21.15.28:55696) 2023-11-28T19:31:23.820 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee1c39640 1 -- 172.21.15.28:0/791463055 >> v2:172.21.15.131:3300/0 conn(0x7f0edc0666e0 msgr2=0x7f0edc153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:23.820 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee1c39640 1 --2- 172.21.15.28:0/791463055 >> v2:172.21.15.131:3300/0 conn(0x7f0edc0666e0 0x7f0edc153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:23.820 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee1c39640 1 -- 172.21.15.28:0/791463055 >> v1:172.21.15.131:6789/0 conn(0x7f0edc0662a0 legacy=0x7f0edc14c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:23.820 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee1c39640 1 -- 172.21.15.28:0/791463055 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc0b6c90 con 0x7f0edc143440 2023-11-28T19:31:23.820 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.816+0000 7f0ee243a640 1 --2- 172.21.15.28:0/791463055 >> v2:172.21.15.131:3300/0 conn(0x7f0edc0666e0 0x7f0edc153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:31:23.821 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee1c39640 1 --2- 172.21.15.28:0/791463055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc143440 0x7f0edc070c60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8009e50 tx=0x7f0ed801c9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6925dc12c4be6e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:23.822 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee0c37640 1 -- 172.21.15.28:0/791463055 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80a58a0 con 0x7f0edc143440 2023-11-28T19:31:23.822 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee0c37640 1 -- 172.21.15.28:0/791463055 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed80a5a00 con 0x7f0edc143440 2023-11-28T19:31:23.822 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee0c37640 1 -- 172.21.15.28:0/791463055 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80a5d90 con 0x7f0edc143440 2023-11-28T19:31:23.823 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 -- 172.21.15.28:0/791463055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc143440 msgr2=0x7f0edc070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:23.823 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 --2- 172.21.15.28:0/791463055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc143440 0x7f0edc070c60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8009e50 tx=0x7f0ed801c9e0 comp rx=0 tx=0).stop 2023-11-28T19:31:23.823 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 -- 172.21.15.28:0/791463055 shutdown_connections 2023-11-28T19:31:23.823 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 --2- 172.21.15.28:0/791463055 >> v2:172.21.15.131:3300/0 conn(0x7f0edc0666e0 0x7f0edc153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:23.823 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 --2- 172.21.15.28:0/791463055 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc143440 0x7f0edc070c60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:23.823 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 -- 172.21.15.28:0/791463055 >> 172.21.15.28:0/791463055 conn(0x7f0edc06a5b0 msgr2=0x7f0edc06a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:23.823 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 -- 172.21.15.28:0/791463055 shutdown_connections 2023-11-28T19:31:23.823 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 -- 172.21.15.28:0/791463055 wait complete. 2023-11-28T19:31:23.824 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 Processor -- start 2023-11-28T19:31:23.824 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 -- start start 2023-11-28T19:31:23.826 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0edc0662a0 0x7f0edc0b8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:23.826 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0edc0666e0 0x7f0edc14e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:23.826 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc143440 0x7f0edc1395e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:23.826 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0b9c90 con 0x7f0edc0662a0 2023-11-28T19:31:23.826 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc14df00 con 0x7f0edc0666e0 2023-11-28T19:31:23.827 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee3e9d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0edc0b9780 con 0x7f0edc143440 2023-11-28T19:31:23.827 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee1c39640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0edc0662a0 0x7f0edc0b8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:23.827 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee1c39640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0edc0662a0 0x7f0edc0b8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:35536/0 (socket says 172.21.15.28:35536) 2023-11-28T19:31:23.827 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.820+0000 7f0ee1c39640 1 -- 172.21.15.28:0/215319162 learned_addr learned my addr 172.21.15.28:0/215319162 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:23.827 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ee1438640 1 --2- 172.21.15.28:0/215319162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0edc0666e0 0x7f0edc14e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:23.827 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ee243a640 1 --2- 172.21.15.28:0/215319162 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc143440 0x7f0edc1395e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:23.827 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ee1c39640 1 -- 172.21.15.28:0/215319162 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc143440 msgr2=0x7f0edc1395e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:23.827 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ee1c39640 1 --2- 172.21.15.28:0/215319162 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc143440 0x7f0edc1395e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:23.827 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ee1c39640 1 -- 172.21.15.28:0/215319162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0edc0666e0 msgr2=0x7f0edc14e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:23.827 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ee1c39640 1 --2- 172.21.15.28:0/215319162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0edc0666e0 0x7f0edc14e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:23.827 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ee1c39640 1 -- 172.21.15.28:0/215319162 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed4009420 con 0x7f0edc0662a0 2023-11-28T19:31:23.828 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ee1c39640 1 --2- 172.21.15.28:0/215319162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0edc0662a0 0x7f0edc0b8a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0ed801a610 tx=0x7f0ed8019780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:23.828 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ed27fc640 1 -- 172.21.15.28:0/215319162 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80b8670 con 0x7f0edc0662a0 2023-11-28T19:31:23.828 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ed27fc640 1 -- 172.21.15.28:0/215319162 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ed80b87f0 con 0x7f0edc0662a0 2023-11-28T19:31:23.828 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ee3e9d640 1 -- 172.21.15.28:0/215319162 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ed8009b30 con 0x7f0edc0662a0 2023-11-28T19:31:23.828 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ed27fc640 1 -- 172.21.15.28:0/215319162 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80b8ba0 con 0x7f0edc0662a0 2023-11-28T19:31:23.828 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ee3e9d640 1 -- 172.21.15.28:0/215319162 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0edc14e9e0 con 0x7f0edc0662a0 2023-11-28T19:31:23.828 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ed27fc640 1 -- 172.21.15.28:0/215319162 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0ed80c1400 con 0x7f0edc0662a0 2023-11-28T19:31:23.828 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ed27fc640 1 -- 172.21.15.28:0/215319162 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0ed80b6b10 con 0x7f0edc0662a0 2023-11-28T19:31:23.828 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.824+0000 7f0ee3e9d640 1 -- 172.21.15.28:0/215319162 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0edc14e1e0 con 0x7f0edc0662a0 2023-11-28T19:31:23.829 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.828+0000 7f0ed27fc640 1 -- 172.21.15.28:0/215319162 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f0ed80dfce0 con 0x7f0edc0662a0 2023-11-28T19:31:23.887 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.884+0000 7f0ee3e9d640 1 -- 172.21.15.28:0/215319162 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0edc067c10 con 0x7f0edc0662a0 2023-11-28T19:31:23.888 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.884+0000 7f0ed27fc640 1 -- 172.21.15.28:0/215319162 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0ed80ce030 con 0x7f0edc0662a0 2023-11-28T19:31:23.888 INFO:teuthology.misc.health.smithi028.stdout: 2023-11-28T19:31:23.888 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":10,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:22.643528+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:23.889 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.884+0000 7f0ee3e9d640 1 -- 172.21.15.28:0/215319162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0edc0662a0 msgr2=0x7f0edc0b8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:23.889 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.884+0000 7f0ee3e9d640 1 --2- 172.21.15.28:0/215319162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0edc0662a0 0x7f0edc0b8a00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f0ed801a610 tx=0x7f0ed8019780 comp rx=0 tx=0).stop 2023-11-28T19:31:23.889 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.888+0000 7f0ee3e9d640 1 -- 172.21.15.28:0/215319162 shutdown_connections 2023-11-28T19:31:23.890 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.888+0000 7f0ee3e9d640 1 --2- 172.21.15.28:0/215319162 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0edc143440 0x7f0edc1395e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:23.890 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.888+0000 7f0ee3e9d640 1 --2- 172.21.15.28:0/215319162 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0edc0666e0 0x7f0edc14e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:23.890 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.888+0000 7f0ee3e9d640 1 --2- 172.21.15.28:0/215319162 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0edc0662a0 0x7f0edc0b8a00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:23.890 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.888+0000 7f0ee3e9d640 1 -- 172.21.15.28:0/215319162 >> 172.21.15.28:0/215319162 conn(0x7f0edc06a5b0 msgr2=0x7f0edc142420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:23.890 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.888+0000 7f0ee3e9d640 1 -- 172.21.15.28:0/215319162 shutdown_connections 2023-11-28T19:31:23.890 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:23.888+0000 7f0ee3e9d640 1 -- 172.21.15.28:0/215319162 wait complete. 2023-11-28T19:31:23.905 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T19:31:23.927 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:23.924+0000 7efeb3e66180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-11-28T19:31:24.422 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:24.419+0000 7f4dab9e7180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T19:31:24.497 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:24.495+0000 7f4dab9e7180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T19:31:24.562 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:24.560+0000 7efeb3e66180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-11-28T19:31:24.640 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:24.636+0000 7efeb3e66180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-11-28T19:31:24.668 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:24.667+0000 7f4dab9e7180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T19:31:24.742 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:24.739+0000 7f4dab9e7180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T19:31:24.819 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:24.816+0000 7efeb3e66180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-11-28T19:31:24.896 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:24.892+0000 7efeb3e66180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-11-28T19:31:25.030 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:25.027+0000 7f4dab9e7180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T19:31:25.092 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:25.087+0000 7f4dab9e7180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T19:31:25.203 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:25.200+0000 7efeb3e66180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-11-28T19:31:25.265 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-28T19:31:25.260+0000 7efeb3e66180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-11-28T19:31:26.133 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:26.131+0000 7f4d53271640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-11-28T19:31:26.134 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-28T19:31:26.131+0000 7f4d53271640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-11-28T19:31:27.168 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-11-28T19:31:27.167+0000 7fb3400e5640 -1 osd.7 0 log_to_monitors true 2023-11-28T19:31:27.189 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-11-28T19:31:27.183+0000 7f75e16be640 -1 osd.3 0 log_to_monitors true 2023-11-28T19:31:27.202 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-11-28T19:31:27.199+0000 7fc01e919640 -1 osd.1 0 log_to_monitors true 2023-11-28T19:31:27.203 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-11-28T19:31:27.199+0000 7f23bf907640 -1 osd.4 0 log_to_monitors true 2023-11-28T19:31:27.223 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-11-28T19:31:27.219+0000 7f96cbe94640 -1 osd.2 0 log_to_monitors true 2023-11-28T19:31:27.229 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-11-28T19:31:27.223+0000 7fb9e59c3640 -1 osd.0 0 log_to_monitors true 2023-11-28T19:31:27.287 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-11-28T19:31:27.283+0000 7faeb339b640 -1 osd.6 0 log_to_monitors true 2023-11-28T19:31:27.290 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-11-28T19:31:27.287+0000 7f2195bab640 -1 osd.5 0 log_to_monitors true 2023-11-28T19:31:30.713 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:30.747 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-11-28T19:31:30.743+0000 7f96c761a640 -1 osd.2 0 waiting for initial osdmap 2023-11-28T19:31:30.786 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-11-28T19:31:30.783+0000 7f96bfc67640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:31:30.799 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-11-28T19:31:30.795+0000 7fc01a09f640 -1 osd.1 0 waiting for initial osdmap 2023-11-28T19:31:30.826 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-11-28T19:31:30.823+0000 7fc0126ec640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:31:30.827 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-11-28T19:31:30.823+0000 7f75dce44640 -1 osd.3 0 waiting for initial osdmap 2023-11-28T19:31:30.834 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:31:30.836 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:31:30.838 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:31:30.853 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-11-28T19:31:30.851+0000 7f75d5491640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:31:30.868 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.863+0000 7f42eb76f640 1 Processor -- start 2023-11-28T19:31:30.869 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.863+0000 7f42eb76f640 1 -- start start 2023-11-28T19:31:30.870 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42eb76f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f42e4071540 0x7f42e414e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:30.870 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42eb76f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f42e40719a0 0x7f42e414ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:30.870 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42eb76f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42e406e4c0 con 0x7f42e4148ac0 2023-11-28T19:31:30.870 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42eb76f640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e406de70 con 0x7f42e40719a0 2023-11-28T19:31:30.870 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42eb76f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42e406e150 con 0x7f42e4071540 2023-11-28T19:31:30.870 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42e9d0c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f42e40719a0 0x7f42e414ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:30.870 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42e950b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f42e4148ac0 0x7f42e4070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49210/0 (socket says 172.21.15.28:49210) 2023-11-28T19:31:30.870 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42e950b640 1 -- 172.21.15.28:0/316039152 learned_addr learned my addr 172.21.15.28:0/316039152 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:30.870 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42e8d0a640 1 --2- 172.21.15.28:0/316039152 >> v2:172.21.15.131:3300/0 conn(0x7f42e4071540 0x7f42e414e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:30.871 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42e9d0c640 1 -- 172.21.15.28:0/316039152 >> v2:172.21.15.131:3300/0 conn(0x7f42e4071540 msgr2=0x7f42e414e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:30.871 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42e9d0c640 1 --2- 172.21.15.28:0/316039152 >> v2:172.21.15.131:3300/0 conn(0x7f42e4071540 0x7f42e414e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:30.871 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42e9d0c640 1 -- 172.21.15.28:0/316039152 >> v1:172.21.15.28:6789/0 conn(0x7f42e4148ac0 legacy=0x7f42e4070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:30.871 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42e9d0c640 1 -- 172.21.15.28:0/316039152 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e4071ea0 con 0x7f42e40719a0 2023-11-28T19:31:30.872 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42e9d0c640 1 --2- 172.21.15.28:0/316039152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42e40719a0 0x7f42e414ede0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f42e40b51f0 tx=0x7f42e001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6096eb88262858a2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:30.872 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42dbfff640 1 -- 172.21.15.28:0/316039152 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00a57d0 con 0x7f42e40719a0 2023-11-28T19:31:30.872 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42dbfff640 1 -- 172.21.15.28:0/316039152 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e00a5930 con 0x7f42e40719a0 2023-11-28T19:31:30.872 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42dbfff640 1 -- 172.21.15.28:0/316039152 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00a5cc0 con 0x7f42e40719a0 2023-11-28T19:31:30.873 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42eb76f640 1 -- 172.21.15.28:0/316039152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42e40719a0 msgr2=0x7f42e414ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:30.873 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42eb76f640 1 --2- 172.21.15.28:0/316039152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42e40719a0 0x7f42e414ede0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f42e40b51f0 tx=0x7f42e001c910 comp rx=0 tx=0).stop 2023-11-28T19:31:30.873 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42eb76f640 1 -- 172.21.15.28:0/316039152 shutdown_connections 2023-11-28T19:31:30.873 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42eb76f640 1 --2- 172.21.15.28:0/316039152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42e40719a0 0x7f42e414ede0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:30.873 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42eb76f640 1 --2- 172.21.15.28:0/316039152 >> v2:172.21.15.131:3300/0 conn(0x7f42e4071540 0x7f42e414e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:30.873 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42eb76f640 1 -- 172.21.15.28:0/316039152 >> 172.21.15.28:0/316039152 conn(0x7f42e40ba920 msgr2=0x7f42e40bad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:30.873 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42eb76f640 1 -- 172.21.15.28:0/316039152 shutdown_connections 2023-11-28T19:31:30.874 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.867+0000 7f42eb76f640 1 -- 172.21.15.28:0/316039152 wait complete. 2023-11-28T19:31:30.874 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42eb76f640 1 Processor -- start 2023-11-28T19:31:30.874 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42eb76f640 1 -- start start 2023-11-28T19:31:30.875 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-11-28T19:31:30.871+0000 7fb9e1149640 -1 osd.0 0 waiting for initial osdmap 2023-11-28T19:31:30.876 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42eb76f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42e4071540 0x7f42e40b49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:30.876 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42eb76f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42e40719a0 0x7f42e40b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:30.876 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42eb76f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42e4148ac0 0x7f42e41e4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:30.876 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42eb76f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40b3a30 con 0x7f42e4148ac0 2023-11-28T19:31:30.877 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42eb76f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42e41e3ba0 con 0x7f42e4071540 2023-11-28T19:31:30.877 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42eb76f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42e40b2e40 con 0x7f42e40719a0 2023-11-28T19:31:30.877 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42e9d0c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42e4148ac0 0x7f42e41e4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:30.877 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42e8d0a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42e40719a0 0x7f42e40b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:30.877 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42e950b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42e4071540 0x7f42e40b49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:30.877 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42e9d0c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42e4148ac0 0x7f42e41e4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:46712/0 (socket says 172.21.15.28:46712) 2023-11-28T19:31:30.877 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42e9d0c640 1 -- 172.21.15.28:0/1491922543 learned_addr learned my addr 172.21.15.28:0/1491922543 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:30.877 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42e8d0a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42e40719a0 0x7f42e40b34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:47640/0 (socket says 172.21.15.28:47640) 2023-11-28T19:31:30.877 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42e9d0c640 1 -- 172.21.15.28:0/1491922543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42e40719a0 msgr2=0x7f42e40b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:30.877 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42e9d0c640 1 --2- 172.21.15.28:0/1491922543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42e40719a0 0x7f42e40b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:30.877 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42e9d0c640 1 -- 172.21.15.28:0/1491922543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42e4071540 msgr2=0x7f42e40b49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:30.877 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42e9d0c640 1 --2- 172.21.15.28:0/1491922543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42e4071540 0x7f42e40b49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:30.878 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42e9d0c640 1 -- 172.21.15.28:0/1491922543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e0009a70 con 0x7f42e4148ac0 2023-11-28T19:31:30.878 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42e9d0c640 1 --2- 172.21.15.28:0/1491922543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42e4148ac0 0x7f42e41e4080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f42e0019520 tx=0x7f42e00196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:30.878 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42d9ffb640 1 -- 172.21.15.28:0/1491922543 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00b9860 con 0x7f42e4148ac0 2023-11-28T19:31:30.878 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42d9ffb640 1 -- 172.21.15.28:0/1491922543 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e00b99c0 con 0x7f42e4148ac0 2023-11-28T19:31:30.878 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42d9ffb640 1 -- 172.21.15.28:0/1491922543 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e00b9d50 con 0x7f42e4148ac0 2023-11-28T19:31:30.878 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42eb76f640 1 -- 172.21.15.28:0/1491922543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42e4144940 con 0x7f42e4148ac0 2023-11-28T19:31:30.878 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.871+0000 7f42eb76f640 1 -- 172.21.15.28:0/1491922543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42e41446a0 con 0x7f42e4148ac0 2023-11-28T19:31:30.879 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.875+0000 7f42eb76f640 1 -- 172.21.15.28:0/1491922543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42e4144220 con 0x7f42e4148ac0 2023-11-28T19:31:30.879 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.875+0000 7f42d9ffb640 1 -- 172.21.15.28:0/1491922543 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f42e00ad440 con 0x7f42e4148ac0 2023-11-28T19:31:30.879 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.875+0000 7f42d9ffb640 1 --2- 172.21.15.28:0/1491922543 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f42c80663e0 0x7f42c80688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:30.879 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.875+0000 7f42d9ffb640 1 -- 172.21.15.28:0/1491922543 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f42e011e2e0 con 0x7f42e4148ac0 2023-11-28T19:31:30.879 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.875+0000 7f42e950b640 1 --2- 172.21.15.28:0/1491922543 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f42c80663e0 0x7f42c80688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:30.879 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.875+0000 7f42e950b640 1 --2- 172.21.15.28:0/1491922543 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f42c80663e0 0x7f42c80688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f42dc005890 tx=0x7f42dc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:30.884 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:30.879+0000 7f42d9ffb640 1 -- 172.21.15.28:0/1491922543 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f42e4144220 con 0x7f42e4148ac0 2023-11-28T19:31:30.914 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-11-28T19:31:30.911+0000 7fb9d9796640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:31:31.035 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:31.031+0000 7f42eb76f640 1 -- 172.21.15.28:0/1491922543 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42e4144220 con 0x7f42e4148ac0 2023-11-28T19:31:31.036 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:31.031+0000 7f42d9ffb640 1 -- 172.21.15.28:0/1491922543 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f42e4144220 con 0x7f42e4148ac0 2023-11-28T19:31:31.037 INFO:teuthology.misc.health.smithi028.stdout: 2023-11-28T19:31:31.037 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":12,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:29.143423+0000","last_up_change":"0.000000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:31.039 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:31.035+0000 7f42eb76f640 1 -- 172.21.15.28:0/1491922543 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f42c80663e0 msgr2=0x7f42c80688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:31.039 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:31.035+0000 7f42eb76f640 1 --2- 172.21.15.28:0/1491922543 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f42c80663e0 0x7f42c80688a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f42dc005890 tx=0x7f42dc009040 comp rx=0 tx=0).stop 2023-11-28T19:31:31.039 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:31.035+0000 7f42eb76f640 1 -- 172.21.15.28:0/1491922543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42e4148ac0 msgr2=0x7f42e41e4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:31.039 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:31.035+0000 7f42eb76f640 1 --2- 172.21.15.28:0/1491922543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42e4148ac0 0x7f42e41e4080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f42e0019520 tx=0x7f42e00196b0 comp rx=0 tx=0).stop 2023-11-28T19:31:31.039 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:31.035+0000 7f42eb76f640 1 -- 172.21.15.28:0/1491922543 shutdown_connections 2023-11-28T19:31:31.039 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:31.035+0000 7f42eb76f640 1 --2- 172.21.15.28:0/1491922543 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f42c80663e0 0x7f42c80688a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:31.039 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:31.035+0000 7f42eb76f640 1 --2- 172.21.15.28:0/1491922543 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f42e4148ac0 0x7f42e41e4080 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:31.039 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:31.035+0000 7f42eb76f640 1 --2- 172.21.15.28:0/1491922543 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f42e40719a0 0x7f42e40b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:31.039 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:31.035+0000 7f42eb76f640 1 --2- 172.21.15.28:0/1491922543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42e4071540 0x7f42e40b49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:31.040 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:31.035+0000 7f42eb76f640 1 -- 172.21.15.28:0/1491922543 >> 172.21.15.28:0/1491922543 conn(0x7f42e40ba920 msgr2=0x7f42e40b9fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:31.040 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:31.035+0000 7f42eb76f640 1 -- 172.21.15.28:0/1491922543 shutdown_connections 2023-11-28T19:31:31.040 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:31.035+0000 7f42eb76f640 1 -- 172.21.15.28:0/1491922543 wait complete. 2023-11-28T19:31:31.054 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-11-28T19:31:31.396 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-11-28T19:31:31.391+0000 7faeb0357640 -1 osd.6 0 waiting for initial osdmap 2023-11-28T19:31:31.404 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-11-28T19:31:31.399+0000 7f2191331640 -1 osd.5 0 waiting for initial osdmap 2023-11-28T19:31:31.421 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-11-28T19:31:31.419+0000 7faea716e640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:31:31.437 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-11-28T19:31:31.435+0000 7f218997e640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:31:31.447 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-11-28T19:31:31.443+0000 7f23bb08d640 -1 osd.4 0 waiting for initial osdmap 2023-11-28T19:31:31.460 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-11-28T19:31:31.455+0000 7fb33b86b640 -1 osd.7 0 waiting for initial osdmap 2023-11-28T19:31:31.481 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-11-28T19:31:31.479+0000 7f23b36da640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:31:31.488 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-11-28T19:31:31.487+0000 7fb333eb8640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-11-28T19:31:37.860 DEBUG:teuthology.orchestra.run.smithi028:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:37.988 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.983+0000 7f1e380bc640 1 Processor -- start 2023-11-28T19:31:37.988 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.983+0000 7f1e380bc640 1 -- start start 2023-11-28T19:31:37.990 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.983+0000 7f1e380bc640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1e30143180 0x7f1e3014c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:37.990 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.983+0000 7f1e380bc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1e30149590 0x7f1e30149a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:37.990 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.983+0000 7f1e380bc640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e30149f60 con 0x7f1e300b7f90 2023-11-28T19:31:37.991 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.983+0000 7f1e380bc640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e30149160 con 0x7f1e30149590 2023-11-28T19:31:37.991 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.983+0000 7f1e380bc640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e3014cc70 con 0x7f1e30143180 2023-11-28T19:31:37.991 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e35657640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1e30149590 0x7f1e30149a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:37.991 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e35657640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1e30149590 0x7f1e30149a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33982/0 (socket says 172.21.15.28:33982) 2023-11-28T19:31:37.991 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e35657640 1 -- 172.21.15.28:0/1902670938 learned_addr learned my addr 172.21.15.28:0/1902670938 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:37.991 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e35e58640 1 --2- 172.21.15.28:0/1902670938 >> v2:172.21.15.131:3300/0 conn(0x7f1e30143180 0x7f1e3014c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:37.991 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e35657640 1 -- 172.21.15.28:0/1902670938 >> v2:172.21.15.131:3300/0 conn(0x7f1e30143180 msgr2=0x7f1e3014c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:37.991 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e35657640 1 --2- 172.21.15.28:0/1902670938 >> v2:172.21.15.131:3300/0 conn(0x7f1e30143180 0x7f1e3014c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:37.991 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e35657640 1 -- 172.21.15.28:0/1902670938 >> v1:172.21.15.131:6789/0 conn(0x7f1e300b7f90 legacy=0x7f1e300b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:37.991 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e35657640 1 -- 172.21.15.28:0/1902670938 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e300b8ad0 con 0x7f1e30149590 2023-11-28T19:31:37.991 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e35e58640 1 --2- 172.21.15.28:0/1902670938 >> v2:172.21.15.131:3300/0 conn(0x7f1e30143180 0x7f1e3014c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:37.993 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e35657640 1 --2- 172.21.15.28:0/1902670938 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e30149590 0x7f1e30149a20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1e300bcaa0 tx=0x7f1e2001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf0f2c5bfe49f45 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:37.993 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e34e56640 1 -- 172.21.15.28:0/1902670938 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e200a89b0 con 0x7f1e30149590 2023-11-28T19:31:37.993 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e34e56640 1 -- 172.21.15.28:0/1902670938 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e200a8b10 con 0x7f1e30149590 2023-11-28T19:31:37.993 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e34e56640 1 -- 172.21.15.28:0/1902670938 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e200a8ea0 con 0x7f1e30149590 2023-11-28T19:31:37.993 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e380bc640 1 -- 172.21.15.28:0/1902670938 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e30149590 msgr2=0x7f1e30149a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:37.994 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e380bc640 1 --2- 172.21.15.28:0/1902670938 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e30149590 0x7f1e30149a20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1e300bcaa0 tx=0x7f1e2001ecb0 comp rx=0 tx=0).stop 2023-11-28T19:31:37.994 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e380bc640 1 -- 172.21.15.28:0/1902670938 shutdown_connections 2023-11-28T19:31:37.994 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e380bc640 1 --2- 172.21.15.28:0/1902670938 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e30149590 0x7f1e30149a20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:37.994 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e380bc640 1 --2- 172.21.15.28:0/1902670938 >> v2:172.21.15.131:3300/0 conn(0x7f1e30143180 0x7f1e3014c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:37.994 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e380bc640 1 -- 172.21.15.28:0/1902670938 >> 172.21.15.28:0/1902670938 conn(0x7f1e3006f150 msgr2=0x7f1e3006f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:37.994 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e380bc640 1 -- 172.21.15.28:0/1902670938 shutdown_connections 2023-11-28T19:31:37.994 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.987+0000 7f1e380bc640 1 -- 172.21.15.28:0/1902670938 wait complete. 2023-11-28T19:31:37.996 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e380bc640 1 Processor -- start 2023-11-28T19:31:37.996 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e380bc640 1 -- start start 2023-11-28T19:31:37.997 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e380bc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e300b7f90 0x7f1e30145180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:37.997 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e380bc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e30143180 0x7f1e301437d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:37.997 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e380bc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1e30149590 0x7f1e30145df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:37.997 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e380bc640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e301df860 con 0x7f1e30143180 2023-11-28T19:31:37.997 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e380bc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e301def70 con 0x7f1e300b7f90 2023-11-28T19:31:37.997 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e380bc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e30146820 con 0x7f1e30149590 2023-11-28T19:31:37.997 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e35657640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e30143180 0x7f1e301437d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:37.997 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e35657640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e30143180 0x7f1e301437d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:33984/0 (socket says 172.21.15.28:33984) 2023-11-28T19:31:37.997 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e35657640 1 -- 172.21.15.28:0/3446677241 learned_addr learned my addr 172.21.15.28:0/3446677241 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:37.997 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e36659640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1e30149590 0x7f1e30145df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:37.998 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e35e58640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e300b7f90 0x7f1e30145180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:37.998 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e35657640 1 -- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1e30149590 msgr2=0x7f1e30145df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:37.998 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e35657640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1e30149590 0x7f1e30145df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:37.998 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e35657640 1 -- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e300b7f90 msgr2=0x7f1e30145180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:37.998 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e35657640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e300b7f90 0x7f1e30145180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:37.998 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e35657640 1 -- 172.21.15.28:0/3446677241 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e200094d0 con 0x7f1e30143180 2023-11-28T19:31:37.998 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e35e58640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e300b7f90 0x7f1e30145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:37.998 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e35657640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e30143180 0x7f1e301437d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1e200b3040 tx=0x7f1e2001ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:37.998 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e267fc640 1 -- 172.21.15.28:0/3446677241 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e200b0e80 con 0x7f1e30143180 2023-11-28T19:31:37.998 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e267fc640 1 -- 172.21.15.28:0/3446677241 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e200bb480 con 0x7f1e30143180 2023-11-28T19:31:37.999 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e380bc640 1 -- 172.21.15.28:0/3446677241 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e301df210 con 0x7f1e30143180 2023-11-28T19:31:37.999 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e267fc640 1 -- 172.21.15.28:0/3446677241 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e200bb830 con 0x7f1e30143180 2023-11-28T19:31:37.999 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e380bc640 1 -- 172.21.15.28:0/3446677241 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e301dfcf0 con 0x7f1e30143180 2023-11-28T19:31:37.999 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e380bc640 1 -- 172.21.15.28:0/3446677241 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e301df9d0 con 0x7f1e30143180 2023-11-28T19:31:38.000 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.991+0000 7f1e267fc640 1 -- 172.21.15.28:0/3446677241 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 4) v1 ==== 85796+0+0 (secure 0 0 0) 0x7f1e200bb990 con 0x7f1e30143180 2023-11-28T19:31:38.000 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.995+0000 7f1e267fc640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1e140663e0 0x7f1e140688a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.000 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.995+0000 7f1e267fc640 1 -- 172.21.15.28:0/3446677241 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1e20122040 con 0x7f1e30143180 2023-11-28T19:31:38.000 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.995+0000 7f1e35e58640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1e140663e0 0x7f1e140688a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.000 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.995+0000 7f1e35e58640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1e140663e0 0x7f1e140688a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c008930 tx=0x7f1e2c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:38.002 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:37.999+0000 7f1e267fc640 1 -- 172.21.15.28:0/3446677241 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1e200ef980 con 0x7f1e30143180 2023-11-28T19:31:38.093 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.087+0000 7f1e267fc640 1 -- 172.21.15.28:0/3446677241 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1e200efd50 con 0x7f1e30143180 2023-11-28T19:31:38.167 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.163+0000 7f1e380bc640 1 -- 172.21.15.28:0/3446677241 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e301df9a0 con 0x7f1e30143180 2023-11-28T19:31:38.169 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.167+0000 7f1e267fc640 1 -- 172.21.15.28:0/3446677241 <== mon.0 v2:172.21.15.28:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7f1e200f5e80 con 0x7f1e30143180 2023-11-28T19:31:38.169 INFO:teuthology.misc.health.smithi028.stdout: 2023-11-28T19:31:38.170 INFO:teuthology.misc.health.smithi028.stdout:{"epoch":17,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:36.063116+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:38.172 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.167+0000 7f1e380bc640 1 -- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1e140663e0 msgr2=0x7f1e140688a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.172 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.167+0000 7f1e380bc640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1e140663e0 0x7f1e140688a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f1e2c008930 tx=0x7f1e2c008040 comp rx=0 tx=0).stop 2023-11-28T19:31:38.172 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.167+0000 7f1e380bc640 1 -- 172.21.15.28:0/3446677241 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e30143180 msgr2=0x7f1e301437d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.172 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.167+0000 7f1e380bc640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e30143180 0x7f1e301437d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1e200b3040 tx=0x7f1e2001ba50 comp rx=0 tx=0).stop 2023-11-28T19:31:38.172 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.167+0000 7f1e380bc640 1 -- 172.21.15.28:0/3446677241 shutdown_connections 2023-11-28T19:31:38.172 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.167+0000 7f1e380bc640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1e140663e0 0x7f1e140688a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.173 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.167+0000 7f1e380bc640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1e30149590 0x7f1e30145df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.173 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.167+0000 7f1e380bc640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1e30143180 0x7f1e301437d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.173 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.167+0000 7f1e380bc640 1 --2- 172.21.15.28:0/3446677241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e300b7f90 0x7f1e30145180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.173 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.167+0000 7f1e380bc640 1 -- 172.21.15.28:0/3446677241 >> 172.21.15.28:0/3446677241 conn(0x7f1e3006f150 msgr2=0x7f1e300beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:38.173 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.167+0000 7f1e380bc640 1 -- 172.21.15.28:0/3446677241 shutdown_connections 2023-11-28T19:31:38.173 INFO:teuthology.misc.health.smithi028.stderr:2023-11-28T19:31:38.167+0000 7f1e380bc640 1 -- 172.21.15.28:0/3446677241 wait complete. 2023-11-28T19:31:38.188 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-11-28T19:31:38.188 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-11-28T19:31:38.189 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T19:31:38.189 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T19:31:38.191 INFO:tasks.ceph.mds.a:Started 2023-11-28T19:31:38.191 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T19:31:38.192 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T19:31:38.193 INFO:tasks.ceph.mds.c:Started 2023-11-28T19:31:38.193 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T19:31:38.194 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T19:31:38.196 INFO:tasks.ceph.mds.b:Started 2023-11-28T19:31:38.196 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-11-28T19:31:38.197 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:38.263 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2023-11-28T19:31:38.264 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2023-11-28T19:31:38.289 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-11-28T19:31:38.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.307+0000 7fd51893f640 1 Processor -- start 2023-11-28T19:31:38.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.307+0000 7fd51893f640 1 -- start start 2023-11-28T19:31:38.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.307+0000 7fd51893f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5141424d0 0x7fd5140b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.307+0000 7fd51893f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd5140b7580 0x7fd5140b9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.307+0000 7fd51893f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5140b9bb0 con 0x7fd51414c1f0 2023-11-28T19:31:38.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.307+0000 7fd51893f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd514072130 con 0x7fd5140b7580 2023-11-28T19:31:38.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.307+0000 7fd51893f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51414bd60 con 0x7fd5141424d0 2023-11-28T19:31:38.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.307+0000 7fd512d9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd51414c1f0 0x7fd51406b590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57318/0 (socket says 172.21.15.28:57318) 2023-11-28T19:31:38.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.307+0000 7fd512d9d640 1 -- 172.21.15.28:0/3696310301 learned_addr learned my addr 172.21.15.28:0/3696310301 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:38.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51259c640 1 --2- 172.21.15.28:0/3696310301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5141424d0 0x7fd5140b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd511d9b640 1 --2- 172.21.15.28:0/3696310301 >> v2:172.21.15.131:3300/0 conn(0x7fd5140b7580 0x7fd5140b9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 -- 172.21.15.28:0/3696310301 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2103504594 0 0) 0x7fd5140b9bb0 con 0x7fd51414c1f0 2023-11-28T19:31:38.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 -- 172.21.15.28:0/3696310301 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4fc005740 con 0x7fd51414c1f0 2023-11-28T19:31:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 -- 172.21.15.28:0/3696310301 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1139109811 0 0) 0x7fd4fc005740 con 0x7fd51414c1f0 2023-11-28T19:31:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 -- 172.21.15.28:0/3696310301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5141424d0 msgr2=0x7fd5140b50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 --2- 172.21.15.28:0/3696310301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5141424d0 0x7fd5140b50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 -- 172.21.15.28:0/3696310301 >> v2:172.21.15.131:3300/0 conn(0x7fd5140b7580 msgr2=0x7fd5140b9260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 --2- 172.21.15.28:0/3696310301 >> v2:172.21.15.131:3300/0 conn(0x7fd5140b7580 0x7fd5140b9260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 -- 172.21.15.28:0/3696310301 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51406bca0 con 0x7fd51414c1f0 2023-11-28T19:31:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 -- 172.21.15.28:0/3696310301 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7fd50c001a00 con 0x7fd51414c1f0 2023-11-28T19:31:38.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd511d9b640 1 --2- 172.21.15.28:0/3696310301 >> v2:172.21.15.131:3300/0 conn(0x7fd5140b7580 0x7fd5140b9260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:31:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 -- 172.21.15.28:0/3696310301 >> v1:172.21.15.28:6789/0 conn(0x7fd51414c1f0 legacy=0x7fd51406b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 --2- 172.21.15.28:0/3696310301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4fc005b90 0x7fd4fc005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 --2- 172.21.15.28:0/3696310301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4fc0069e0 0x7fd4fc006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 --2- 172.21.15.28:0/3696310301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0073a0 0x7fd4fc00dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 -- 172.21.15.28:0/3696310301 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd514072130 con 0x7fd4fc005b90 2023-11-28T19:31:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 -- 172.21.15.28:0/3696310301 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51414bd60 con 0x7fd4fc0073a0 2023-11-28T19:31:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 -- 172.21.15.28:0/3696310301 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4fc00e0e0 con 0x7fd4fc0069e0 2023-11-28T19:31:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51259c640 1 --2- 172.21.15.28:0/3696310301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5141424d0 0x7fd5140b50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:31:38.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51259c640 1 --2- 172.21.15.28:0/3696310301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4fc005b90 0x7fd4fc005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd511d9b640 1 --2- 172.21.15.28:0/3696310301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4fc0069e0 0x7fd4fc006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd512d9d640 1 --2- 172.21.15.28:0/3696310301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0073a0 0x7fd4fc00dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51259c640 1 -- 172.21.15.28:0/3696310301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4fc0069e0 msgr2=0x7fd4fc006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:38.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51259c640 1 --2- 172.21.15.28:0/3696310301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4fc0069e0 0x7fd4fc006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51259c640 1 -- 172.21.15.28:0/3696310301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0073a0 msgr2=0x7fd4fc00dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:38.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51259c640 1 --2- 172.21.15.28:0/3696310301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4fc0073a0 0x7fd4fc00dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51259c640 1 -- 172.21.15.28:0/3696310301 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4fc005740 con 0x7fd4fc005b90 2023-11-28T19:31:38.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51259c640 1 --2- 172.21.15.28:0/3696310301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4fc005b90 0x7fd4fc005fb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd504009b20 tx=0x7fd50401ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb1a87af891dca86 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:38.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 -- 172.21.15.28:0/3696310301 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504004030 con 0x7fd4fc005b90 2023-11-28T19:31:38.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 -- 172.21.15.28:0/3696310301 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd504004190 con 0x7fd4fc005b90 2023-11-28T19:31:38.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51159a640 1 -- 172.21.15.28:0/3696310301 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504004520 con 0x7fd4fc005b90 2023-11-28T19:31:38.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51893f640 1 -- 172.21.15.28:0/3696310301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4fc005b90 msgr2=0x7fd4fc005fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51893f640 1 --2- 172.21.15.28:0/3696310301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4fc005b90 0x7fd4fc005fb0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fd504009b20 tx=0x7fd50401ca90 comp rx=0 tx=0).stop 2023-11-28T19:31:38.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd512d9d640 1 -- 172.21.15.28:0/3696310301 reap_dead start 2023-11-28T19:31:38.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51893f640 1 -- 172.21.15.28:0/3696310301 shutdown_connections 2023-11-28T19:31:38.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51893f640 1 -- 172.21.15.28:0/3696310301 >> 172.21.15.28:0/3696310301 conn(0x7fd5140b9d90 msgr2=0x7fd5140ba1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:38.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.311+0000 7fd51893f640 1 -- 172.21.15.28:0/3696310301 shutdown_connections 2023-11-28T19:31:38.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51893f640 1 -- 172.21.15.28:0/3696310301 wait complete. 2023-11-28T19:31:38.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51893f640 1 Processor -- start 2023-11-28T19:31:38.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51893f640 1 -- start start 2023-11-28T19:31:38.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51893f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4fc005b90 0x7fd5141359f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51893f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5140713d0 0x7fd5141e6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51893f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5141e7220 0x7fd514132550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51893f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd514135380 con 0x7fd4fc005b90 2023-11-28T19:31:38.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51893f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5141362d0 con 0x7fd5141e7220 2023-11-28T19:31:38.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51893f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd514134530 con 0x7fd5140713d0 2023-11-28T19:31:38.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4fc005b90 0x7fd5141359f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4fc005b90 0x7fd5141359f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34046/0 (socket says 172.21.15.28:34046) 2023-11-28T19:31:38.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51259c640 1 -- 172.21.15.28:0/1879225733 learned_addr learned my addr 172.21.15.28:0/1879225733 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:38.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd511d9b640 1 --2- 172.21.15.28:0/1879225733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5140713d0 0x7fd5141e6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd512d9d640 1 --2- 172.21.15.28:0/1879225733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5141e7220 0x7fd514132550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51259c640 1 -- 172.21.15.28:0/1879225733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5140713d0 msgr2=0x7fd5141e6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51259c640 1 --2- 172.21.15.28:0/1879225733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5140713d0 0x7fd5141e6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51259c640 1 -- 172.21.15.28:0/1879225733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5141e7220 msgr2=0x7fd514132550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51259c640 1 --2- 172.21.15.28:0/1879225733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5141e7220 0x7fd514132550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51259c640 1 -- 172.21.15.28:0/1879225733 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd514135ff0 con 0x7fd4fc005b90 2023-11-28T19:31:38.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51259c640 1 --2- 172.21.15.28:0/1879225733 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4fc005b90 0x7fd5141359f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd50401c8c0 tx=0x7fd4fc007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:38.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd502ffd640 1 -- 172.21.15.28:0/1879225733 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504004030 con 0x7fd4fc005b90 2023-11-28T19:31:38.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd502ffd640 1 -- 172.21.15.28:0/1879225733 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd504000e90 con 0x7fd4fc005b90 2023-11-28T19:31:38.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51893f640 1 -- 172.21.15.28:0/1879225733 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd514133d30 con 0x7fd4fc005b90 2023-11-28T19:31:38.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd502ffd640 1 -- 172.21.15.28:0/1879225733 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd504004300 con 0x7fd4fc005b90 2023-11-28T19:31:38.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51893f640 1 -- 172.21.15.28:0/1879225733 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5141355d0 con 0x7fd4fc005b90 2023-11-28T19:31:38.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.315+0000 7fd51893f640 1 -- 172.21.15.28:0/1879225733 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd514074a90 con 0x7fd4fc005b90 2023-11-28T19:31:38.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.319+0000 7fd502ffd640 1 -- 172.21.15.28:0/1879225733 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd5040b0050 con 0x7fd4fc005b90 2023-11-28T19:31:38.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.319+0000 7fd502ffd640 1 --2- 172.21.15.28:0/1879225733 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd4f4066470 0x7fd4f4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.319+0000 7fd502ffd640 1 -- 172.21.15.28:0/1879225733 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd50411ce10 con 0x7fd4fc005b90 2023-11-28T19:31:38.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.319+0000 7fd511d9b640 1 --2- 172.21.15.28:0/1879225733 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd4f4066470 0x7fd4f4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.319+0000 7fd511d9b640 1 --2- 172.21.15.28:0/1879225733 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd4f4066470 0x7fd4f4068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd514149150 tx=0x7fd508009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:38.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.323+0000 7fd502ffd640 1 -- 172.21.15.28:0/1879225733 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5040ea690 con 0x7fd4fc005b90 2023-11-28T19:31:38.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.479+0000 7fd51893f640 1 -- 172.21.15.28:0/1879225733 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd514066810 con 0x7fd4fc005b90 2023-11-28T19:31:38.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.479+0000 7fd502ffd640 1 -- 172.21.15.28:0/1879225733 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fd5040ae020 con 0x7fd4fc005b90 2023-11-28T19:31:38.484 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:38.485 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":17,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:36.063116+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:38.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.483+0000 7fd51893f640 1 -- 172.21.15.28:0/1879225733 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd4f4066470 msgr2=0x7fd4f4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.483+0000 7fd51893f640 1 --2- 172.21.15.28:0/1879225733 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd4f4066470 0x7fd4f4068930 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd514149150 tx=0x7fd508009190 comp rx=0 tx=0).stop 2023-11-28T19:31:38.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.483+0000 7fd51893f640 1 -- 172.21.15.28:0/1879225733 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4fc005b90 msgr2=0x7fd5141359f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.483+0000 7fd51893f640 1 --2- 172.21.15.28:0/1879225733 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4fc005b90 0x7fd5141359f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd50401c8c0 tx=0x7fd4fc007a10 comp rx=0 tx=0).stop 2023-11-28T19:31:38.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.483+0000 7fd51893f640 1 -- 172.21.15.28:0/1879225733 shutdown_connections 2023-11-28T19:31:38.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.483+0000 7fd51893f640 1 --2- 172.21.15.28:0/1879225733 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd4f4066470 0x7fd4f4068930 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.483+0000 7fd51893f640 1 --2- 172.21.15.28:0/1879225733 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5141e7220 0x7fd514132550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.483+0000 7fd51893f640 1 --2- 172.21.15.28:0/1879225733 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5140713d0 0x7fd5141e6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.483+0000 7fd51893f640 1 --2- 172.21.15.28:0/1879225733 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4fc005b90 0x7fd5141359f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.483+0000 7fd51893f640 1 -- 172.21.15.28:0/1879225733 >> 172.21.15.28:0/1879225733 conn(0x7fd5140b9d90 msgr2=0x7fd5140ba1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:38.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.483+0000 7fd51893f640 1 -- 172.21.15.28:0/1879225733 shutdown_connections 2023-11-28T19:31:38.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.483+0000 7fd51893f640 1 -- 172.21.15.28:0/1879225733 wait complete. 2023-11-28T19:31:38.504 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:31:33.212362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T19:31:38.504 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:31:38.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9ca579b640 1 Processor -- start 2023-11-28T19:31:38.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9ca579b640 1 -- start start 2023-11-28T19:31:38.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9ca579b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9ca00b7ce0 0x7f9ca014fa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9ca579b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ca014ffc0 0x7f9ca015a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9ca579b640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ca00b9100 con 0x7f9ca00b6ac0 2023-11-28T19:31:38.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9ca579b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ca014a140 con 0x7f9ca00b7ce0 2023-11-28T19:31:38.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9ca579b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca00bd7f0 con 0x7f9ca014ffc0 2023-11-28T19:31:38.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9c9f7fe640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ca014ffc0 0x7f9ca015a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9c9effd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f9ca00b6ac0 0x7f9ca00bd0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:41368/0 (socket says 172.21.15.28:41368) 2023-11-28T19:31:38.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9c9effd640 1 -- 172.21.15.28:0/3967941929 learned_addr learned my addr 172.21.15.28:0/3967941929 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:38.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9c9e7fc640 1 --2- 172.21.15.28:0/3967941929 >> v2:172.21.15.131:3300/0 conn(0x7f9ca00b7ce0 0x7f9ca014fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9c9dffb640 1 -- 172.21.15.28:0/3967941929 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982522174 0 0) 0x7f9ca00b9100 con 0x7f9ca00b6ac0 2023-11-28T19:31:38.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9c9dffb640 1 -- 172.21.15.28:0/3967941929 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c8c003530 con 0x7f9ca00b6ac0 2023-11-28T19:31:38.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9c9f7fe640 1 -- 172.21.15.28:0/3967941929 >> v2:172.21.15.131:3300/0 conn(0x7f9ca00b7ce0 msgr2=0x7f9ca014fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:38.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9c9f7fe640 1 --2- 172.21.15.28:0/3967941929 >> v2:172.21.15.131:3300/0 conn(0x7f9ca00b7ce0 0x7f9ca014fa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9c9f7fe640 1 -- 172.21.15.28:0/3967941929 >> v1:172.21.15.131:6789/0 conn(0x7f9ca00b6ac0 legacy=0x7f9ca00bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9c9f7fe640 1 -- 172.21.15.28:0/3967941929 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca0150430 con 0x7f9ca014ffc0 2023-11-28T19:31:38.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.631+0000 7f9c9e7fc640 1 --2- 172.21.15.28:0/3967941929 >> v2:172.21.15.131:3300/0 conn(0x7f9ca00b7ce0 0x7f9ca014fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:31:38.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9c9f7fe640 1 --2- 172.21.15.28:0/3967941929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ca014ffc0 0x7f9ca015a1b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9c980097c0 tx=0x7f9c9801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f8284f405c3fe90 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:38.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9c9dffb640 1 -- 172.21.15.28:0/3967941929 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c980a8970 con 0x7f9ca014ffc0 2023-11-28T19:31:38.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9c9dffb640 1 -- 172.21.15.28:0/3967941929 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c980a8ad0 con 0x7f9ca014ffc0 2023-11-28T19:31:38.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9c9dffb640 1 -- 172.21.15.28:0/3967941929 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c980a8e40 con 0x7f9ca014ffc0 2023-11-28T19:31:38.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 -- 172.21.15.28:0/3967941929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ca014ffc0 msgr2=0x7f9ca015a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 --2- 172.21.15.28:0/3967941929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ca014ffc0 0x7f9ca015a1b0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f9c980097c0 tx=0x7f9c9801ec70 comp rx=0 tx=0).stop 2023-11-28T19:31:38.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 -- 172.21.15.28:0/3967941929 shutdown_connections 2023-11-28T19:31:38.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 --2- 172.21.15.28:0/3967941929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ca014ffc0 0x7f9ca015a1b0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 --2- 172.21.15.28:0/3967941929 >> v2:172.21.15.131:3300/0 conn(0x7f9ca00b7ce0 0x7f9ca014fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 -- 172.21.15.28:0/3967941929 >> 172.21.15.28:0/3967941929 conn(0x7f9ca006ab80 msgr2=0x7f9ca00bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:38.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 -- 172.21.15.28:0/3967941929 shutdown_connections 2023-11-28T19:31:38.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 -- 172.21.15.28:0/3967941929 wait complete. 2023-11-28T19:31:38.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 Processor -- start 2023-11-28T19:31:38.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 -- start start 2023-11-28T19:31:38.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ca00b6ac0 0x7f9ca01dc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ca00b7ce0 0x7f9ca014a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ca014ffc0 0x7f9ca0071630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca01dca90 con 0x7f9ca00b7ce0 2023-11-28T19:31:38.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca014c130 con 0x7f9ca014ffc0 2023-11-28T19:31:38.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.635+0000 7f9ca579b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca014cfa0 con 0x7f9ca00b6ac0 2023-11-28T19:31:38.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c9e7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ca00b7ce0 0x7f9ca014a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c9e7fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ca00b7ce0 0x7f9ca014a8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34048/0 (socket says 172.21.15.28:34048) 2023-11-28T19:31:38.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c9e7fc640 1 -- 172.21.15.28:0/3534678189 learned_addr learned my addr 172.21.15.28:0/3534678189 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:38.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c9f7fe640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ca014ffc0 0x7f9ca0071630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c9effd640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ca00b6ac0 0x7f9ca01dc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c9e7fc640 1 -- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ca00b6ac0 msgr2=0x7f9ca01dc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c9e7fc640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ca00b6ac0 0x7f9ca01dc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c9e7fc640 1 -- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ca014ffc0 msgr2=0x7f9ca0071630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c9e7fc640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ca014ffc0 0x7f9ca0071630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c9e7fc640 1 -- 172.21.15.28:0/3534678189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c90009a70 con 0x7f9ca00b7ce0 2023-11-28T19:31:38.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c9f7fe640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ca014ffc0 0x7f9ca0071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:31:38.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c9e7fc640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ca00b7ce0 0x7f9ca014a8d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009f60 tx=0x7f9c90009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:38.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c977fe640 1 -- 172.21.15.28:0/3534678189 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90014680 con 0x7f9ca00b7ce0 2023-11-28T19:31:38.648 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c977fe640 1 -- 172.21.15.28:0/3534678189 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c9000f040 con 0x7f9ca00b7ce0 2023-11-28T19:31:38.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c977fe640 1 -- 172.21.15.28:0/3534678189 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90014a00 con 0x7f9ca00b7ce0 2023-11-28T19:31:38.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9ca579b640 1 -- 172.21.15.28:0/3534678189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c98009420 con 0x7f9ca00b7ce0 2023-11-28T19:31:38.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9ca579b640 1 -- 172.21.15.28:0/3534678189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca014bb70 con 0x7f9ca00b7ce0 2023-11-28T19:31:38.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9ca579b640 1 -- 172.21.15.28:0/3534678189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ca00b4400 con 0x7f9ca00b7ce0 2023-11-28T19:31:38.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c977fe640 1 -- 172.21.15.28:0/3534678189 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9c90014b60 con 0x7f9ca00b7ce0 2023-11-28T19:31:38.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c977fe640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9c80066470 0x7f9c80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c977fe640 1 -- 172.21.15.28:0/3534678189 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9c90084a80 con 0x7f9ca00b7ce0 2023-11-28T19:31:38.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.639+0000 7f9c9effd640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9c80066470 0x7f9c80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.643+0000 7f9c9effd640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9c80066470 0x7f9c80068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c88005890 tx=0x7f9c88009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:38.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.643+0000 7f9c977fe640 1 -- 172.21.15.28:0/3534678189 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9c900522e0 con 0x7f9ca00b7ce0 2023-11-28T19:31:38.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.803+0000 7f9ca579b640 1 -- 172.21.15.28:0/3534678189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9ca00b8a90 con 0x7f9ca00b7ce0 2023-11-28T19:31:38.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.803+0000 7f9c977fe640 1 -- 172.21.15.28:0/3534678189 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9ca00b8a90 con 0x7f9ca00b7ce0 2023-11-28T19:31:38.807 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-28T19:31:38.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.803+0000 7f9ca579b640 1 -- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9c80066470 msgr2=0x7f9c80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.803+0000 7f9ca579b640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9c80066470 0x7f9c80068930 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c88005890 tx=0x7f9c88009040 comp rx=0 tx=0).stop 2023-11-28T19:31:38.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.803+0000 7f9ca579b640 1 -- 172.21.15.28:0/3534678189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ca00b7ce0 msgr2=0x7f9ca014a8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.803+0000 7f9ca579b640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ca00b7ce0 0x7f9ca014a8d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9c90009f60 tx=0x7f9c90009f90 comp rx=0 tx=0).stop 2023-11-28T19:31:38.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.803+0000 7f9ca579b640 1 -- 172.21.15.28:0/3534678189 shutdown_connections 2023-11-28T19:31:38.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.803+0000 7f9ca579b640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9c80066470 0x7f9c80068930 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.803+0000 7f9ca579b640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ca014ffc0 0x7f9ca0071630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.803+0000 7f9ca579b640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9ca00b7ce0 0x7f9ca014a8d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.803+0000 7f9ca579b640 1 --2- 172.21.15.28:0/3534678189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9ca00b6ac0 0x7f9ca01dc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.803+0000 7f9ca579b640 1 -- 172.21.15.28:0/3534678189 >> 172.21.15.28:0/3534678189 conn(0x7f9ca006ab80 msgr2=0x7f9ca00b5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:38.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.803+0000 7f9ca579b640 1 -- 172.21.15.28:0/3534678189 shutdown_connections 2023-11-28T19:31:38.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.803+0000 7f9ca579b640 1 -- 172.21.15.28:0/3534678189 wait complete. 2023-11-28T19:31:38.826 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:31:38.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.947+0000 7f330ab01640 1 Processor -- start 2023-11-28T19:31:38.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.947+0000 7f330ab01640 1 -- start start 2023-11-28T19:31:38.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.951+0000 7f330ab01640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3304142560 0x7f33040b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.951+0000 7f330ab01640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33040b4a80 con 0x7f33040b4610 2023-11-28T19:31:38.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.951+0000 7f330ab01640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3304142940 con 0x7f33040b5dd0 2023-11-28T19:31:38.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.951+0000 7f330ab01640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f330406f950 con 0x7f3304142560 2023-11-28T19:31:38.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.951+0000 7f330909e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f33040b4610 0x7f3304152b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57334/0 (socket says 172.21.15.28:57334) 2023-11-28T19:31:38.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.951+0000 7f330909e640 1 -- 172.21.15.28:0/686752720 learned_addr learned my addr 172.21.15.28:0/686752720 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:38.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.951+0000 7f330889d640 1 --2- 172.21.15.28:0/686752720 >> v2:172.21.15.131:3300/0 conn(0x7f3304142560 0x7f33040b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.951+0000 7f33037fe640 1 -- 172.21.15.28:0/686752720 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 131849567 0 0) 0x7f33040b4a80 con 0x7f33040b4610 2023-11-28T19:31:38.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.951+0000 7f33037fe640 1 -- 172.21.15.28:0/686752720 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32ec003530 con 0x7f33040b4610 2023-11-28T19:31:38.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.951+0000 7f330889d640 1 -- 172.21.15.28:0/686752720 >> v1:172.21.15.131:6789/0 conn(0x7f33040b5dd0 legacy=0x7f33040b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.951+0000 7f330889d640 1 -- 172.21.15.28:0/686752720 >> v1:172.21.15.28:6789/0 conn(0x7f33040b4610 legacy=0x7f3304152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.951+0000 7f330889d640 1 -- 172.21.15.28:0/686752720 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f330414bb40 con 0x7f3304142560 2023-11-28T19:31:38.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.951+0000 7f330889d640 1 --2- 172.21.15.28:0/686752720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3304142560 0x7f33040b40d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32f40097c0 tx=0x7f32f401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fdbb0da8102472c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:38.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f33037fe640 1 -- 172.21.15.28:0/686752720 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40a8970 con 0x7f3304142560 2023-11-28T19:31:38.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f33037fe640 1 -- 172.21.15.28:0/686752720 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f40a8ad0 con 0x7f3304142560 2023-11-28T19:31:38.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f33037fe640 1 -- 172.21.15.28:0/686752720 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f40a8e40 con 0x7f3304142560 2023-11-28T19:31:38.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 -- 172.21.15.28:0/686752720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3304142560 msgr2=0x7f33040b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 --2- 172.21.15.28:0/686752720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3304142560 0x7f33040b40d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f32f40097c0 tx=0x7f32f401ec70 comp rx=0 tx=0).stop 2023-11-28T19:31:38.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 -- 172.21.15.28:0/686752720 shutdown_connections 2023-11-28T19:31:38.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 --2- 172.21.15.28:0/686752720 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3304142560 0x7f33040b40d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 -- 172.21.15.28:0/686752720 >> 172.21.15.28:0/686752720 conn(0x7f33040bcb40 msgr2=0x7f33040bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:38.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 -- 172.21.15.28:0/686752720 shutdown_connections 2023-11-28T19:31:38.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 -- 172.21.15.28:0/686752720 wait complete. 2023-11-28T19:31:38.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 Processor -- start 2023-11-28T19:31:38.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 -- start start 2023-11-28T19:31:38.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33040b4610 0x7f330413b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33040b5dd0 0x7f33041dedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3304142560 0x7f33041df300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330413bbc0 con 0x7f33040b5dd0 2023-11-28T19:31:38.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33041e2f20 con 0x7f3304142560 2023-11-28T19:31:38.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33041e25f0 con 0x7f33040b4610 2023-11-28T19:31:38.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f3303fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33040b5dd0 0x7f33041dedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f3303fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33040b5dd0 0x7f33041dedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34058/0 (socket says 172.21.15.28:34058) 2023-11-28T19:31:38.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f3303fff640 1 -- 172.21.15.28:0/1043438319 learned_addr learned my addr 172.21.15.28:0/1043438319 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:38.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330909e640 1 --2- 172.21.15.28:0/1043438319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3304142560 0x7f33041df300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330889d640 1 --2- 172.21.15.28:0/1043438319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33040b4610 0x7f330413b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f3303fff640 1 -- 172.21.15.28:0/1043438319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33040b4610 msgr2=0x7f330413b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f3303fff640 1 --2- 172.21.15.28:0/1043438319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33040b4610 0x7f330413b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f3303fff640 1 -- 172.21.15.28:0/1043438319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3304142560 msgr2=0x7f33041df300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:38.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f3303fff640 1 --2- 172.21.15.28:0/1043438319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3304142560 0x7f33041df300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:38.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f3303fff640 1 -- 172.21.15.28:0/1043438319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f4009420 con 0x7f33040b5dd0 2023-11-28T19:31:38.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f3303fff640 1 --2- 172.21.15.28:0/1043438319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33040b5dd0 0x7f33041dedc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f32f800c460 tx=0x7f32f800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:38.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f33017fa640 1 -- 172.21.15.28:0/1043438319 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80052d0 con 0x7f33040b5dd0 2023-11-28T19:31:38.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f33017fa640 1 -- 172.21.15.28:0/1043438319 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f8005430 con 0x7f33040b5dd0 2023-11-28T19:31:38.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 -- 172.21.15.28:0/1043438319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33041e28d0 con 0x7f33040b5dd0 2023-11-28T19:31:38.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f33017fa640 1 -- 172.21.15.28:0/1043438319 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f8007260 con 0x7f33040b5dd0 2023-11-28T19:31:38.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.955+0000 7f330ab01640 1 -- 172.21.15.28:0/1043438319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33041e2250 con 0x7f33040b5dd0 2023-11-28T19:31:38.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.959+0000 7f330ab01640 1 -- 172.21.15.28:0/1043438319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3304074a90 con 0x7f33040b5dd0 2023-11-28T19:31:38.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.959+0000 7f33017fa640 1 -- 172.21.15.28:0/1043438319 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f32f80073c0 con 0x7f33040b5dd0 2023-11-28T19:31:38.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.959+0000 7f33017fa640 1 --2- 172.21.15.28:0/1043438319 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f32f0066470 0x7f32f0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:38.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.959+0000 7f33017fa640 1 -- 172.21.15.28:0/1043438319 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f32f80834c0 con 0x7f33040b5dd0 2023-11-28T19:31:38.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.959+0000 7f330889d640 1 --2- 172.21.15.28:0/1043438319 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f32f0066470 0x7f32f0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:38.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.959+0000 7f330889d640 1 --2- 172.21.15.28:0/1043438319 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f32f0066470 0x7f32f0068930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f32f40b2000 tx=0x7f32f40aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:38.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:38.963+0000 7f33017fa640 1 -- 172.21.15.28:0/1043438319 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f32f8050b70 con 0x7f33040b5dd0 2023-11-28T19:31:39.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:39.151+0000 7f330ab01640 1 -- 172.21.15.28:0/1043438319 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33041e3060 con 0x7f33040b5dd0 2023-11-28T19:31:39.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:39.151+0000 7f33017fa640 1 -- 172.21.15.28:0/1043438319 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7f32f8054190 con 0x7f33040b5dd0 2023-11-28T19:31:39.157 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:39.157 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2598774147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2598774147},{"type":"v1","addr":"172.21.15.28:6835","nonce":2598774147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-28T19:31:39.158 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 2 2023-11-28T19:31:39.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:39.155+0000 7f330ab01640 1 -- 172.21.15.28:0/1043438319 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f32f0066470 msgr2=0x7f32f0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:39.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:39.155+0000 7f330ab01640 1 --2- 172.21.15.28:0/1043438319 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f32f0066470 0x7f32f0068930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f32f40b2000 tx=0x7f32f40aa070 comp rx=0 tx=0).stop 2023-11-28T19:31:39.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:39.155+0000 7f330ab01640 1 -- 172.21.15.28:0/1043438319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33040b5dd0 msgr2=0x7f33041dedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:39.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:39.155+0000 7f330ab01640 1 --2- 172.21.15.28:0/1043438319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33040b5dd0 0x7f33041dedc0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f32f800c460 tx=0x7f32f800c920 comp rx=0 tx=0).stop 2023-11-28T19:31:39.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:39.155+0000 7f330ab01640 1 -- 172.21.15.28:0/1043438319 shutdown_connections 2023-11-28T19:31:39.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:39.155+0000 7f330ab01640 1 --2- 172.21.15.28:0/1043438319 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f32f0066470 0x7f32f0068930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:39.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:39.155+0000 7f330ab01640 1 --2- 172.21.15.28:0/1043438319 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3304142560 0x7f33041df300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:39.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:39.155+0000 7f330ab01640 1 --2- 172.21.15.28:0/1043438319 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f33040b5dd0 0x7f33041dedc0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:39.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:39.155+0000 7f330ab01640 1 --2- 172.21.15.28:0/1043438319 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f33040b4610 0x7f330413b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:39.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:39.155+0000 7f330ab01640 1 -- 172.21.15.28:0/1043438319 >> 172.21.15.28:0/1043438319 conn(0x7f33040bcb40 msgr2=0x7f33040b9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:39.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:39.155+0000 7f330ab01640 1 -- 172.21.15.28:0/1043438319 shutdown_connections 2023-11-28T19:31:39.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:39.155+0000 7f330ab01640 1 -- 172.21.15.28:0/1043438319 wait complete. 2023-11-28T19:31:41.176 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:31:41.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.307+0000 7fd20c03c640 1 Processor -- start 2023-11-28T19:31:41.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.307+0000 7fd20c03c640 1 -- start start 2023-11-28T19:31:41.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd20c03c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd2040beb10 0x7fd2040b8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd20c03c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd20414ba80 0x7fd20414be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd20c03c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2040b9680 con 0x7fd204141df0 2023-11-28T19:31:41.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd20c03c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd20414b5f0 con 0x7fd20414ba80 2023-11-28T19:31:41.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd20c03c640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2041421d0 con 0x7fd2040beb10 2023-11-28T19:31:41.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd20a5d9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd20414ba80 0x7fd20414be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd20a5d9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd20414ba80 0x7fd20414be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34060/0 (socket says 172.21.15.28:34060) 2023-11-28T19:31:41.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd20a5d9640 1 -- 172.21.15.28:0/995640386 learned_addr learned my addr 172.21.15.28:0/995640386 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:41.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd2095d7640 1 --2- 172.21.15.28:0/995640386 >> v2:172.21.15.131:3300/0 conn(0x7fd2040beb10 0x7fd2040b8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd20a5d9640 1 -- 172.21.15.28:0/995640386 >> v2:172.21.15.131:3300/0 conn(0x7fd2040beb10 msgr2=0x7fd2040b8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:41.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd20a5d9640 1 --2- 172.21.15.28:0/995640386 >> v2:172.21.15.131:3300/0 conn(0x7fd2040beb10 0x7fd2040b8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd20a5d9640 1 -- 172.21.15.28:0/995640386 >> v1:172.21.15.131:6789/0 conn(0x7fd204141df0 legacy=0x7fd20406d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:41.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd20a5d9640 1 -- 172.21.15.28:0/995640386 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2040befa0 con 0x7fd20414ba80 2023-11-28T19:31:41.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd20a5d9640 1 --2- 172.21.15.28:0/995640386 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20414ba80 0x7fd20414be90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2040671e0 tx=0x7fd1fc01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b080d476f2426a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:41.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd208dd6640 1 -- 172.21.15.28:0/995640386 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0a5870 con 0x7fd20414ba80 2023-11-28T19:31:41.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd208dd6640 1 -- 172.21.15.28:0/995640386 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1fc0a59d0 con 0x7fd20414ba80 2023-11-28T19:31:41.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.311+0000 7fd208dd6640 1 -- 172.21.15.28:0/995640386 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc0a5d60 con 0x7fd20414ba80 2023-11-28T19:31:41.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 -- 172.21.15.28:0/995640386 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20414ba80 msgr2=0x7fd20414be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 --2- 172.21.15.28:0/995640386 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20414ba80 0x7fd20414be90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd2040671e0 tx=0x7fd1fc01c9d0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 -- 172.21.15.28:0/995640386 shutdown_connections 2023-11-28T19:31:41.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 --2- 172.21.15.28:0/995640386 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20414ba80 0x7fd20414be90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 --2- 172.21.15.28:0/995640386 >> v2:172.21.15.131:3300/0 conn(0x7fd2040beb10 0x7fd2040b8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 -- 172.21.15.28:0/995640386 >> 172.21.15.28:0/995640386 conn(0x7fd2040662a0 msgr2=0x7fd2040666b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:41.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 -- 172.21.15.28:0/995640386 shutdown_connections 2023-11-28T19:31:41.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 -- 172.21.15.28:0/995640386 wait complete. 2023-11-28T19:31:41.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 Processor -- start 2023-11-28T19:31:41.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 -- start start 2023-11-28T19:31:41.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd204141df0 0x7fd2041e6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20414ba80 0x7fd20413fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd204136f60 0x7fd204140100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd204135c60 con 0x7fd20414ba80 2023-11-28T19:31:41.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd204135f40 con 0x7fd204141df0 2023-11-28T19:31:41.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2041e7140 con 0x7fd204136f60 2023-11-28T19:31:41.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd2095d7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20414ba80 0x7fd20413fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd2095d7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20414ba80 0x7fd20413fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34070/0 (socket says 172.21.15.28:34070) 2023-11-28T19:31:41.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd2095d7640 1 -- 172.21.15.28:0/1240243609 learned_addr learned my addr 172.21.15.28:0/1240243609 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:41.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd209dd8640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd204141df0 0x7fd2041e6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20a5d9640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd204136f60 0x7fd204140100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd2095d7640 1 -- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd204136f60 msgr2=0x7fd204140100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd2095d7640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd204136f60 0x7fd204140100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd2095d7640 1 -- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd204141df0 msgr2=0x7fd2041e6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd2095d7640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd204141df0 0x7fd2041e6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd2095d7640 1 -- 172.21.15.28:0/1240243609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1fc009b30 con 0x7fd20414ba80 2023-11-28T19:31:41.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd209dd8640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd204141df0 0x7fd2041e6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:41.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20a5d9640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd204136f60 0x7fd204140100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:41.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd2095d7640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20414ba80 0x7fd20413fbc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd20000d800 tx=0x7fd20000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:41.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd1fa7fc640 1 -- 172.21.15.28:0/1240243609 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000b6c0 con 0x7fd20414ba80 2023-11-28T19:31:41.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd1fa7fc640 1 -- 172.21.15.28:0/1240243609 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20000b820 con 0x7fd20414ba80 2023-11-28T19:31:41.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 -- 172.21.15.28:0/1240243609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd204137440 con 0x7fd20414ba80 2023-11-28T19:31:41.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd1fa7fc640 1 -- 172.21.15.28:0/1240243609 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000bb90 con 0x7fd20414ba80 2023-11-28T19:31:41.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 -- 172.21.15.28:0/1240243609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2041e76f0 con 0x7fd20414ba80 2023-11-28T19:31:41.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.315+0000 7fd20c03c640 1 -- 172.21.15.28:0/1240243609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2041360b0 con 0x7fd20414ba80 2023-11-28T19:31:41.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.319+0000 7fd1fa7fc640 1 -- 172.21.15.28:0/1240243609 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd20000bcf0 con 0x7fd20414ba80 2023-11-28T19:31:41.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.319+0000 7fd1fa7fc640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd1e8066470 0x7fd1e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.319+0000 7fd1fa7fc640 1 -- 172.21.15.28:0/1240243609 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd200084030 con 0x7fd20414ba80 2023-11-28T19:31:41.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.319+0000 7fd209dd8640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd1e8066470 0x7fd1e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.319+0000 7fd209dd8640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd1e8066470 0x7fd1e8068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4000f70 tx=0x7fd1f4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:41.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.323+0000 7fd1fa7fc640 1 -- 172.21.15.28:0/1240243609 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd200051890 con 0x7fd20414ba80 2023-11-28T19:31:41.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.515+0000 7fd20c03c640 1 -- 172.21.15.28:0/1240243609 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd204074a90 con 0x7fd20414ba80 2023-11-28T19:31:41.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.515+0000 7fd1fa7fc640 1 -- 172.21.15.28:0/1240243609 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2907 (secure 0 0 0) 0x7fd200011340 con 0x7fd20414ba80 2023-11-28T19:31:41.519 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:41.519 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3575778574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3575778574},{"type":"v1","addr":"172.21.15.131:6835","nonce":3575778574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6833/1578638846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1578638846},{"type":"v1","addr":"172.21.15.28:6833","nonce":1578638846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/2598774147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2598774147},{"type":"v1","addr":"172.21.15.28:6835","nonce":2598774147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-11-28T19:31:41.519 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 3 2023-11-28T19:31:41.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.515+0000 7fd20c03c640 1 -- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd1e8066470 msgr2=0x7fd1e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.515+0000 7fd20c03c640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd1e8066470 0x7fd1e8068930 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd1f4000f70 tx=0x7fd1f4009040 comp rx=0 tx=0).stop 2023-11-28T19:31:41.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.515+0000 7fd20c03c640 1 -- 172.21.15.28:0/1240243609 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20414ba80 msgr2=0x7fd20413fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.515+0000 7fd20c03c640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20414ba80 0x7fd20413fbc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd20000d800 tx=0x7fd20000dcc0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.515+0000 7fd20c03c640 1 -- 172.21.15.28:0/1240243609 shutdown_connections 2023-11-28T19:31:41.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.515+0000 7fd20c03c640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd1e8066470 0x7fd1e8068930 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.515+0000 7fd20c03c640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd204136f60 0x7fd204140100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.515+0000 7fd20c03c640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd20414ba80 0x7fd20413fbc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.515+0000 7fd20c03c640 1 --2- 172.21.15.28:0/1240243609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd204141df0 0x7fd2041e6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.515+0000 7fd20c03c640 1 -- 172.21.15.28:0/1240243609 >> 172.21.15.28:0/1240243609 conn(0x7fd2040662a0 msgr2=0x7fd2040badb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:41.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.515+0000 7fd20c03c640 1 -- 172.21.15.28:0/1240243609 shutdown_connections 2023-11-28T19:31:41.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.515+0000 7fd20c03c640 1 -- 172.21.15.28:0/1240243609 wait complete. 2023-11-28T19:31:41.539 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:41.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.655+0000 7fc543bf5640 1 Processor -- start 2023-11-28T19:31:41.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.655+0000 7fc543bf5640 1 -- start start 2023-11-28T19:31:41.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.655+0000 7fc543bf5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc53c149f50 0x7fc53c0ba9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.655+0000 7fc543bf5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53c0b8860 con 0x7fc53c1494b0 2023-11-28T19:31:41.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.655+0000 7fc543bf5640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc53c06fd70 con 0x7fc53c149890 2023-11-28T19:31:41.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.655+0000 7fc543bf5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc53c06f7b0 con 0x7fc53c149f50 2023-11-28T19:31:41.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.655+0000 7fc542192640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc53c149f50 0x7fc53c0ba9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.655+0000 7fc541991640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc53c1494b0 0x7fc53c0b5710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57346/0 (socket says 172.21.15.28:57346) 2023-11-28T19:31:41.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.655+0000 7fc541991640 1 -- 172.21.15.28:0/2432862638 learned_addr learned my addr 172.21.15.28:0/2432862638 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:41.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.655+0000 7fc542192640 1 -- 172.21.15.28:0/2432862638 >> v1:172.21.15.131:6789/0 conn(0x7fc53c149890 legacy=0x7fc53c0b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:41.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.655+0000 7fc542192640 1 -- 172.21.15.28:0/2432862638 >> v1:172.21.15.28:6789/0 conn(0x7fc53c1494b0 legacy=0x7fc53c0b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.655+0000 7fc54098f640 1 -- 172.21.15.28:0/2432862638 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152062830 0 0) 0x7fc53c0b8860 con 0x7fc53c1494b0 2023-11-28T19:31:41.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.655+0000 7fc542192640 1 -- 172.21.15.28:0/2432862638 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c06fa90 con 0x7fc53c149f50 2023-11-28T19:31:41.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.655+0000 7fc542192640 1 --2- 172.21.15.28:0/2432862638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc53c149f50 0x7fc53c0ba9f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc5340097c0 tx=0x7fc53401c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=486bf9d93011949c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:41.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc54098f640 1 -- 172.21.15.28:0/2432862638 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5340ab660 con 0x7fc53c149f50 2023-11-28T19:31:41.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc54098f640 1 -- 172.21.15.28:0/2432862638 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5340ab7c0 con 0x7fc53c149f50 2023-11-28T19:31:41.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc54098f640 1 -- 172.21.15.28:0/2432862638 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5340abb50 con 0x7fc53c149f50 2023-11-28T19:31:41.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 -- 172.21.15.28:0/2432862638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc53c149f50 msgr2=0x7fc53c0ba9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 --2- 172.21.15.28:0/2432862638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc53c149f50 0x7fc53c0ba9f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc5340097c0 tx=0x7fc53401c440 comp rx=0 tx=0).stop 2023-11-28T19:31:41.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 -- 172.21.15.28:0/2432862638 shutdown_connections 2023-11-28T19:31:41.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 --2- 172.21.15.28:0/2432862638 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc53c149f50 0x7fc53c0ba9f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 -- 172.21.15.28:0/2432862638 >> 172.21.15.28:0/2432862638 conn(0x7fc53c0beaf0 msgr2=0x7fc53c0bef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:41.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 -- 172.21.15.28:0/2432862638 shutdown_connections 2023-11-28T19:31:41.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 -- 172.21.15.28:0/2432862638 wait complete. 2023-11-28T19:31:41.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 Processor -- start 2023-11-28T19:31:41.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 -- start start 2023-11-28T19:31:41.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc53c1494b0 0x7fc53c0b9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc53c149890 0x7fc53c1e53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc53c149f50 0x7fc53c1e58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c0ba400 con 0x7fc53c149890 2023-11-28T19:31:41.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c146930 con 0x7fc53c149f50 2023-11-28T19:31:41.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc53c146000 con 0x7fc53c1494b0 2023-11-28T19:31:41.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc541190640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc53c149890 0x7fc53c1e53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc541190640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc53c149890 0x7fc53c1e53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34100/0 (socket says 172.21.15.28:34100) 2023-11-28T19:31:41.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc541190640 1 -- 172.21.15.28:0/4050573491 learned_addr learned my addr 172.21.15.28:0/4050573491 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:41.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc541991640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc53c1494b0 0x7fc53c0b9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc542192640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc53c149f50 0x7fc53c1e58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc541190640 1 -- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc53c1494b0 msgr2=0x7fc53c0b9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc541190640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc53c1494b0 0x7fc53c0b9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc541190640 1 -- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc53c149f50 msgr2=0x7fc53c1e58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc541190640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc53c149f50 0x7fc53c1e58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc541190640 1 -- 172.21.15.28:0/4050573491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc534009420 con 0x7fc53c149890 2023-11-28T19:31:41.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc542192640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc53c149f50 0x7fc53c1e58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:41.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc541190640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc53c149890 0x7fc53c1e53a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc53000c450 tx=0x7fc53000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:41.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc53a7fc640 1 -- 172.21.15.28:0/4050573491 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530012830 con 0x7fc53c149890 2023-11-28T19:31:41.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc53a7fc640 1 -- 172.21.15.28:0/4050573491 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5300129b0 con 0x7fc53c149890 2023-11-28T19:31:41.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 -- 172.21.15.28:0/4050573491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc53c1462e0 con 0x7fc53c149890 2023-11-28T19:31:41.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc53a7fc640 1 -- 172.21.15.28:0/4050573491 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc530012d60 con 0x7fc53c149890 2023-11-28T19:31:41.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.659+0000 7fc543bf5640 1 -- 172.21.15.28:0/4050573491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53c13e5b0 con 0x7fc53c149890 2023-11-28T19:31:41.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.663+0000 7fc543bf5640 1 -- 172.21.15.28:0/4050573491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53c074a90 con 0x7fc53c149890 2023-11-28T19:31:41.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.663+0000 7fc53a7fc640 1 -- 172.21.15.28:0/4050573491 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc53001c460 con 0x7fc53c149890 2023-11-28T19:31:41.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.663+0000 7fc53a7fc640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc528066470 0x7fc528068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.663+0000 7fc53a7fc640 1 -- 172.21.15.28:0/4050573491 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc530083950 con 0x7fc53c149890 2023-11-28T19:31:41.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.663+0000 7fc541991640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc528066470 0x7fc528068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.663+0000 7fc541991640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc528066470 0x7fc528068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0012f0 tx=0x7fc52c005ec0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:41.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.667+0000 7fc53a7fc640 1 -- 172.21.15.28:0/4050573491 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc530051120 con 0x7fc53c149890 2023-11-28T19:31:41.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.823+0000 7fc543bf5640 1 -- 172.21.15.28:0/4050573491 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc53c13b140 con 0x7fc53c149890 2023-11-28T19:31:41.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.827+0000 7fc53a7fc640 1 -- 172.21.15.28:0/4050573491 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fc530054740 con 0x7fc53c149890 2023-11-28T19:31:41.831 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:41.831 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":17,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:36.063116+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:41.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.827+0000 7fc543bf5640 1 -- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc528066470 msgr2=0x7fc528068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.827+0000 7fc543bf5640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc528066470 0x7fc528068930 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc52c0012f0 tx=0x7fc52c005ec0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.827+0000 7fc543bf5640 1 -- 172.21.15.28:0/4050573491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc53c149890 msgr2=0x7fc53c1e53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.827+0000 7fc543bf5640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc53c149890 0x7fc53c1e53a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc53000c450 tx=0x7fc53000c910 comp rx=0 tx=0).stop 2023-11-28T19:31:41.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.831+0000 7fc543bf5640 1 -- 172.21.15.28:0/4050573491 shutdown_connections 2023-11-28T19:31:41.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.831+0000 7fc543bf5640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc528066470 0x7fc528068930 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.831+0000 7fc543bf5640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc53c149f50 0x7fc53c1e58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.831+0000 7fc543bf5640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc53c149890 0x7fc53c1e53a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.831+0000 7fc543bf5640 1 --2- 172.21.15.28:0/4050573491 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc53c1494b0 0x7fc53c0b9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.831+0000 7fc543bf5640 1 -- 172.21.15.28:0/4050573491 >> 172.21.15.28:0/4050573491 conn(0x7fc53c0beaf0 msgr2=0x7fc53c0b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:41.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.831+0000 7fc543bf5640 1 -- 172.21.15.28:0/4050573491 shutdown_connections 2023-11-28T19:31:41.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.831+0000 7fc543bf5640 1 -- 172.21.15.28:0/4050573491 wait complete. 2023-11-28T19:31:41.849 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:31:33.212362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T19:31:41.850 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:31:41.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c3779640 1 Processor -- start 2023-11-28T19:31:41.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c3779640 1 -- start start 2023-11-28T19:31:41.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c3779640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd6bc0b7320 0x7fd6bc0bd100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c3779640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd6bc0bf0f0 0x7fd6bc0bf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c3779640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6bc14f7a0 con 0x7fd6bc0c0850 2023-11-28T19:31:41.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c3779640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6bc0b7700 con 0x7fd6bc0bf0f0 2023-11-28T19:31:41.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c3779640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6bc0bfac0 con 0x7fd6bc0b7320 2023-11-28T19:31:41.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c1d16640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd6bc0bf0f0 0x7fd6bc0bf580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c1d16640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd6bc0bf0f0 0x7fd6bc0bf580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34102/0 (socket says 172.21.15.28:34102) 2023-11-28T19:31:41.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c1d16640 1 -- 172.21.15.28:0/1638438680 learned_addr learned my addr 172.21.15.28:0/1638438680 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:41.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c0d14640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd6bc0c0850 0x7fd6bc14e930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57354/0 (socket says 172.21.15.28:57354) 2023-11-28T19:31:41.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c1d16640 1 -- 172.21.15.28:0/1638438680 >> v2:172.21.15.131:3300/0 conn(0x7fd6bc0b7320 msgr2=0x7fd6bc0bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:41.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c1515640 1 --2- 172.21.15.28:0/1638438680 >> v2:172.21.15.131:3300/0 conn(0x7fd6bc0b7320 0x7fd6bc0bd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6b3fff640 1 -- 172.21.15.28:0/1638438680 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1260743688 0 0) 0x7fd6bc14f7a0 con 0x7fd6bc0c0850 2023-11-28T19:31:41.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c1d16640 1 --2- 172.21.15.28:0/1638438680 >> v2:172.21.15.131:3300/0 conn(0x7fd6bc0b7320 0x7fd6bc0bd100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c1d16640 1 -- 172.21.15.28:0/1638438680 >> v1:172.21.15.28:6789/0 conn(0x7fd6bc0c0850 legacy=0x7fd6bc14e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c1d16640 1 -- 172.21.15.28:0/1638438680 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc0b7970 con 0x7fd6bc0bf0f0 2023-11-28T19:31:41.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c1515640 1 --2- 172.21.15.28:0/1638438680 >> v2:172.21.15.131:3300/0 conn(0x7fd6bc0b7320 0x7fd6bc0bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:41.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.963+0000 7fd6c1d16640 1 --2- 172.21.15.28:0/1638438680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6bc0bf0f0 0x7fd6bc0bf580 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc072d90 tx=0x7fd6b401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da47da81dd991ff8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:41.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6b3fff640 1 -- 172.21.15.28:0/1638438680 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40a5690 con 0x7fd6bc0bf0f0 2023-11-28T19:31:41.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6b3fff640 1 -- 172.21.15.28:0/1638438680 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b40a57f0 con 0x7fd6bc0bf0f0 2023-11-28T19:31:41.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6b3fff640 1 -- 172.21.15.28:0/1638438680 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40a5b80 con 0x7fd6bc0bf0f0 2023-11-28T19:31:41.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 -- 172.21.15.28:0/1638438680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6bc0bf0f0 msgr2=0x7fd6bc0bf580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 --2- 172.21.15.28:0/1638438680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6bc0bf0f0 0x7fd6bc0bf580 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc072d90 tx=0x7fd6b401c9d0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 -- 172.21.15.28:0/1638438680 shutdown_connections 2023-11-28T19:31:41.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 --2- 172.21.15.28:0/1638438680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6bc0bf0f0 0x7fd6bc0bf580 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 --2- 172.21.15.28:0/1638438680 >> v2:172.21.15.131:3300/0 conn(0x7fd6bc0b7320 0x7fd6bc0bd100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 -- 172.21.15.28:0/1638438680 >> 172.21.15.28:0/1638438680 conn(0x7fd6bc0bd780 msgr2=0x7fd6bc0bdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:41.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 -- 172.21.15.28:0/1638438680 shutdown_connections 2023-11-28T19:31:41.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 -- 172.21.15.28:0/1638438680 wait complete. 2023-11-28T19:31:41.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 Processor -- start 2023-11-28T19:31:41.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 -- start start 2023-11-28T19:31:41.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6bc0b7320 0x7fd6bc0a4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6bc0bf0f0 0x7fd6bc13bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6bc0c0850 0x7fd6bc0a5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc0a4e70 con 0x7fd6bc0c0850 2023-11-28T19:31:41.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc1e4440 con 0x7fd6bc0b7320 2023-11-28T19:31:41.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c3779640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6bc1e3df0 con 0x7fd6bc0bf0f0 2023-11-28T19:31:41.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c1d16640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6bc0c0850 0x7fd6bc0a5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c1d16640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6bc0c0850 0x7fd6bc0a5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34118/0 (socket says 172.21.15.28:34118) 2023-11-28T19:31:41.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c1d16640 1 -- 172.21.15.28:0/2549050849 learned_addr learned my addr 172.21.15.28:0/2549050849 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:41.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c1515640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6bc0b7320 0x7fd6bc0a4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c0d14640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6bc0bf0f0 0x7fd6bc13bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c1d16640 1 -- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6bc0bf0f0 msgr2=0x7fd6bc13bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c1d16640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6bc0bf0f0 0x7fd6bc13bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c1d16640 1 -- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6bc0b7320 msgr2=0x7fd6bc0a4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:41.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c1d16640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6bc0b7320 0x7fd6bc0a4930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:41.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c1d16640 1 -- 172.21.15.28:0/2549050849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b4009b30 con 0x7fd6bc0c0850 2023-11-28T19:31:41.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c1515640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6bc0b7320 0x7fd6bc0a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:41.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c0d14640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6bc0bf0f0 0x7fd6bc13bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:41.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6c1d16640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6bc0c0850 0x7fd6bc0a5800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40195e0 tx=0x7fd6b4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:41.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6b1ffb640 1 -- 172.21.15.28:0/2549050849 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40b8670 con 0x7fd6bc0c0850 2023-11-28T19:31:41.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6b1ffb640 1 -- 172.21.15.28:0/2549050849 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b40b87d0 con 0x7fd6bc0c0850 2023-11-28T19:31:41.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.967+0000 7fd6b1ffb640 1 -- 172.21.15.28:0/2549050849 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b40b8b40 con 0x7fd6bc0c0850 2023-11-28T19:31:41.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.971+0000 7fd6c3779640 1 -- 172.21.15.28:0/2549050849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6bc1e40d0 con 0x7fd6bc0c0850 2023-11-28T19:31:41.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.971+0000 7fd6c3779640 1 -- 172.21.15.28:0/2549050849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6bc0a5060 con 0x7fd6bc0c0850 2023-11-28T19:31:41.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.971+0000 7fd6c3779640 1 -- 172.21.15.28:0/2549050849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6bc1e45d0 con 0x7fd6bc0c0850 2023-11-28T19:31:41.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.971+0000 7fd6b1ffb640 1 -- 172.21.15.28:0/2549050849 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd6b40b8ca0 con 0x7fd6bc0c0850 2023-11-28T19:31:41.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.971+0000 7fd6b1ffb640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd6a0066470 0x7fd6a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:41.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.971+0000 7fd6b1ffb640 1 -- 172.21.15.28:0/2549050849 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd6b411f100 con 0x7fd6bc0c0850 2023-11-28T19:31:41.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.971+0000 7fd6c1515640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd6a0066470 0x7fd6a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:41.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.971+0000 7fd6c1515640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd6a0066470 0x7fd6a0068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8008890 tx=0x7fd6b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:41.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:41.975+0000 7fd6b1ffb640 1 -- 172.21.15.28:0/2549050849 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd6b40eca80 con 0x7fd6bc0c0850 2023-11-28T19:31:42.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.131+0000 7fd6c3779640 1 -- 172.21.15.28:0/2549050849 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6bc0bfdd0 con 0x7fd6bc0c0850 2023-11-28T19:31:42.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.131+0000 7fd6b1ffb640 1 -- 172.21.15.28:0/2549050849 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6b40f00a0 con 0x7fd6bc0c0850 2023-11-28T19:31:42.135 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-28T19:31:42.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.135+0000 7fd6c3779640 1 -- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd6a0066470 msgr2=0x7fd6a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:42.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.135+0000 7fd6c3779640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd6a0066470 0x7fd6a0068930 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8008890 tx=0x7fd6b8008040 comp rx=0 tx=0).stop 2023-11-28T19:31:42.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.135+0000 7fd6c3779640 1 -- 172.21.15.28:0/2549050849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6bc0c0850 msgr2=0x7fd6bc0a5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:42.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.135+0000 7fd6c3779640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6bc0c0850 0x7fd6bc0a5800 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd6b40195e0 tx=0x7fd6b4019770 comp rx=0 tx=0).stop 2023-11-28T19:31:42.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.135+0000 7fd6c3779640 1 -- 172.21.15.28:0/2549050849 shutdown_connections 2023-11-28T19:31:42.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.135+0000 7fd6c3779640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd6a0066470 0x7fd6a0068930 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.135+0000 7fd6c3779640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd6bc0c0850 0x7fd6bc0a5800 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.135+0000 7fd6c3779640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd6bc0bf0f0 0x7fd6bc13bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.135+0000 7fd6c3779640 1 --2- 172.21.15.28:0/2549050849 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6bc0b7320 0x7fd6bc0a4930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.135+0000 7fd6c3779640 1 -- 172.21.15.28:0/2549050849 >> 172.21.15.28:0/2549050849 conn(0x7fd6bc0bd780 msgr2=0x7fd6bc141290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:42.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.135+0000 7fd6c3779640 1 -- 172.21.15.28:0/2549050849 shutdown_connections 2023-11-28T19:31:42.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.135+0000 7fd6c3779640 1 -- 172.21.15.28:0/2549050849 wait complete. 2023-11-28T19:31:42.154 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T19:31:42.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f372cb28640 1 Processor -- start 2023-11-28T19:31:42.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f372cb28640 1 -- start start 2023-11-28T19:31:42.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f372cb28640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3728142560 0x7f37280b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f372cb28640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37280b4aa0 con 0x7f37280b5dd0 2023-11-28T19:31:42.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f372cb28640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3728142940 con 0x7f37280b4610 2023-11-28T19:31:42.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f372cb28640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f372806f950 con 0x7f3728142560 2023-11-28T19:31:42.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f371ffff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f37280b5dd0 0x7f37280b6470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57364/0 (socket says 172.21.15.28:57364) 2023-11-28T19:31:42.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f371ffff640 1 -- 172.21.15.28:0/3438300832 learned_addr learned my addr 172.21.15.28:0/3438300832 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:42.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 -- 172.21.15.28:0/3438300832 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 248466316 0 0) 0x7f37280b4aa0 con 0x7f37280b5dd0 2023-11-28T19:31:42.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f372659c640 1 --2- 172.21.15.28:0/3438300832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3728142560 0x7f37280b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 -- 172.21.15.28:0/3438300832 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3714003530 con 0x7f37280b5dd0 2023-11-28T19:31:42.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 -- 172.21.15.28:0/3438300832 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1364428419 0 0) 0x7f3714003530 con 0x7f37280b5dd0 2023-11-28T19:31:42.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 -- 172.21.15.28:0/3438300832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3728142560 msgr2=0x7f37280b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:42.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 --2- 172.21.15.28:0/3438300832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3728142560 0x7f37280b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 -- 172.21.15.28:0/3438300832 >> v1:172.21.15.131:6789/0 conn(0x7f37280b4610 legacy=0x7f3728152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:42.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 -- 172.21.15.28:0/3438300832 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f372814bb40 con 0x7f37280b5dd0 2023-11-28T19:31:42.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 -- 172.21.15.28:0/3438300832 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f3718001680 con 0x7f37280b5dd0 2023-11-28T19:31:42.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 -- 172.21.15.28:0/3438300832 >> v1:172.21.15.28:6789/0 conn(0x7f37280b5dd0 legacy=0x7f37280b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:42.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 --2- 172.21.15.28:0/3438300832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3728142560 0x7f37140039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 --2- 172.21.15.28:0/3438300832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3714003f30 0x7f37140047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 --2- 172.21.15.28:0/3438300832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3714004d10 0x7f3714005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 -- 172.21.15.28:0/3438300832 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f372806f950 con 0x7f3714003f30 2023-11-28T19:31:42.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 -- 172.21.15.28:0/3438300832 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f371400bb00 con 0x7f3714004d10 2023-11-28T19:31:42.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3725d9b640 1 -- 172.21.15.28:0/3438300832 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f371400bcc0 con 0x7f3728142560 2023-11-28T19:31:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f371ffff640 1 --2- 172.21.15.28:0/3438300832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3714003f30 0x7f37140047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f372659c640 1 --2- 172.21.15.28:0/3438300832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3728142560 0x7f37140039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3726d9d640 1 --2- 172.21.15.28:0/3438300832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3714004d10 0x7f3714005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f371ffff640 1 -- 172.21.15.28:0/3438300832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3728142560 msgr2=0x7f37140039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f371ffff640 1 --2- 172.21.15.28:0/3438300832 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3728142560 0x7f37140039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f371ffff640 1 -- 172.21.15.28:0/3438300832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3714004d10 msgr2=0x7f3714005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:42.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f371ffff640 1 --2- 172.21.15.28:0/3438300832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3714004d10 0x7f3714005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f371ffff640 1 -- 172.21.15.28:0/3438300832 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3714003530 con 0x7f3714003f30 2023-11-28T19:31:42.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.279+0000 7f3726d9d640 1 --2- 172.21.15.28:0/3438300832 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3714004d10 0x7f3714005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:42.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f371ffff640 1 --2- 172.21.15.28:0/3438300832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3714003f30 0x7f37140047d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f371800c210 tx=0x7f371801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b4945fda21c2ae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:42.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f3725d9b640 1 -- 172.21.15.28:0/3438300832 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37180a5b20 con 0x7f3714003f30 2023-11-28T19:31:42.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f3725d9b640 1 -- 172.21.15.28:0/3438300832 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37180a5c80 con 0x7f3714003f30 2023-11-28T19:31:42.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f3725d9b640 1 -- 172.21.15.28:0/3438300832 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3718005b20 con 0x7f3714003f30 2023-11-28T19:31:42.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372cb28640 1 -- 172.21.15.28:0/3438300832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3714003f30 msgr2=0x7f37140047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:42.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372cb28640 1 --2- 172.21.15.28:0/3438300832 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3714003f30 0x7f37140047d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f371800c210 tx=0x7f371801cc20 comp rx=0 tx=0).stop 2023-11-28T19:31:42.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f3726d9d640 1 -- 172.21.15.28:0/3438300832 reap_dead start 2023-11-28T19:31:42.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372cb28640 1 -- 172.21.15.28:0/3438300832 shutdown_connections 2023-11-28T19:31:42.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372cb28640 1 -- 172.21.15.28:0/3438300832 >> 172.21.15.28:0/3438300832 conn(0x7f37280bcb40 msgr2=0x7f37280bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:42.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372cb28640 1 -- 172.21.15.28:0/3438300832 shutdown_connections 2023-11-28T19:31:42.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372cb28640 1 -- 172.21.15.28:0/3438300832 wait complete. 2023-11-28T19:31:42.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372cb28640 1 Processor -- start 2023-11-28T19:31:42.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372cb28640 1 -- start start 2023-11-28T19:31:42.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372cb28640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3714003f30 0x7f3728142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372cb28640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37281d3410 0x7f37281d2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372cb28640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37281d3870 0x7f37281d27a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372cb28640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37281417c0 con 0x7f37281d3410 2023-11-28T19:31:42.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372cb28640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37281433f0 con 0x7f37281d3870 2023-11-28T19:31:42.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372cb28640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37281d3cf0 con 0x7f3714003f30 2023-11-28T19:31:42.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f371ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37281d3410 0x7f37281d2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f371ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37281d3410 0x7f37281d2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34136/0 (socket says 172.21.15.28:34136) 2023-11-28T19:31:42.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f371ffff640 1 -- 172.21.15.28:0/1358779436 learned_addr learned my addr 172.21.15.28:0/1358779436 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:42.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f3726d9d640 1 --2- 172.21.15.28:0/1358779436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37281d3870 0x7f37281d27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f372659c640 1 --2- 172.21.15.28:0/1358779436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3714003f30 0x7f3728142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f371ffff640 1 -- 172.21.15.28:0/1358779436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3714003f30 msgr2=0x7f3728142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:42.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f371ffff640 1 --2- 172.21.15.28:0/1358779436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3714003f30 0x7f3728142eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f371ffff640 1 -- 172.21.15.28:0/1358779436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37281d3870 msgr2=0x7f37281d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:42.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.283+0000 7f371ffff640 1 --2- 172.21.15.28:0/1358779436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37281d3870 0x7f37281d27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.287+0000 7f371ffff640 1 -- 172.21.15.28:0/1358779436 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37281d1d40 con 0x7f37281d3410 2023-11-28T19:31:42.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.287+0000 7f371ffff640 1 --2- 172.21.15.28:0/1358779436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37281d3410 0x7f37281d2260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f371800c210 tx=0x7f3714005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:42.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.287+0000 7f371effd640 1 -- 172.21.15.28:0/1358779436 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37180b4070 con 0x7f37281d3410 2023-11-28T19:31:42.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.287+0000 7f371effd640 1 -- 172.21.15.28:0/1358779436 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3718000ee0 con 0x7f37281d3410 2023-11-28T19:31:42.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.287+0000 7f372cb28640 1 -- 172.21.15.28:0/1358779436 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3728143670 con 0x7f37281d3410 2023-11-28T19:31:42.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.287+0000 7f371effd640 1 -- 172.21.15.28:0/1358779436 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37180a5b20 con 0x7f37281d3410 2023-11-28T19:31:42.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.287+0000 7f372cb28640 1 -- 172.21.15.28:0/1358779436 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37281d3fd0 con 0x7f37281d3410 2023-11-28T19:31:42.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.287+0000 7f372cb28640 1 -- 172.21.15.28:0/1358779436 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37281d2ce0 con 0x7f37281d3410 2023-11-28T19:31:42.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.287+0000 7f371effd640 1 -- 172.21.15.28:0/1358779436 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3718001440 con 0x7f37281d3410 2023-11-28T19:31:42.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.287+0000 7f371effd640 1 --2- 172.21.15.28:0/1358779436 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3708066460 0x7f3708068920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.287+0000 7f371effd640 1 -- 172.21.15.28:0/1358779436 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f371811da40 con 0x7f37281d3410 2023-11-28T19:31:42.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.287+0000 7f372659c640 1 --2- 172.21.15.28:0/1358779436 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3708066460 0x7f3708068920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.287+0000 7f372659c640 1 --2- 172.21.15.28:0/1358779436 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3708066460 0x7f3708068920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3710009a30 tx=0x7f3710008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:42.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.291+0000 7f371effd640 1 -- 172.21.15.28:0/1358779436 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f371811fe60 con 0x7f37281d3410 2023-11-28T19:31:42.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.451+0000 7f372cb28640 1 -- 172.21.15.28:0/1358779436 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f37281d3e30 con 0x7f37281d3410 2023-11-28T19:31:42.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.451+0000 7f371effd640 1 -- 172.21.15.28:0/1358779436 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f37281d3e30 con 0x7f37281d3410 2023-11-28T19:31:42.456 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:42.456 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2023-11-28T19:31:42.456 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:31:42.456 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2023-11-28T19:31:42.457 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2023-11-28T19:31:42.457 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:31:42.457 INFO:teuthology.orchestra.run.smithi028.stdout:] 2023-11-28T19:31:42.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.455+0000 7f372cb28640 1 -- 172.21.15.28:0/1358779436 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3708066460 msgr2=0x7f3708068920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:42.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.455+0000 7f372cb28640 1 --2- 172.21.15.28:0/1358779436 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3708066460 0x7f3708068920 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f3710009a30 tx=0x7f3710008040 comp rx=0 tx=0).stop 2023-11-28T19:31:42.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.455+0000 7f372cb28640 1 -- 172.21.15.28:0/1358779436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37281d3410 msgr2=0x7f37281d2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:42.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.455+0000 7f372cb28640 1 --2- 172.21.15.28:0/1358779436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37281d3410 0x7f37281d2260 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f371800c210 tx=0x7f3714005800 comp rx=0 tx=0).stop 2023-11-28T19:31:42.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.455+0000 7f372cb28640 1 -- 172.21.15.28:0/1358779436 shutdown_connections 2023-11-28T19:31:42.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.455+0000 7f372cb28640 1 --2- 172.21.15.28:0/1358779436 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3708066460 0x7f3708068920 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.455+0000 7f372cb28640 1 --2- 172.21.15.28:0/1358779436 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37281d3870 0x7f37281d27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.455+0000 7f372cb28640 1 --2- 172.21.15.28:0/1358779436 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37281d3410 0x7f37281d2260 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.455+0000 7f372cb28640 1 --2- 172.21.15.28:0/1358779436 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3714003f30 0x7f3728142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.455+0000 7f372cb28640 1 -- 172.21.15.28:0/1358779436 >> 172.21.15.28:0/1358779436 conn(0x7f37280bcb40 msgr2=0x7f37280b6260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:42.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.455+0000 7f372cb28640 1 -- 172.21.15.28:0/1358779436 shutdown_connections 2023-11-28T19:31:42.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.455+0000 7f372cb28640 1 -- 172.21.15.28:0/1358779436 wait complete. 2023-11-28T19:31:42.475 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T19:31:42.475 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T19:31:42.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80cb8df640 1 Processor -- start 2023-11-28T19:31:42.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80cb8df640 1 -- start start 2023-11-28T19:31:42.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80cb8df640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80c40b6bc0 0x7f80c40b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80cb8df640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f80c40a20e0 0x7f80c4143060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80cb8df640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f80c41435a0 0x7f80c4149670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80cb8df640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c4149190 con 0x7f80c41435a0 2023-11-28T19:31:42.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80cb8df640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80c40b4be0 con 0x7f80c40a20e0 2023-11-28T19:31:42.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80cb8df640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c40b4ec0 con 0x7f80c40b6bc0 2023-11-28T19:31:42.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80c9e7c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f80c41435a0 0x7f80c4149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80c9e7c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f80c41435a0 0x7f80c4149670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34142/0 (socket says 172.21.15.28:34142) 2023-11-28T19:31:42.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80c9e7c640 1 -- 172.21.15.28:0/4193355438 learned_addr learned my addr 172.21.15.28:0/4193355438 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:42.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80c967b640 1 --2- 172.21.15.28:0/4193355438 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80c40b6bc0 0x7f80c40b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80c8e7a640 1 --2- 172.21.15.28:0/4193355438 >> v2:172.21.15.131:3300/0 conn(0x7f80c40a20e0 0x7f80c4143060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80c9e7c640 1 -- 172.21.15.28:0/4193355438 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80c40b6bc0 msgr2=0x7f80c40b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:42.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80c9e7c640 1 --2- 172.21.15.28:0/4193355438 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80c40b6bc0 0x7f80c40b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80c9e7c640 1 -- 172.21.15.28:0/4193355438 >> v2:172.21.15.131:3300/0 conn(0x7f80c40a20e0 msgr2=0x7f80c4143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:42.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80c9e7c640 1 --2- 172.21.15.28:0/4193355438 >> v2:172.21.15.131:3300/0 conn(0x7f80c40a20e0 0x7f80c4143060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80c9e7c640 1 -- 172.21.15.28:0/4193355438 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80c40b51a0 con 0x7f80c41435a0 2023-11-28T19:31:42.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.595+0000 7f80c967b640 1 --2- 172.21.15.28:0/4193355438 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80c40b6bc0 0x7f80c40b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:31:42.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80c9e7c640 1 --2- 172.21.15.28:0/4193355438 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80c41435a0 0x7f80c4149670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80c406d500 tx=0x7f80bc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c405e4acadbbb8ec server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:42.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80c3fff640 1 -- 172.21.15.28:0/4193355438 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0ab610 con 0x7f80c41435a0 2023-11-28T19:31:42.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80c3fff640 1 -- 172.21.15.28:0/4193355438 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80bc0ab770 con 0x7f80c41435a0 2023-11-28T19:31:42.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80c3fff640 1 -- 172.21.15.28:0/4193355438 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80bc0abb00 con 0x7f80c41435a0 2023-11-28T19:31:42.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 -- 172.21.15.28:0/4193355438 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80c41435a0 msgr2=0x7f80c4149670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:42.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 --2- 172.21.15.28:0/4193355438 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80c41435a0 0x7f80c4149670 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f80c406d500 tx=0x7f80bc01c470 comp rx=0 tx=0).stop 2023-11-28T19:31:42.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 -- 172.21.15.28:0/4193355438 shutdown_connections 2023-11-28T19:31:42.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 --2- 172.21.15.28:0/4193355438 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80c41435a0 0x7f80c4149670 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 --2- 172.21.15.28:0/4193355438 >> v2:172.21.15.131:3300/0 conn(0x7f80c40a20e0 0x7f80c4143060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 --2- 172.21.15.28:0/4193355438 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80c40b6bc0 0x7f80c40b4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 -- 172.21.15.28:0/4193355438 >> 172.21.15.28:0/4193355438 conn(0x7f80c40666d0 msgr2=0x7f80c406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:42.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 -- 172.21.15.28:0/4193355438 shutdown_connections 2023-11-28T19:31:42.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 -- 172.21.15.28:0/4193355438 wait complete. 2023-11-28T19:31:42.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 Processor -- start 2023-11-28T19:31:42.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 -- start start 2023-11-28T19:31:42.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c40a20e0 0x7f80c41e7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80c40b6bc0 0x7f80c413a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80c41435a0 0x7f80c413a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c40b2b50 con 0x7f80c40b6bc0 2023-11-28T19:31:42.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80c41e7a80 con 0x7f80c40a20e0 2023-11-28T19:31:42.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80cb8df640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80c40b2800 con 0x7f80c41435a0 2023-11-28T19:31:42.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80c8e7a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80c40b6bc0 0x7f80c413a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80c8e7a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80c40b6bc0 0x7f80c413a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34158/0 (socket says 172.21.15.28:34158) 2023-11-28T19:31:42.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.599+0000 7f80c8e7a640 1 -- 172.21.15.28:0/1162795220 learned_addr learned my addr 172.21.15.28:0/1162795220 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:42.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c9e7c640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80c41435a0 0x7f80c413a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c967b640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c40a20e0 0x7f80c41e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c8e7a640 1 -- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80c41435a0 msgr2=0x7f80c413a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:42.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c8e7a640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80c41435a0 0x7f80c413a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c8e7a640 1 -- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c40a20e0 msgr2=0x7f80c41e7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:42.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c8e7a640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c40a20e0 0x7f80c41e7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:42.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c8e7a640 1 -- 172.21.15.28:0/1162795220 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc0094d0 con 0x7f80c40b6bc0 2023-11-28T19:31:42.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c967b640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c40a20e0 0x7f80c41e7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:42.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c8e7a640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80c40b6bc0 0x7f80c413a120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f80b800d800 tx=0x7f80b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:42.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c1ffb640 1 -- 172.21.15.28:0/1162795220 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b80096a0 con 0x7f80c40b6bc0 2023-11-28T19:31:42.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c1ffb640 1 -- 172.21.15.28:0/1162795220 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b8009800 con 0x7f80c40b6bc0 2023-11-28T19:31:42.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c1ffb640 1 -- 172.21.15.28:0/1162795220 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8009b70 con 0x7f80c40b6bc0 2023-11-28T19:31:42.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80cb8df640 1 -- 172.21.15.28:0/1162795220 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80c40b1ed0 con 0x7f80c40b6bc0 2023-11-28T19:31:42.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80cb8df640 1 -- 172.21.15.28:0/1162795220 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80c40b2490 con 0x7f80c40b6bc0 2023-11-28T19:31:42.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80cb8df640 1 -- 172.21.15.28:0/1162795220 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80c40b2990 con 0x7f80c40b6bc0 2023-11-28T19:31:42.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c1ffb640 1 -- 172.21.15.28:0/1162795220 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f80b8009cd0 con 0x7f80c40b6bc0 2023-11-28T19:31:42.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c1ffb640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f80b0066470 0x7f80b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:42.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c1ffb640 1 -- 172.21.15.28:0/1162795220 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f80b8084330 con 0x7f80c40b6bc0 2023-11-28T19:31:42.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c967b640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f80b0066470 0x7f80b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:42.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.603+0000 7f80c967b640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f80b0066470 0x7f80b0068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009540 tx=0x7f80b400b040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:42.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.607+0000 7f80c1ffb640 1 -- 172.21.15.28:0/1162795220 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f80b8051a60 con 0x7f80c40b6bc0 2023-11-28T19:31:42.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:42.763+0000 7f80cb8df640 1 -- 172.21.15.28:0/1162795220 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f80c4074a90 con 0x7f80c40b6bc0 2023-11-28T19:31:43.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.199+0000 7f80c1ffb640 1 -- 172.21.15.28:0/1162795220 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f80b8055080 con 0x7f80c40b6bc0 2023-11-28T19:31:43.203 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' created 2023-11-28T19:31:43.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.203+0000 7f80cb8df640 1 -- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f80b0066470 msgr2=0x7f80b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:43.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.203+0000 7f80cb8df640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f80b0066470 0x7f80b0068930 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009540 tx=0x7f80b400b040 comp rx=0 tx=0).stop 2023-11-28T19:31:43.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.203+0000 7f80cb8df640 1 -- 172.21.15.28:0/1162795220 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80c40b6bc0 msgr2=0x7f80c413a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:43.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.203+0000 7f80cb8df640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80c40b6bc0 0x7f80c413a120 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f80b800d800 tx=0x7f80b800dcc0 comp rx=0 tx=0).stop 2023-11-28T19:31:43.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.203+0000 7f80cb8df640 1 -- 172.21.15.28:0/1162795220 shutdown_connections 2023-11-28T19:31:43.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.203+0000 7f80cb8df640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f80b0066470 0x7f80b0068930 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:43.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.203+0000 7f80cb8df640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f80c41435a0 0x7f80c413a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:43.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.203+0000 7f80cb8df640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f80c40b6bc0 0x7f80c413a120 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f80b800d800 tx=0x7f80b800dcc0 comp rx=0 tx=0).stop 2023-11-28T19:31:43.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.203+0000 7f80cb8df640 1 --2- 172.21.15.28:0/1162795220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80c40a20e0 0x7f80c41e7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:43.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.203+0000 7f80cb8df640 1 -- 172.21.15.28:0/1162795220 >> 172.21.15.28:0/1162795220 conn(0x7f80c40666d0 msgr2=0x7f80c41480e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:43.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.203+0000 7f80cb8df640 1 -- 172.21.15.28:0/1162795220 shutdown_connections 2023-11-28T19:31:43.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.203+0000 7f80cb8df640 1 -- 172.21.15.28:0/1162795220 wait complete. 2023-11-28T19:31:43.233 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T19:31:43.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.363+0000 7fe258f2d640 1 Processor -- start 2023-11-28T19:31:43.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.363+0000 7fe258f2d640 1 -- start start 2023-11-28T19:31:43.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.363+0000 7fe258f2d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe2540bc120 0x7fe2540bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:43.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.363+0000 7fe258f2d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe254143b60 con 0x7fe2540a2d60 2023-11-28T19:31:43.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.363+0000 7fe258f2d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2540b7aa0 con 0x7fe254072940 2023-11-28T19:31:43.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.363+0000 7fe258f2d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2540b6f30 con 0x7fe2540bc120 2023-11-28T19:31:43.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.363+0000 7fe25259c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe2540bc120 0x7fe2540bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:43.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.363+0000 7fe251d9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe2540a2d60 0x7fe25414c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:57368/0 (socket says 172.21.15.28:57368) 2023-11-28T19:31:43.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.363+0000 7fe25259c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe2540bc120 0x7fe2540bd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34164/0 (socket says 172.21.15.28:34164) 2023-11-28T19:31:43.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.363+0000 7fe251d9b640 1 -- 172.21.15.28:0/2325888695 learned_addr learned my addr 172.21.15.28:0/2325888695 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:43.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.363+0000 7fe25259c640 1 -- 172.21.15.28:0/2325888695 >> v1:172.21.15.131:6789/0 conn(0x7fe254072940 legacy=0x7fe254153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:43.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.363+0000 7fe25259c640 1 -- 172.21.15.28:0/2325888695 >> v1:172.21.15.28:6789/0 conn(0x7fe2540a2d60 legacy=0x7fe25414c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:43.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.363+0000 7fe25159a640 1 -- 172.21.15.28:0/2325888695 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 529260719 0 0) 0x7fe254143b60 con 0x7fe2540a2d60 2023-11-28T19:31:43.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.363+0000 7fe25259c640 1 -- 172.21.15.28:0/2325888695 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2540b7d60 con 0x7fe2540bc120 2023-11-28T19:31:43.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe25259c640 1 --2- 172.21.15.28:0/2325888695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2540bc120 0x7fe2540bd0e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe2440097c0 tx=0x7fe24401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d919285ea0f1b7a4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:43.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe25159a640 1 -- 172.21.15.28:0/2325888695 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2440a8930 con 0x7fe2540bc120 2023-11-28T19:31:43.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe25159a640 1 -- 172.21.15.28:0/2325888695 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2440a8a90 con 0x7fe2540bc120 2023-11-28T19:31:43.370 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe25159a640 1 -- 172.21.15.28:0/2325888695 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2440a8e20 con 0x7fe2540bc120 2023-11-28T19:31:43.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 -- 172.21.15.28:0/2325888695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2540bc120 msgr2=0x7fe2540bd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:43.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 --2- 172.21.15.28:0/2325888695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2540bc120 0x7fe2540bd0e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe2440097c0 tx=0x7fe24401ec30 comp rx=0 tx=0).stop 2023-11-28T19:31:43.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 -- 172.21.15.28:0/2325888695 shutdown_connections 2023-11-28T19:31:43.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 --2- 172.21.15.28:0/2325888695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2540bc120 0x7fe2540bd0e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:43.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 -- 172.21.15.28:0/2325888695 >> 172.21.15.28:0/2325888695 conn(0x7fe25406ab80 msgr2=0x7fe2540bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:43.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 -- 172.21.15.28:0/2325888695 shutdown_connections 2023-11-28T19:31:43.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 -- 172.21.15.28:0/2325888695 wait complete. 2023-11-28T19:31:43.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 Processor -- start 2023-11-28T19:31:43.375 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 -- start start 2023-11-28T19:31:43.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe254072940 0x7fe254143d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:43.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2540a2d60 0x7fe254070ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:43.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2540bc120 0x7fe254145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:43.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe254145e00 con 0x7fe2540bc120 2023-11-28T19:31:43.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2540713e0 con 0x7fe2540a2d60 2023-11-28T19:31:43.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe258f2d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe254145a80 con 0x7fe254072940 2023-11-28T19:31:43.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe252d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2540bc120 0x7fe254145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:43.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe252d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2540bc120 0x7fe254145540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34178/0 (socket says 172.21.15.28:34178) 2023-11-28T19:31:43.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe252d9d640 1 -- 172.21.15.28:0/2714526121 learned_addr learned my addr 172.21.15.28:0/2714526121 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:43.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe25259c640 1 --2- 172.21.15.28:0/2714526121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe254072940 0x7fe254143d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:43.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe251d9b640 1 --2- 172.21.15.28:0/2714526121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2540a2d60 0x7fe254070ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:43.376 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe252d9d640 1 -- 172.21.15.28:0/2714526121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe254072940 msgr2=0x7fe254143d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:43.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe252d9d640 1 --2- 172.21.15.28:0/2714526121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe254072940 0x7fe254143d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:43.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe252d9d640 1 -- 172.21.15.28:0/2714526121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2540a2d60 msgr2=0x7fe254070ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:43.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe252d9d640 1 --2- 172.21.15.28:0/2714526121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2540a2d60 0x7fe254070ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:43.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe252d9d640 1 -- 172.21.15.28:0/2714526121 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe244009420 con 0x7fe2540bc120 2023-11-28T19:31:43.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.367+0000 7fe252d9d640 1 --2- 172.21.15.28:0/2714526121 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2540bc120 0x7fe254145540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00c7e0 tx=0x7fe24c00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:43.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.371+0000 7fe242ffd640 1 -- 172.21.15.28:0/2714526121 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c003d90 con 0x7fe2540bc120 2023-11-28T19:31:43.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.371+0000 7fe242ffd640 1 -- 172.21.15.28:0/2714526121 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24c005070 con 0x7fe2540bc120 2023-11-28T19:31:43.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.371+0000 7fe242ffd640 1 -- 172.21.15.28:0/2714526121 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24c005420 con 0x7fe2540bc120 2023-11-28T19:31:43.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.371+0000 7fe258f2d640 1 -- 172.21.15.28:0/2714526121 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2540b59b0 con 0x7fe2540bc120 2023-11-28T19:31:43.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.371+0000 7fe258f2d640 1 -- 172.21.15.28:0/2714526121 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe254144c70 con 0x7fe2540bc120 2023-11-28T19:31:43.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.371+0000 7fe258f2d640 1 -- 172.21.15.28:0/2714526121 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe254067a20 con 0x7fe2540bc120 2023-11-28T19:31:43.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.371+0000 7fe242ffd640 1 -- 172.21.15.28:0/2714526121 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe24c005580 con 0x7fe2540bc120 2023-11-28T19:31:43.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.371+0000 7fe242ffd640 1 --2- 172.21.15.28:0/2714526121 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe234066470 0x7fe234068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:43.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.371+0000 7fe242ffd640 1 -- 172.21.15.28:0/2714526121 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fe24c0830b0 con 0x7fe2540bc120 2023-11-28T19:31:43.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.371+0000 7fe25259c640 1 --2- 172.21.15.28:0/2714526121 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe234066470 0x7fe234068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:43.378 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.371+0000 7fe25259c640 1 --2- 172.21.15.28:0/2714526121 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe234066470 0x7fe234068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe2440b2000 tx=0x7fe244008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:43.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.375+0000 7fe242ffd640 1 -- 172.21.15.28:0/2714526121 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe24c050700 con 0x7fe2540bc120 2023-11-28T19:31:43.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:43.535+0000 7fe258f2d640 1 -- 172.21.15.28:0/2714526121 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe254074a90 con 0x7fe2540bc120 2023-11-28T19:31:44.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.203+0000 7fe242ffd640 1 -- 172.21.15.28:0/2714526121 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v19) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe24c053d20 con 0x7fe2540bc120 2023-11-28T19:31:44.208 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' created 2023-11-28T19:31:44.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.207+0000 7fe258f2d640 1 -- 172.21.15.28:0/2714526121 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe234066470 msgr2=0x7fe234068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:44.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.207+0000 7fe258f2d640 1 --2- 172.21.15.28:0/2714526121 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe234066470 0x7fe234068930 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe2440b2000 tx=0x7fe244008040 comp rx=0 tx=0).stop 2023-11-28T19:31:44.211 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.207+0000 7fe258f2d640 1 -- 172.21.15.28:0/2714526121 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2540bc120 msgr2=0x7fe254145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:44.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.207+0000 7fe258f2d640 1 --2- 172.21.15.28:0/2714526121 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2540bc120 0x7fe254145540 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe24c00c7e0 tx=0x7fe24c00cca0 comp rx=0 tx=0).stop 2023-11-28T19:31:44.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.207+0000 7fe258f2d640 1 -- 172.21.15.28:0/2714526121 shutdown_connections 2023-11-28T19:31:44.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.207+0000 7fe258f2d640 1 --2- 172.21.15.28:0/2714526121 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe234066470 0x7fe234068930 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:44.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.207+0000 7fe258f2d640 1 --2- 172.21.15.28:0/2714526121 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe2540bc120 0x7fe254145540 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:44.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.207+0000 7fe258f2d640 1 --2- 172.21.15.28:0/2714526121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2540a2d60 0x7fe254070ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:44.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.207+0000 7fe258f2d640 1 --2- 172.21.15.28:0/2714526121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe254072940 0x7fe254143d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:44.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.207+0000 7fe258f2d640 1 -- 172.21.15.28:0/2714526121 >> 172.21.15.28:0/2714526121 conn(0x7fe25406ab80 msgr2=0x7fe25414c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:44.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.207+0000 7fe258f2d640 1 -- 172.21.15.28:0/2714526121 shutdown_connections 2023-11-28T19:31:44.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.207+0000 7fe258f2d640 1 -- 172.21.15.28:0/2714526121 wait complete. 2023-11-28T19:31:44.254 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T19:31:44.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29bac6d640 1 Processor -- start 2023-11-28T19:31:44.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29bac6d640 1 -- start start 2023-11-28T19:31:44.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29bac6d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f29b40b6970 0x7f29b40b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:44.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29bac6d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f29b414b5a0 0x7f29b40bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:44.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29bac6d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29b40b8d20 con 0x7f29b40728a0 2023-11-28T19:31:44.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29bac6d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b40b92e0 con 0x7f29b40b6970 2023-11-28T19:31:44.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29bac6d640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29b40b8200 con 0x7f29b414b5a0 2023-11-28T19:31:44.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29b8a09640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f29b40b6970 0x7f29b40b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:44.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29b8a09640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f29b40b6970 0x7f29b40b7a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34192/0 (socket says 172.21.15.28:34192) 2023-11-28T19:31:44.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29b8a09640 1 -- 172.21.15.28:0/8527970 learned_addr learned my addr 172.21.15.28:0/8527970 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:44.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29abfff640 1 --2- 172.21.15.28:0/8527970 >> v2:172.21.15.131:3300/0 conn(0x7f29b414b5a0 0x7f29b40bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:44.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29b8a09640 1 -- 172.21.15.28:0/8527970 >> v2:172.21.15.131:3300/0 conn(0x7f29b414b5a0 msgr2=0x7f29b40bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:44.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29b8a09640 1 --2- 172.21.15.28:0/8527970 >> v2:172.21.15.131:3300/0 conn(0x7f29b414b5a0 0x7f29b40bd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:44.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29b8a09640 1 -- 172.21.15.28:0/8527970 >> v1:172.21.15.131:6789/0 conn(0x7f29b40728a0 legacy=0x7f29b414eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:44.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29b8a09640 1 -- 172.21.15.28:0/8527970 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b40b9000 con 0x7f29b40b6970 2023-11-28T19:31:44.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.379+0000 7f29abfff640 1 --2- 172.21.15.28:0/8527970 >> v2:172.21.15.131:3300/0 conn(0x7f29b414b5a0 0x7f29b40bd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:44.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29b8a09640 1 --2- 172.21.15.28:0/8527970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b40b6970 0x7f29b40b7a20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29b40b94a0 tx=0x7f29b001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26c5caf26c3af81 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:44.426 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29ab7fe640 1 -- 172.21.15.28:0/8527970 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b00ab600 con 0x7f29b40b6970 2023-11-28T19:31:44.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29ab7fe640 1 -- 172.21.15.28:0/8527970 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b00a7050 con 0x7f29b40b6970 2023-11-28T19:31:44.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29ab7fe640 1 -- 172.21.15.28:0/8527970 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b00ab980 con 0x7f29b40b6970 2023-11-28T19:31:44.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 -- 172.21.15.28:0/8527970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b40b6970 msgr2=0x7f29b40b7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:44.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 --2- 172.21.15.28:0/8527970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b40b6970 0x7f29b40b7a20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f29b40b94a0 tx=0x7f29b001c4c0 comp rx=0 tx=0).stop 2023-11-28T19:31:44.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 -- 172.21.15.28:0/8527970 shutdown_connections 2023-11-28T19:31:44.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 --2- 172.21.15.28:0/8527970 >> v2:172.21.15.131:3300/0 conn(0x7f29b414b5a0 0x7f29b40bd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:44.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 --2- 172.21.15.28:0/8527970 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b40b6970 0x7f29b40b7a20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:44.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 -- 172.21.15.28:0/8527970 >> 172.21.15.28:0/8527970 conn(0x7f29b406ab80 msgr2=0x7f29b40bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:44.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 -- 172.21.15.28:0/8527970 shutdown_connections 2023-11-28T19:31:44.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 -- 172.21.15.28:0/8527970 wait complete. 2023-11-28T19:31:44.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 Processor -- start 2023-11-28T19:31:44.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 -- start start 2023-11-28T19:31:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b40728a0 0x7f29b4071740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29b40b6970 0x7f29b41e41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29b414b5a0 0x7f29b41e4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4141f90 con 0x7f29b40728a0 2023-11-28T19:31:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4070810 con 0x7f29b40b6970 2023-11-28T19:31:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29bac6d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29b4141d40 con 0x7f29b414b5a0 2023-11-28T19:31:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29b8a09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b40728a0 0x7f29b4071740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29b8a09640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b40728a0 0x7f29b4071740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:34202/0 (socket says 172.21.15.28:34202) 2023-11-28T19:31:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29b8a09640 1 -- 172.21.15.28:0/1544194671 learned_addr learned my addr 172.21.15.28:0/1544194671 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29abfff640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29b40b6970 0x7f29b41e41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29b8a09640 1 -- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29b414b5a0 msgr2=0x7f29b41e4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.383+0000 7f29b920a640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29b414b5a0 0x7f29b41e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:44.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29b8a09640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29b414b5a0 0x7f29b41e4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29b8a09640 1 -- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29b40b6970 msgr2=0x7f29b41e41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29b8a09640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29b40b6970 0x7f29b41e41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29b8a09640 1 -- 172.21.15.28:0/1544194671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29b00094d0 con 0x7f29b40728a0 2023-11-28T19:31:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29abfff640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29b40b6970 0x7f29b41e41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29b920a640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29b414b5a0 0x7f29b41e4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29b8a09640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b40728a0 0x7f29b4071740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f29b001ab70 tx=0x7f29b0019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29a97fa640 1 -- 172.21.15.28:0/1544194671 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b00b5640 con 0x7f29b40728a0 2023-11-28T19:31:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29a97fa640 1 -- 172.21.15.28:0/1544194671 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29b00b57c0 con 0x7f29b40728a0 2023-11-28T19:31:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29bac6d640 1 -- 172.21.15.28:0/1544194671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29b4070570 con 0x7f29b40728a0 2023-11-28T19:31:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29a97fa640 1 -- 172.21.15.28:0/1544194671 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29b00b5b70 con 0x7f29b40728a0 2023-11-28T19:31:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29bac6d640 1 -- 172.21.15.28:0/1544194671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29b4071c80 con 0x7f29b40728a0 2023-11-28T19:31:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29bac6d640 1 -- 172.21.15.28:0/1544194671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29b4074a90 con 0x7f29b40728a0 2023-11-28T19:31:44.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29a97fa640 1 -- 172.21.15.28:0/1544194671 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f29b00b5cd0 con 0x7f29b40728a0 2023-11-28T19:31:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29a97fa640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f29a0066470 0x7f29a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29a97fa640 1 -- 172.21.15.28:0/1544194671 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f29b011e800 con 0x7f29b40728a0 2023-11-28T19:31:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29abfff640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f29a0066470 0x7f29a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.387+0000 7f29abfff640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f29a0066470 0x7f29a0068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f29b40bb850 tx=0x7f29a4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:44.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.391+0000 7f29a97fa640 1 -- 172.21.15.28:0/1544194671 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f29b00ebd70 con 0x7f29b40728a0 2023-11-28T19:31:44.586 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:44.583+0000 7f29bac6d640 1 -- 172.21.15.28:0/1544194671 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f29b40bb5a0 con 0x7f29b40728a0 2023-11-28T19:31:45.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.247+0000 7f29a97fa640 1 -- 172.21.15.28:0/1544194671 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f29b00b90c0 con 0x7f29b40728a0 2023-11-28T19:31:45.252 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 2 and data pool 3 2023-11-28T19:31:45.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.251+0000 7f29bac6d640 1 -- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f29a0066470 msgr2=0x7f29a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:45.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.251+0000 7f29bac6d640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f29a0066470 0x7f29a0068930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f29b40bb850 tx=0x7f29a4008040 comp rx=0 tx=0).stop 2023-11-28T19:31:45.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.251+0000 7f29bac6d640 1 -- 172.21.15.28:0/1544194671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b40728a0 msgr2=0x7f29b4071740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:45.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.251+0000 7f29bac6d640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b40728a0 0x7f29b4071740 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f29b001ab70 tx=0x7f29b0019260 comp rx=0 tx=0).stop 2023-11-28T19:31:45.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.251+0000 7f29bac6d640 1 -- 172.21.15.28:0/1544194671 shutdown_connections 2023-11-28T19:31:45.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.251+0000 7f29bac6d640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f29a0066470 0x7f29a0068930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.251+0000 7f29bac6d640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f29b414b5a0 0x7f29b41e4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.251+0000 7f29bac6d640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29b40b6970 0x7f29b41e41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.251+0000 7f29bac6d640 1 --2- 172.21.15.28:0/1544194671 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f29b40728a0 0x7f29b4071740 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.251+0000 7f29bac6d640 1 -- 172.21.15.28:0/1544194671 >> 172.21.15.28:0/1544194671 conn(0x7f29b406ab80 msgr2=0x7f29b414a820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:45.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.251+0000 7f29bac6d640 1 -- 172.21.15.28:0/1544194671 shutdown_connections 2023-11-28T19:31:45.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.251+0000 7f29bac6d640 1 -- 172.21.15.28:0/1544194671 wait complete. 2023-11-28T19:31:45.285 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:45.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.399+0000 7f318a795640 1 Processor -- start 2023-11-28T19:31:45.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.399+0000 7f318a795640 1 -- start start 2023-11-28T19:31:45.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f318a795640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f318414c860 0x7f31840b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:45.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f318a795640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f318414ccc0 0x7f31840b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:45.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f318a795640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f318406f780 con 0x7f31840b8f30 2023-11-28T19:31:45.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f318a795640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31840b6cd0 con 0x7f318414ccc0 2023-11-28T19:31:45.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f318a795640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3184143aa0 con 0x7f318414c860 2023-11-28T19:31:45.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f3188d32640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f318414ccc0 0x7f31840b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:45.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f3183fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f31840b8f30 0x7f3184071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49488/0 (socket says 172.21.15.28:49488) 2023-11-28T19:31:45.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f3188d32640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f318414ccc0 0x7f31840b6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50752/0 (socket says 172.21.15.28:50752) 2023-11-28T19:31:45.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f3183fff640 1 -- 172.21.15.28:0/958836768 learned_addr learned my addr 172.21.15.28:0/958836768 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:45.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f31837fe640 1 --2- 172.21.15.28:0/958836768 >> v2:172.21.15.131:3300/0 conn(0x7f318414c860 0x7f31840b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:45.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f3188d32640 1 -- 172.21.15.28:0/958836768 >> v2:172.21.15.131:3300/0 conn(0x7f318414c860 msgr2=0x7f31840b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:45.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f3188d32640 1 --2- 172.21.15.28:0/958836768 >> v2:172.21.15.131:3300/0 conn(0x7f318414c860 0x7f31840b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f3188d32640 1 -- 172.21.15.28:0/958836768 >> v1:172.21.15.28:6789/0 conn(0x7f31840b8f30 legacy=0x7f3184071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:45.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f3188d32640 1 -- 172.21.15.28:0/958836768 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3184072320 con 0x7f318414ccc0 2023-11-28T19:31:45.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f3188d32640 1 --2- 172.21.15.28:0/958836768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f318414ccc0 0x7f31840b6790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3184071580 tx=0x7f317401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a916a1fd7829ff server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:45.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f3182ffd640 1 -- 172.21.15.28:0/958836768 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31740ab600 con 0x7f318414ccc0 2023-11-28T19:31:45.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f3182ffd640 1 -- 172.21.15.28:0/958836768 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31740a7050 con 0x7f318414ccc0 2023-11-28T19:31:45.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.403+0000 7f3182ffd640 1 -- 172.21.15.28:0/958836768 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31740ab980 con 0x7f318414ccc0 2023-11-28T19:31:45.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 -- 172.21.15.28:0/958836768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f318414ccc0 msgr2=0x7f31840b6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:45.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 --2- 172.21.15.28:0/958836768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f318414ccc0 0x7f31840b6790 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3184071580 tx=0x7f317401c460 comp rx=0 tx=0).stop 2023-11-28T19:31:45.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 -- 172.21.15.28:0/958836768 shutdown_connections 2023-11-28T19:31:45.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 --2- 172.21.15.28:0/958836768 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f318414ccc0 0x7f31840b6790 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 --2- 172.21.15.28:0/958836768 >> v2:172.21.15.131:3300/0 conn(0x7f318414c860 0x7f31840b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 -- 172.21.15.28:0/958836768 >> 172.21.15.28:0/958836768 conn(0x7f31840bcb40 msgr2=0x7f31840bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:45.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 -- 172.21.15.28:0/958836768 shutdown_connections 2023-11-28T19:31:45.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 -- 172.21.15.28:0/958836768 wait complete. 2023-11-28T19:31:45.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 Processor -- start 2023-11-28T19:31:45.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 -- start start 2023-11-28T19:31:45.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31840b8f30 0x7f3184149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:45.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f318414c860 0x7f31841e76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:45.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f318414ccc0 0x7f31840b5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:45.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3184149a70 con 0x7f318414c860 2023-11-28T19:31:45.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31841538d0 con 0x7f318414ccc0 2023-11-28T19:31:45.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31841e7260 con 0x7f31840b8f30 2023-11-28T19:31:45.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f31837fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f318414c860 0x7f31841e76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:45.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f31837fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f318414c860 0x7f31841e76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50758/0 (socket says 172.21.15.28:50758) 2023-11-28T19:31:45.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f31837fe640 1 -- 172.21.15.28:0/4189823372 learned_addr learned my addr 172.21.15.28:0/4189823372 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:45.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f3188d32640 1 --2- 172.21.15.28:0/4189823372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f318414ccc0 0x7f31840b5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:45.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f3183fff640 1 --2- 172.21.15.28:0/4189823372 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31840b8f30 0x7f3184149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:45.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f31837fe640 1 -- 172.21.15.28:0/4189823372 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31840b8f30 msgr2=0x7f3184149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:45.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f31837fe640 1 --2- 172.21.15.28:0/4189823372 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31840b8f30 0x7f3184149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f31837fe640 1 -- 172.21.15.28:0/4189823372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f318414ccc0 msgr2=0x7f31840b5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:45.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f31837fe640 1 --2- 172.21.15.28:0/4189823372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f318414ccc0 0x7f31840b5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f31837fe640 1 -- 172.21.15.28:0/4189823372 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3174009420 con 0x7f318414c860 2023-11-28T19:31:45.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f31837fe640 1 --2- 172.21.15.28:0/4189823372 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f318414c860 0x7f31841e76f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f316c00d830 tx=0x7f316c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:45.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f3180ff9640 1 -- 172.21.15.28:0/4189823372 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c018070 con 0x7f318414c860 2023-11-28T19:31:45.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f3180ff9640 1 -- 172.21.15.28:0/4189823372 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c004020 con 0x7f318414c860 2023-11-28T19:31:45.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f3180ff9640 1 -- 172.21.15.28:0/4189823372 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c0041d0 con 0x7f318414c860 2023-11-28T19:31:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 -- 172.21.15.28:0/4189823372 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31841e6f90 con 0x7f318414c860 2023-11-28T19:31:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.407+0000 7f318a795640 1 -- 172.21.15.28:0/4189823372 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31840b5d90 con 0x7f318414c860 2023-11-28T19:31:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.411+0000 7f318a795640 1 -- 172.21.15.28:0/4189823372 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31841e73f0 con 0x7f318414c860 2023-11-28T19:31:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.411+0000 7f3180ff9640 1 -- 172.21.15.28:0/4189823372 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f316c004330 con 0x7f318414c860 2023-11-28T19:31:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.411+0000 7f3180ff9640 1 --2- 172.21.15.28:0/4189823372 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3164066470 0x7f3164068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:45.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.411+0000 7f3180ff9640 1 -- 172.21.15.28:0/4189823372 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f316c083b60 con 0x7f318414c860 2023-11-28T19:31:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.411+0000 7f3183fff640 1 --2- 172.21.15.28:0/4189823372 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3164066470 0x7f3164068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:45.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.411+0000 7f3183fff640 1 --2- 172.21.15.28:0/4189823372 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3164066470 0x7f3164068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f317c0012f0 tx=0x7f317c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:45.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.415+0000 7f3180ff9640 1 -- 172.21.15.28:0/4189823372 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f316c050ff0 con 0x7f318414c860 2023-11-28T19:31:45.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.575+0000 7f318a795640 1 -- 172.21.15.28:0/4189823372 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3184074a90 con 0x7f318414c860 2023-11-28T19:31:45.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.575+0000 7f3180ff9640 1 -- 172.21.15.28:0/4189823372 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16518 (secure 0 0 0) 0x7f316c054610 con 0x7f318414c860 2023-11-28T19:31:45.581 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:45.581 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:44.588020+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:45.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.579+0000 7f318a795640 1 -- 172.21.15.28:0/4189823372 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3164066470 msgr2=0x7f3164068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:45.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.579+0000 7f318a795640 1 --2- 172.21.15.28:0/4189823372 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3164066470 0x7f3164068930 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f317c0012f0 tx=0x7f317c009040 comp rx=0 tx=0).stop 2023-11-28T19:31:45.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.579+0000 7f318a795640 1 -- 172.21.15.28:0/4189823372 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f318414c860 msgr2=0x7f31841e76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:45.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.579+0000 7f318a795640 1 --2- 172.21.15.28:0/4189823372 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f318414c860 0x7f31841e76f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f316c00d830 tx=0x7f316c00dcf0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.579+0000 7f318a795640 1 -- 172.21.15.28:0/4189823372 shutdown_connections 2023-11-28T19:31:45.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.579+0000 7f318a795640 1 --2- 172.21.15.28:0/4189823372 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3164066470 0x7f3164068930 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.579+0000 7f318a795640 1 --2- 172.21.15.28:0/4189823372 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f318414ccc0 0x7f31840b5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.579+0000 7f318a795640 1 --2- 172.21.15.28:0/4189823372 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f318414c860 0x7f31841e76f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.579+0000 7f318a795640 1 --2- 172.21.15.28:0/4189823372 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f31840b8f30 0x7f3184149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.579+0000 7f318a795640 1 -- 172.21.15.28:0/4189823372 >> 172.21.15.28:0/4189823372 conn(0x7f31840bcb40 msgr2=0x7f318413c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:45.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.579+0000 7f318a795640 1 -- 172.21.15.28:0/4189823372 shutdown_connections 2023-11-28T19:31:45.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.579+0000 7f318a795640 1 -- 172.21.15.28:0/4189823372 wait complete. 2023-11-28T19:31:45.600 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:45.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.715+0000 7f8cf2ba4640 1 Processor -- start 2023-11-28T19:31:45.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.715+0000 7f8cf2ba4640 1 -- start start 2023-11-28T19:31:45.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8cf2ba4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8cec06e980 0x7f8cec06d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:45.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8cf2ba4640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cec06bbd0 con 0x7f8cec0b8ec0 2023-11-28T19:31:45.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8cf2ba4640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cec06b610 con 0x7f8cec0bb150 2023-11-28T19:31:45.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8cf2ba4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cec06b400 con 0x7f8cec06e980 2023-11-28T19:31:45.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8cf1141640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8cec06e980 0x7f8cec06d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:45.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8cf1141640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8cec06e980 0x7f8cec06d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50770/0 (socket says 172.21.15.28:50770) 2023-11-28T19:31:45.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8cebfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8cec0b8ec0 0x7f8cec06e270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49490/0 (socket says 172.21.15.28:49490) 2023-11-28T19:31:45.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8cf1141640 1 -- 172.21.15.28:0/758786134 learned_addr learned my addr 172.21.15.28:0/758786134 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:45.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8cf1141640 1 -- 172.21.15.28:0/758786134 >> v1:172.21.15.131:6789/0 conn(0x7f8cec0bb150 legacy=0x7f8cec145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:45.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8cf1141640 1 -- 172.21.15.28:0/758786134 >> v1:172.21.15.28:6789/0 conn(0x7f8cec0b8ec0 legacy=0x7f8cec06e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:45.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8ceb7fe640 1 -- 172.21.15.28:0/758786134 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314456167 0 0) 0x7f8cec06bbd0 con 0x7f8cec0b8ec0 2023-11-28T19:31:45.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8cf1141640 1 -- 172.21.15.28:0/758786134 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec06b8f0 con 0x7f8cec06e980 2023-11-28T19:31:45.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8cf1141640 1 --2- 172.21.15.28:0/758786134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cec06e980 0x7f8cec06d0f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009e50 tx=0x7f8ce401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd20a751a128d4d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:45.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8ceb7fe640 1 -- 172.21.15.28:0/758786134 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40a58b0 con 0x7f8cec06e980 2023-11-28T19:31:45.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8ceb7fe640 1 -- 172.21.15.28:0/758786134 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce40a5a10 con 0x7f8cec06e980 2023-11-28T19:31:45.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.719+0000 7f8ceb7fe640 1 -- 172.21.15.28:0/758786134 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40a5da0 con 0x7f8cec06e980 2023-11-28T19:31:45.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/758786134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cec06e980 msgr2=0x7f8cec06d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:45.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 --2- 172.21.15.28:0/758786134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cec06e980 0x7f8cec06d0f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8ce4009e50 tx=0x7f8ce401c9d0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/758786134 shutdown_connections 2023-11-28T19:31:45.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 --2- 172.21.15.28:0/758786134 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cec06e980 0x7f8cec06d0f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/758786134 >> 172.21.15.28:0/758786134 conn(0x7f8cec0bed00 msgr2=0x7f8cec0bf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:45.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/758786134 shutdown_connections 2023-11-28T19:31:45.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/758786134 wait complete. 2023-11-28T19:31:45.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 Processor -- start 2023-11-28T19:31:45.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 -- start start 2023-11-28T19:31:45.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec06e980 0x7f8cec0b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:45.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cec0b8ec0 0x7f8cec148690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:45.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cec0bb150 0x7f8cec13e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:45.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec141fe0 con 0x7f8cec0bb150 2023-11-28T19:31:45.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec0b7f70 con 0x7f8cec06e980 2023-11-28T19:31:45.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cec149010 con 0x7f8cec0b8ec0 2023-11-28T19:31:45.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf1141640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cec0bb150 0x7f8cec13e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:45.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf1141640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cec0bb150 0x7f8cec13e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50786/0 (socket says 172.21.15.28:50786) 2023-11-28T19:31:45.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf1141640 1 -- 172.21.15.28:0/3723744942 learned_addr learned my addr 172.21.15.28:0/3723744942 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:45.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf0940640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec06e980 0x7f8cec0b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:45.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf1141640 1 -- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cec0b8ec0 msgr2=0x7f8cec148690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:45.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cebfff640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cec0b8ec0 0x7f8cec148690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:45.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf1141640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cec0b8ec0 0x7f8cec148690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf1141640 1 -- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec06e980 msgr2=0x7f8cec0b7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:45.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf1141640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec06e980 0x7f8cec0b7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf1141640 1 -- 172.21.15.28:0/3723744942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce4009b30 con 0x7f8cec0bb150 2023-11-28T19:31:45.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf0940640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec06e980 0x7f8cec0b7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:45.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf1141640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cec0bb150 0x7f8cec13e480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40af040 tx=0x7f8ce4019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:45.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8ce97fa640 1 -- 172.21.15.28:0/3723744942 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40b8880 con 0x7f8cec0bb150 2023-11-28T19:31:45.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8ce97fa640 1 -- 172.21.15.28:0/3723744942 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce40b8a00 con 0x7f8cec0bb150 2023-11-28T19:31:45.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/3723744942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cec147780 con 0x7f8cec0bb150 2023-11-28T19:31:45.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8ce97fa640 1 -- 172.21.15.28:0/3723744942 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce40b8db0 con 0x7f8cec0bb150 2023-11-28T19:31:45.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.723+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/3723744942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cec147d40 con 0x7f8cec0bb150 2023-11-28T19:31:45.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.727+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/3723744942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cec071000 con 0x7f8cec0bb150 2023-11-28T19:31:45.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.727+0000 7f8ce97fa640 1 -- 172.21.15.28:0/3723744942 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8ce40b6440 con 0x7f8cec0bb150 2023-11-28T19:31:45.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.727+0000 7f8ce97fa640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8ccc066470 0x7f8ccc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:45.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.727+0000 7f8ce97fa640 1 -- 172.21.15.28:0/3723744942 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ce411f530 con 0x7f8cec0bb150 2023-11-28T19:31:45.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.727+0000 7f8cf0940640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8ccc066470 0x7f8ccc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:45.734 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.727+0000 7f8cf0940640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8ccc066470 0x7f8ccc068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00a850 tx=0x7f8cdc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:45.735 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.731+0000 7f8ce97fa640 1 -- 172.21.15.28:0/3723744942 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8ce40eca40 con 0x7f8cec0bb150 2023-11-28T19:31:45.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.887+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/3723744942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cec147590 con 0x7f8cec0bb150 2023-11-28T19:31:45.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.891+0000 7f8ce97fa640 1 -- 172.21.15.28:0/3723744942 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16518 (secure 0 0 0) 0x7f8ce40f0060 con 0x7f8cec0bb150 2023-11-28T19:31:45.895 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:45.895 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":20,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:44.588020+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:45.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.891+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8ccc066470 msgr2=0x7f8ccc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:45.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.891+0000 7f8cf2ba4640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8ccc066470 0x7f8ccc068930 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc00a850 tx=0x7f8cdc008040 comp rx=0 tx=0).stop 2023-11-28T19:31:45.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.891+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/3723744942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cec0bb150 msgr2=0x7f8cec13e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:45.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.891+0000 7f8cf2ba4640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cec0bb150 0x7f8cec13e480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40af040 tx=0x7f8ce4019770 comp rx=0 tx=0).stop 2023-11-28T19:31:45.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.891+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/3723744942 shutdown_connections 2023-11-28T19:31:45.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.891+0000 7f8cf2ba4640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8ccc066470 0x7f8ccc068930 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.891+0000 7f8cf2ba4640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8cec0bb150 0x7f8cec13e480 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.891+0000 7f8cf2ba4640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8cec0b8ec0 0x7f8cec148690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.891+0000 7f8cf2ba4640 1 --2- 172.21.15.28:0/3723744942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8cec06e980 0x7f8cec0b7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:45.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.891+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/3723744942 >> 172.21.15.28:0/3723744942 conn(0x7f8cec0bed00 msgr2=0x7f8cec1433d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:45.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.891+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/3723744942 shutdown_connections 2023-11-28T19:31:45.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:45.891+0000 7f8cf2ba4640 1 -- 172.21.15.28:0/3723744942 wait complete. 2023-11-28T19:31:45.916 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T19:31:46.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c98872640 1 Processor -- start 2023-11-28T19:31:46.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c98872640 1 -- start start 2023-11-28T19:31:46.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c98872640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940bc120 0x7f8c940bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:46.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c98872640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c94143b60 con 0x7f8c940a2d60 2023-11-28T19:31:46.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c98872640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c940b7aa0 con 0x7f8c94072940 2023-11-28T19:31:46.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c98872640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940b6f30 con 0x7f8c940bc120 2023-11-28T19:31:46.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c91d9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8c940a2d60 0x7f8c9414c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49492/0 (socket says 172.21.15.28:49492) 2023-11-28T19:31:46.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c91d9b640 1 -- 172.21.15.28:0/1219741222 learned_addr learned my addr 172.21.15.28:0/1219741222 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:46.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9259c640 1 --2- 172.21.15.28:0/1219741222 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940bc120 0x7f8c940bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:46.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 -- 172.21.15.28:0/1219741222 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417016378 0 0) 0x7f8c94143b60 con 0x7f8c940a2d60 2023-11-28T19:31:46.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 -- 172.21.15.28:0/1219741222 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c80003530 con 0x7f8c940a2d60 2023-11-28T19:31:46.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 -- 172.21.15.28:0/1219741222 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1037057319 0 0) 0x7f8c80003530 con 0x7f8c940a2d60 2023-11-28T19:31:46.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 -- 172.21.15.28:0/1219741222 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940bc120 msgr2=0x7f8c940bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 --2- 172.21.15.28:0/1219741222 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940bc120 0x7f8c940bd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 -- 172.21.15.28:0/1219741222 >> v1:172.21.15.131:6789/0 conn(0x7f8c94072940 legacy=0x7f8c94153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 -- 172.21.15.28:0/1219741222 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c940b7d60 con 0x7f8c940a2d60 2023-11-28T19:31:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 -- 172.21.15.28:0/1219741222 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f8c7c001680 con 0x7f8c940a2d60 2023-11-28T19:31:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 -- 172.21.15.28:0/1219741222 >> v1:172.21.15.28:6789/0 conn(0x7f8c940a2d60 legacy=0x7f8c9414c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 --2- 172.21.15.28:0/1219741222 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940bc120 0x7f8c800039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 --2- 172.21.15.28:0/1219741222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c80003ef0 0x7f8c800047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 --2- 172.21.15.28:0/1219741222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c80004d10 0x7f8c80005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:46.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 -- 172.21.15.28:0/1219741222 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c940b6f30 con 0x7f8c80004d10 2023-11-28T19:31:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 -- 172.21.15.28:0/1219741222 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8000b9f0 con 0x7f8c80003ef0 2023-11-28T19:31:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9159a640 1 -- 172.21.15.28:0/1219741222 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c8000bbb0 con 0x7f8c940bc120 2023-11-28T19:31:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c92d9d640 1 --2- 172.21.15.28:0/1219741222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c80004d10 0x7f8c80005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c9259c640 1 --2- 172.21.15.28:0/1219741222 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940bc120 0x7f8c800039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c91d9b640 1 --2- 172.21.15.28:0/1219741222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c80003ef0 0x7f8c800047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c92d9d640 1 -- 172.21.15.28:0/1219741222 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940bc120 msgr2=0x7f8c800039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c92d9d640 1 --2- 172.21.15.28:0/1219741222 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c940bc120 0x7f8c800039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c92d9d640 1 -- 172.21.15.28:0/1219741222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c80003ef0 msgr2=0x7f8c800047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c92d9d640 1 --2- 172.21.15.28:0/1219741222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c80003ef0 0x7f8c800047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:46.056 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.047+0000 7f8c92d9d640 1 -- 172.21.15.28:0/1219741222 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c80003530 con 0x7f8c80004d10 2023-11-28T19:31:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.051+0000 7f8c92d9d640 1 --2- 172.21.15.28:0/1219741222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c80004d10 0x7f8c80005190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c001860 tx=0x7f8c8c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=168e380c4bcaf1e7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.051+0000 7f8c9159a640 1 -- 172.21.15.28:0/1219741222 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0ab620 con 0x7f8c80004d10 2023-11-28T19:31:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.051+0000 7f8c9159a640 1 -- 172.21.15.28:0/1219741222 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c8c0ab780 con 0x7f8c80004d10 2023-11-28T19:31:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.051+0000 7f8c9159a640 1 -- 172.21.15.28:0/1219741222 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8c0abb70 con 0x7f8c80004d10 2023-11-28T19:31:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.051+0000 7f8c98872640 1 -- 172.21.15.28:0/1219741222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c80004d10 msgr2=0x7f8c80005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:46.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.051+0000 7f8c98872640 1 --2- 172.21.15.28:0/1219741222 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c80004d10 0x7f8c80005190 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c001860 tx=0x7f8c8c01c4e0 comp rx=0 tx=0).stop 2023-11-28T19:31:46.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.051+0000 7f8c92d9d640 1 -- 172.21.15.28:0/1219741222 reap_dead start 2023-11-28T19:31:46.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.051+0000 7f8c98872640 1 -- 172.21.15.28:0/1219741222 shutdown_connections 2023-11-28T19:31:46.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.051+0000 7f8c98872640 1 -- 172.21.15.28:0/1219741222 >> 172.21.15.28:0/1219741222 conn(0x7f8c9406ab80 msgr2=0x7f8c940bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:46.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.051+0000 7f8c98872640 1 -- 172.21.15.28:0/1219741222 shutdown_connections 2023-11-28T19:31:46.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.051+0000 7f8c98872640 1 -- 172.21.15.28:0/1219741222 wait complete. 2023-11-28T19:31:46.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.051+0000 7f8c98872640 1 Processor -- start 2023-11-28T19:31:46.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.051+0000 7f8c98872640 1 -- start start 2023-11-28T19:31:46.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c98872640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c80004d10 0x7f8c9414cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:46.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c98872640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c9414d1e0 0x7f8c941dea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:46.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c98872640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c941defa0 0x7f8c94139fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:46.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c98872640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c941df450 con 0x7f8c80004d10 2023-11-28T19:31:46.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c98872640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c941e1fe0 con 0x7f8c9414d1e0 2023-11-28T19:31:46.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c98872640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c941e2280 con 0x7f8c941defa0 2023-11-28T19:31:46.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c9259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c80004d10 0x7f8c9414cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:46.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c9259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c80004d10 0x7f8c9414cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50808/0 (socket says 172.21.15.28:50808) 2023-11-28T19:31:46.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c9259c640 1 -- 172.21.15.28:0/3816202105 learned_addr learned my addr 172.21.15.28:0/3816202105 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:46.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c91d9b640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c9414d1e0 0x7f8c941dea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:46.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c92d9d640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c941defa0 0x7f8c94139fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c9259c640 1 -- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c941defa0 msgr2=0x7f8c94139fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c9259c640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c941defa0 0x7f8c94139fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c9259c640 1 -- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c9414d1e0 msgr2=0x7f8c941dea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c9259c640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c9414d1e0 0x7f8c941dea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c9259c640 1 -- 172.21.15.28:0/3816202105 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c941e2560 con 0x7f8c80004d10 2023-11-28T19:31:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c91d9b640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c9414d1e0 0x7f8c941dea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c9259c640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c80004d10 0x7f8c9414cca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8c84007f30 tx=0x7f8c84011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c8affd640 1 -- 172.21.15.28:0/3816202105 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c8400e030 con 0x7f8c80004d10 2023-11-28T19:31:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c8affd640 1 -- 172.21.15.28:0/3816202105 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c84016470 con 0x7f8c80004d10 2023-11-28T19:31:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c8affd640 1 -- 172.21.15.28:0/3816202105 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c84016820 con 0x7f8c80004d10 2023-11-28T19:31:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c98872640 1 -- 172.21.15.28:0/3816202105 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c941e2840 con 0x7f8c80004d10 2023-11-28T19:31:46.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c98872640 1 -- 172.21.15.28:0/3816202105 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c94139a10 con 0x7f8c80004d10 2023-11-28T19:31:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c98872640 1 -- 172.21.15.28:0/3816202105 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c9413bfa0 con 0x7f8c80004d10 2023-11-28T19:31:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c8affd640 1 -- 172.21.15.28:0/3816202105 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8c84016980 con 0x7f8c80004d10 2023-11-28T19:31:46.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c8affd640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8c740664a0 0x7f8c74068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c8affd640 1 -- 172.21.15.28:0/3816202105 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8c8400f070 con 0x7f8c80004d10 2023-11-28T19:31:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c91d9b640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8c740664a0 0x7f8c74068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:46.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.055+0000 7f8c91d9b640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8c740664a0 0x7f8c74068960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c001060 tx=0x7f8c7c001d60 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:46.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.063+0000 7f8c8affd640 1 -- 172.21.15.28:0/3816202105 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8c84052230 con 0x7f8c80004d10 2023-11-28T19:31:46.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:46.255+0000 7f8c98872640 1 -- 172.21.15.28:0/3816202105 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8c94074a90 con 0x7f8c80004d10 2023-11-28T19:31:47.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.267+0000 7f8c8affd640 1 -- 172.21.15.28:0/3816202105 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8c84055850 con 0x7f8c80004d10 2023-11-28T19:31:47.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.271+0000 7f8c98872640 1 -- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8c740664a0 msgr2=0x7f8c74068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:47.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.271+0000 7f8c98872640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8c740664a0 0x7f8c74068960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c001060 tx=0x7f8c7c001d60 comp rx=0 tx=0).stop 2023-11-28T19:31:47.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.271+0000 7f8c98872640 1 -- 172.21.15.28:0/3816202105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c80004d10 msgr2=0x7f8c9414cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:47.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.271+0000 7f8c98872640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c80004d10 0x7f8c9414cca0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8c84007f30 tx=0x7f8c84011660 comp rx=0 tx=0).stop 2023-11-28T19:31:47.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.271+0000 7f8c98872640 1 -- 172.21.15.28:0/3816202105 shutdown_connections 2023-11-28T19:31:47.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.271+0000 7f8c98872640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8c740664a0 0x7f8c74068960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:47.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.271+0000 7f8c98872640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8c941defa0 0x7f8c94139fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:47.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.271+0000 7f8c98872640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c9414d1e0 0x7f8c941dea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:47.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.271+0000 7f8c98872640 1 --2- 172.21.15.28:0/3816202105 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8c80004d10 0x7f8c9414cca0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:47.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.271+0000 7f8c98872640 1 -- 172.21.15.28:0/3816202105 >> 172.21.15.28:0/3816202105 conn(0x7f8c9406ab80 msgr2=0x7f8c94142220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:47.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.271+0000 7f8c98872640 1 -- 172.21.15.28:0/3816202105 shutdown_connections 2023-11-28T19:31:47.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.271+0000 7f8c98872640 1 -- 172.21.15.28:0/3816202105 wait complete. 2023-11-28T19:31:47.300 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T19:31:47.300 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T19:31:47.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa6992f4640 1 Processor -- start 2023-11-28T19:31:47.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa6992f4640 1 -- start start 2023-11-28T19:31:47.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa6992f4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6940bc120 0x7fa6940bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:47.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa6992f4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa6940a2d60 0x7fa69414c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:47.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa6992f4640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa694072940 0x7fa69414cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:47.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa6992f4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6940b6f30 con 0x7fa6940a2d60 2023-11-28T19:31:47.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa6992f4640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa694143b60 con 0x7fa694072940 2023-11-28T19:31:47.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa6992f4640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6940b7aa0 con 0x7fa6940bc120 2023-11-28T19:31:47.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa68a7fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa6940a2d60 0x7fa69414c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:47.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa68a7fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa6940a2d60 0x7fa69414c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50818/0 (socket says 172.21.15.28:50818) 2023-11-28T19:31:47.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa68a7fc640 1 -- 172.21.15.28:0/3538918807 learned_addr learned my addr 172.21.15.28:0/3538918807 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:47.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa692ffd640 1 --2- 172.21.15.28:0/3538918807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6940bc120 0x7fa6940bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:47.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa6937fe640 1 --2- 172.21.15.28:0/3538918807 >> v2:172.21.15.131:3300/0 conn(0x7fa694072940 0x7fa69414cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:47.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa68a7fc640 1 -- 172.21.15.28:0/3538918807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6940bc120 msgr2=0x7fa6940bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:47.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa68a7fc640 1 --2- 172.21.15.28:0/3538918807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6940bc120 0x7fa6940bd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:47.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa68a7fc640 1 -- 172.21.15.28:0/3538918807 >> v2:172.21.15.131:3300/0 conn(0x7fa694072940 msgr2=0x7fa69414cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:47.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa68a7fc640 1 --2- 172.21.15.28:0/3538918807 >> v2:172.21.15.131:3300/0 conn(0x7fa694072940 0x7fa69414cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:47.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.431+0000 7fa68a7fc640 1 -- 172.21.15.28:0/3538918807 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6940b7d60 con 0x7fa6940a2d60 2023-11-28T19:31:47.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa68a7fc640 1 --2- 172.21.15.28:0/3538918807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6940a2d60 0x7fa69414c9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa6940bc7d0 tx=0x7fa67c01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c54c071eefa4541 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:47.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6927fc640 1 -- 172.21.15.28:0/3538918807 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0a89b0 con 0x7fa6940a2d60 2023-11-28T19:31:47.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6927fc640 1 -- 172.21.15.28:0/3538918807 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa67c0a8b10 con 0x7fa6940a2d60 2023-11-28T19:31:47.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6927fc640 1 -- 172.21.15.28:0/3538918807 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0a8ea0 con 0x7fa6940a2d60 2023-11-28T19:31:47.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 -- 172.21.15.28:0/3538918807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6940a2d60 msgr2=0x7fa69414c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:47.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 --2- 172.21.15.28:0/3538918807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6940a2d60 0x7fa69414c9a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa6940bc7d0 tx=0x7fa67c01ecf0 comp rx=0 tx=0).stop 2023-11-28T19:31:47.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 -- 172.21.15.28:0/3538918807 shutdown_connections 2023-11-28T19:31:47.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 --2- 172.21.15.28:0/3538918807 >> v2:172.21.15.131:3300/0 conn(0x7fa694072940 0x7fa69414cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:47.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 --2- 172.21.15.28:0/3538918807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6940a2d60 0x7fa69414c9a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:47.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 --2- 172.21.15.28:0/3538918807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6940bc120 0x7fa6940bd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:47.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 -- 172.21.15.28:0/3538918807 >> 172.21.15.28:0/3538918807 conn(0x7fa69406ab80 msgr2=0x7fa6940bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:47.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 -- 172.21.15.28:0/3538918807 shutdown_connections 2023-11-28T19:31:47.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 -- 172.21.15.28:0/3538918807 wait complete. 2023-11-28T19:31:47.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 Processor -- start 2023-11-28T19:31:47.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 -- start start 2023-11-28T19:31:47.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa694072940 0x7fa694147e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:47.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6940a2d60 0x7fa6941e2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:47.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6940bc120 0x7fa6941e2870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:47.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6941483a0 con 0x7fa6940bc120 2023-11-28T19:31:47.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6941d65a0 con 0x7fa694072940 2023-11-28T19:31:47.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6992f4640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6941e1ee0 con 0x7fa6940a2d60 2023-11-28T19:31:47.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6937fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6940bc120 0x7fa6941e2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:47.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6937fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6940bc120 0x7fa6941e2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50828/0 (socket says 172.21.15.28:50828) 2023-11-28T19:31:47.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.435+0000 7fa6937fe640 1 -- 172.21.15.28:0/2353771694 learned_addr learned my addr 172.21.15.28:0/2353771694 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:47.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa692ffd640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa694072940 0x7fa694147e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:47.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa68a7fc640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6940a2d60 0x7fa6941e2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:47.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa6937fe640 1 -- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6940a2d60 msgr2=0x7fa6941e2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:47.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa6937fe640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6940a2d60 0x7fa6941e2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:47.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa6937fe640 1 -- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa694072940 msgr2=0x7fa694147e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:47.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa6937fe640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa694072940 0x7fa694147e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:47.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa6937fe640 1 -- 172.21.15.28:0/2353771694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c0094d0 con 0x7fa6940bc120 2023-11-28T19:31:47.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa68a7fc640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6940a2d60 0x7fa6941e2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:47.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa6937fe640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6940bc120 0x7fa6941e2870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00eed0 tx=0x7fa68c00b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:47.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa68bfff640 1 -- 172.21.15.28:0/2353771694 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c010040 con 0x7fa6940bc120 2023-11-28T19:31:47.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa68bfff640 1 -- 172.21.15.28:0/2353771694 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c014400 con 0x7fa6940bc120 2023-11-28T19:31:47.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa6992f4640 1 -- 172.21.15.28:0/2353771694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa694149520 con 0x7fa6940bc120 2023-11-28T19:31:47.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa68bfff640 1 -- 172.21.15.28:0/2353771694 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c009ea0 con 0x7fa6940bc120 2023-11-28T19:31:47.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa6992f4640 1 -- 172.21.15.28:0/2353771694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69414a360 con 0x7fa6940bc120 2023-11-28T19:31:47.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa6992f4640 1 -- 172.21.15.28:0/2353771694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6941e2050 con 0x7fa6940bc120 2023-11-28T19:31:47.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa68bfff640 1 -- 172.21.15.28:0/2353771694 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa68c0147b0 con 0x7fa6940bc120 2023-11-28T19:31:47.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa68bfff640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa674066470 0x7fa674068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:47.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa68bfff640 1 -- 172.21.15.28:0/2353771694 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa68c084530 con 0x7fa6940bc120 2023-11-28T19:31:47.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa692ffd640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa674066470 0x7fa674068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:47.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.439+0000 7fa692ffd640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa674066470 0x7fa674068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa684009a50 tx=0x7fa684008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:47.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.443+0000 7fa68bfff640 1 -- 172.21.15.28:0/2353771694 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa6941e2050 con 0x7fa6940bc120 2023-11-28T19:31:47.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:47.639+0000 7fa6992f4640 1 -- 172.21.15.28:0/2353771694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa6941e2050 con 0x7fa6940bc120 2023-11-28T19:31:48.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.271+0000 7fa68bfff640 1 -- 172.21.15.28:0/2353771694 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa6941e2050 con 0x7fa6940bc120 2023-11-28T19:31:48.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.275+0000 7fa6992f4640 1 -- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa674066470 msgr2=0x7fa674068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:48.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.275+0000 7fa6992f4640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa674066470 0x7fa674068930 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa684009a50 tx=0x7fa684008040 comp rx=0 tx=0).stop 2023-11-28T19:31:48.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.275+0000 7fa6992f4640 1 -- 172.21.15.28:0/2353771694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6940bc120 msgr2=0x7fa6941e2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:48.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.275+0000 7fa6992f4640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6940bc120 0x7fa6941e2870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa68c00eed0 tx=0x7fa68c00b480 comp rx=0 tx=0).stop 2023-11-28T19:31:48.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.275+0000 7fa6992f4640 1 -- 172.21.15.28:0/2353771694 shutdown_connections 2023-11-28T19:31:48.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.275+0000 7fa6992f4640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa674066470 0x7fa674068930 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.275+0000 7fa6992f4640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6940bc120 0x7fa6941e2870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.275+0000 7fa6992f4640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa6940a2d60 0x7fa6941e2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.275+0000 7fa6992f4640 1 --2- 172.21.15.28:0/2353771694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa694072940 0x7fa694147e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.275+0000 7fa6992f4640 1 -- 172.21.15.28:0/2353771694 >> 172.21.15.28:0/2353771694 conn(0x7fa69406ab80 msgr2=0x7fa69406f650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:48.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.275+0000 7fa6992f4640 1 -- 172.21.15.28:0/2353771694 shutdown_connections 2023-11-28T19:31:48.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.275+0000 7fa6992f4640 1 -- 172.21.15.28:0/2353771694 wait complete. 2023-11-28T19:31:48.282 INFO:tasks.ceph.mds.a.smithi028.stderr:2023-11-28T19:31:48.279+0000 7fb3dc76f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T19:31:48.300 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T19:31:48.302 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:31:48.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.423+0000 7fe927ce5640 1 Processor -- start 2023-11-28T19:31:48.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.423+0000 7fe927ce5640 1 -- start start 2023-11-28T19:31:48.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe927ce5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe92006aed0 0x7fe92014b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe927ce5640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe92014bc20 0x7fe920155da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe927ce5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9200bd5e0 con 0x7fe92006aaf0 2023-11-28T19:31:48.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe927ce5640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9200bc1c0 con 0x7fe92014bc20 2023-11-28T19:31:48.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe927ce5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92006b310 con 0x7fe92006aed0 2023-11-28T19:31:48.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe925a81640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe92006aaf0 0x7fe92014ac70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49502/0 (socket says 172.21.15.28:49502) 2023-11-28T19:31:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe925a81640 1 -- 172.21.15.28:0/2555713191 learned_addr learned my addr 172.21.15.28:0/2555713191 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe926282640 1 --2- 172.21.15.28:0/2555713191 >> v2:172.21.15.131:3300/0 conn(0x7fe92014bc20 0x7fe920155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe925280640 1 --2- 172.21.15.28:0/2555713191 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe92006aed0 0x7fe92014b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 -- 172.21.15.28:0/2555713191 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193694748 0 0) 0x7fe9200bd5e0 con 0x7fe92006aaf0 2023-11-28T19:31:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 -- 172.21.15.28:0/2555713191 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe90c003530 con 0x7fe92006aaf0 2023-11-28T19:31:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 -- 172.21.15.28:0/2555713191 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3420628338 0 0) 0x7fe90c003530 con 0x7fe92006aaf0 2023-11-28T19:31:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 -- 172.21.15.28:0/2555713191 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe92006aed0 msgr2=0x7fe92014b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 --2- 172.21.15.28:0/2555713191 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe92006aed0 0x7fe92014b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 -- 172.21.15.28:0/2555713191 >> v2:172.21.15.131:3300/0 conn(0x7fe92014bc20 msgr2=0x7fe920155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 --2- 172.21.15.28:0/2555713191 >> v2:172.21.15.131:3300/0 conn(0x7fe92014bc20 0x7fe920155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 -- 172.21.15.28:0/2555713191 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92006bca0 con 0x7fe92006aaf0 2023-11-28T19:31:48.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 -- 172.21.15.28:0/2555713191 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7fe910001680 con 0x7fe92006aaf0 2023-11-28T19:31:48.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 -- 172.21.15.28:0/2555713191 >> v1:172.21.15.28:6789/0 conn(0x7fe92006aaf0 legacy=0x7fe92014ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:48.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 --2- 172.21.15.28:0/2555713191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe90c003980 0x7fe90c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 --2- 172.21.15.28:0/2555713191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe90c0047d0 0x7fe90c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 --2- 172.21.15.28:0/2555713191 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe92006aed0 0x7fe90c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 -- 172.21.15.28:0/2555713191 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92006b310 con 0x7fe90c003980 2023-11-28T19:31:48.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 -- 172.21.15.28:0/2555713191 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c00b990 con 0x7fe90c0047d0 2023-11-28T19:31:48.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe924a7f640 1 -- 172.21.15.28:0/2555713191 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c00bad0 con 0x7fe92006aed0 2023-11-28T19:31:48.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe925a81640 1 --2- 172.21.15.28:0/2555713191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe90c003980 0x7fe90c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:48.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe925a81640 1 -- 172.21.15.28:0/2555713191 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe92006aed0 msgr2=0x7fe90c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:48.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe925a81640 1 --2- 172.21.15.28:0/2555713191 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe92006aed0 0x7fe90c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe925280640 1 --2- 172.21.15.28:0/2555713191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe90c0047d0 0x7fe90c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:48.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe925a81640 1 -- 172.21.15.28:0/2555713191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe90c0047d0 msgr2=0x7fe90c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:48.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe925a81640 1 --2- 172.21.15.28:0/2555713191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe90c0047d0 0x7fe90c004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.427+0000 7fe925a81640 1 -- 172.21.15.28:0/2555713191 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c003530 con 0x7fe90c003980 2023-11-28T19:31:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe925a81640 1 --2- 172.21.15.28:0/2555713191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe90c003980 0x7fe90c003da0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe91000c1c0 tx=0x7fe91001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b33501546d0364f0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe924a7f640 1 -- 172.21.15.28:0/2555713191 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9100058e0 con 0x7fe90c003980 2023-11-28T19:31:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe924a7f640 1 -- 172.21.15.28:0/2555713191 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe910005a60 con 0x7fe90c003980 2023-11-28T19:31:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe924a7f640 1 -- 172.21.15.28:0/2555713191 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe910005e10 con 0x7fe90c003980 2023-11-28T19:31:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 -- 172.21.15.28:0/2555713191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe90c003980 msgr2=0x7fe90c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 --2- 172.21.15.28:0/2555713191 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe90c003980 0x7fe90c003da0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe91000c1c0 tx=0x7fe91001cc40 comp rx=0 tx=0).stop 2023-11-28T19:31:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe926282640 1 -- 172.21.15.28:0/2555713191 reap_dead start 2023-11-28T19:31:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 -- 172.21.15.28:0/2555713191 shutdown_connections 2023-11-28T19:31:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 -- 172.21.15.28:0/2555713191 >> 172.21.15.28:0/2555713191 conn(0x7fe9200bd790 msgr2=0x7fe9200bdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:48.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 -- 172.21.15.28:0/2555713191 shutdown_connections 2023-11-28T19:31:48.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 -- 172.21.15.28:0/2555713191 wait complete. 2023-11-28T19:31:48.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 Processor -- start 2023-11-28T19:31:48.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 -- start start 2023-11-28T19:31:48.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe90c003980 0x7fe9201e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9200bb590 0x7fe9201459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe920145f30 0x7fe9200a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9201463e0 con 0x7fe920145f30 2023-11-28T19:31:48.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9201e7ce0 con 0x7fe90c003980 2023-11-28T19:31:48.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9200a67c0 con 0x7fe9200bb590 2023-11-28T19:31:48.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe926282640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe920145f30 0x7fe9200a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:48.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe926282640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe920145f30 0x7fe9200a1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50842/0 (socket says 172.21.15.28:50842) 2023-11-28T19:31:48.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe926282640 1 -- 172.21.15.28:0/169240860 learned_addr learned my addr 172.21.15.28:0/169240860 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:48.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe925280640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9200bb590 0x7fe9201459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:48.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe925a81640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe90c003980 0x7fe9201e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:48.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe926282640 1 -- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9200bb590 msgr2=0x7fe9201459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:48.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe926282640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9200bb590 0x7fe9201459f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe926282640 1 -- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe90c003980 msgr2=0x7fe9201e77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:48.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe926282640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe90c003980 0x7fe9201e77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe926282640 1 -- 172.21.15.28:0/169240860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9201e8450 con 0x7fe920145f30 2023-11-28T19:31:48.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe925a81640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe90c003980 0x7fe9201e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:48.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe926282640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe920145f30 0x7fe9200a1390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe92014c000 tx=0x7fe91800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:48.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe9167fc640 1 -- 172.21.15.28:0/169240860 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918010040 con 0x7fe920145f30 2023-11-28T19:31:48.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe9167fc640 1 -- 172.21.15.28:0/169240860 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91800bce0 con 0x7fe920145f30 2023-11-28T19:31:48.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 -- 172.21.15.28:0/169240860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9201e7ed0 con 0x7fe920145f30 2023-11-28T19:31:48.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe9167fc640 1 -- 172.21.15.28:0/169240860 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe918014640 con 0x7fe920145f30 2023-11-28T19:31:48.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.431+0000 7fe927ce5640 1 -- 172.21.15.28:0/169240860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9200a0c70 con 0x7fe920145f30 2023-11-28T19:31:48.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.435+0000 7fe927ce5640 1 -- 172.21.15.28:0/169240860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9200a10b0 con 0x7fe920145f30 2023-11-28T19:31:48.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.435+0000 7fe9167fc640 1 -- 172.21.15.28:0/169240860 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe9180147a0 con 0x7fe920145f30 2023-11-28T19:31:48.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.435+0000 7fe9167fc640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe904066470 0x7fe904068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.435+0000 7fe9167fc640 1 -- 172.21.15.28:0/169240860 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe918084450 con 0x7fe920145f30 2023-11-28T19:31:48.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.435+0000 7fe925a81640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe904066470 0x7fe904068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:48.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.435+0000 7fe925a81640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe904066470 0x7fe904068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9100aa000 tx=0x7fe9200b7b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:48.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.439+0000 7fe9167fc640 1 -- 172.21.15.28:0/169240860 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe918051830 con 0x7fe920145f30 2023-11-28T19:31:48.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.631+0000 7fe927ce5640 1 -- 172.21.15.28:0/169240860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe920074a90 con 0x7fe920145f30 2023-11-28T19:31:48.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.631+0000 7fe9167fc640 1 -- 172.21.15.28:0/169240860 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7fe918054e50 con 0x7fe920145f30 2023-11-28T19:31:48.635 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:48.635 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3575778574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3575778574},{"type":"v1","addr":"172.21.15.131:6835","nonce":3575778574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6833/1578638846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1578638846},{"type":"v1","addr":"172.21.15.28:6833","nonce":1578638846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:31:44.589007+0000","modified":"2023-11-28T19:31:47.643502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2598774147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2598774147},{"type":"v1","addr":"172.21.15.28:6835","nonce":2598774147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:31:48.635 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-11-28T19:31:48.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.635+0000 7fe927ce5640 1 -- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe904066470 msgr2=0x7fe904068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:48.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.635+0000 7fe927ce5640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe904066470 0x7fe904068930 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe9100aa000 tx=0x7fe9200b7b50 comp rx=0 tx=0).stop 2023-11-28T19:31:48.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.635+0000 7fe927ce5640 1 -- 172.21.15.28:0/169240860 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe920145f30 msgr2=0x7fe9200a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:48.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.635+0000 7fe927ce5640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe920145f30 0x7fe9200a1390 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe92014c000 tx=0x7fe91800b480 comp rx=0 tx=0).stop 2023-11-28T19:31:48.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.635+0000 7fe927ce5640 1 -- 172.21.15.28:0/169240860 shutdown_connections 2023-11-28T19:31:48.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.635+0000 7fe927ce5640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe904066470 0x7fe904068930 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.635+0000 7fe927ce5640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe920145f30 0x7fe9200a1390 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.635+0000 7fe927ce5640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe9200bb590 0x7fe9201459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.635+0000 7fe927ce5640 1 --2- 172.21.15.28:0/169240860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe90c003980 0x7fe9201e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.635+0000 7fe927ce5640 1 -- 172.21.15.28:0/169240860 >> 172.21.15.28:0/169240860 conn(0x7fe9200bd790 msgr2=0x7fe9200bf820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:48.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.635+0000 7fe927ce5640 1 -- 172.21.15.28:0/169240860 shutdown_connections 2023-11-28T19:31:48.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.635+0000 7fe927ce5640 1 -- 172.21.15.28:0/169240860 wait complete. 2023-11-28T19:31:48.655 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:48.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47b60e9640 1 Processor -- start 2023-11-28T19:31:48.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47b60e9640 1 -- start start 2023-11-28T19:31:48.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47b60e9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f47b00b8f30 0x7f47b0071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47b60e9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b014ccc0 0x7f47b0153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47b60e9640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47b006f780 con 0x7f47b014c860 2023-11-28T19:31:48.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47b60e9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47b0143aa0 con 0x7f47b00b8f30 2023-11-28T19:31:48.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47b60e9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b0072320 con 0x7f47b014ccc0 2023-11-28T19:31:48.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47af7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f47b00b8f30 0x7f47b0071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:48.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47af7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f47b00b8f30 0x7f47b0071790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50848/0 (socket says 172.21.15.28:50848) 2023-11-28T19:31:48.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47af7fe640 1 -- 172.21.15.28:0/4124110807 learned_addr learned my addr 172.21.15.28:0/4124110807 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:48.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47affff640 1 --2- 172.21.15.28:0/4124110807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b014ccc0 0x7f47b0153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:48.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47af7fe640 1 -- 172.21.15.28:0/4124110807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b014ccc0 msgr2=0x7f47b0153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:48.780 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47af7fe640 1 --2- 172.21.15.28:0/4124110807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b014ccc0 0x7f47b0153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47af7fe640 1 -- 172.21.15.28:0/4124110807 >> v1:172.21.15.131:6789/0 conn(0x7f47b014c860 legacy=0x7f47b00b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:48.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.775+0000 7f47af7fe640 1 -- 172.21.15.28:0/4124110807 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b006fcf0 con 0x7f47b00b8f30 2023-11-28T19:31:48.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.779+0000 7f47af7fe640 1 --2- 172.21.15.28:0/4124110807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b00b8f30 0x7f47b0071790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009e50 tx=0x7f47a801c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5421e2fb28f36a73 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:48.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.779+0000 7f47ae7fc640 1 -- 172.21.15.28:0/4124110807 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a80a5650 con 0x7f47b00b8f30 2023-11-28T19:31:48.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.779+0000 7f47ae7fc640 1 -- 172.21.15.28:0/4124110807 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a80a57b0 con 0x7f47b00b8f30 2023-11-28T19:31:48.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.779+0000 7f47ae7fc640 1 -- 172.21.15.28:0/4124110807 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a80a5b40 con 0x7f47b00b8f30 2023-11-28T19:31:48.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.779+0000 7f47b60e9640 1 -- 172.21.15.28:0/4124110807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b00b8f30 msgr2=0x7f47b0071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:48.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.779+0000 7f47b60e9640 1 --2- 172.21.15.28:0/4124110807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b00b8f30 0x7f47b0071790 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009e50 tx=0x7f47a801c9d0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.779+0000 7f47b60e9640 1 -- 172.21.15.28:0/4124110807 shutdown_connections 2023-11-28T19:31:48.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.779+0000 7f47b60e9640 1 --2- 172.21.15.28:0/4124110807 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b014ccc0 0x7f47b0153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.779+0000 7f47b60e9640 1 --2- 172.21.15.28:0/4124110807 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b00b8f30 0x7f47b0071790 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.779+0000 7f47b60e9640 1 -- 172.21.15.28:0/4124110807 >> 172.21.15.28:0/4124110807 conn(0x7f47b00bcb40 msgr2=0x7f47b00bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:48.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.779+0000 7f47b60e9640 1 -- 172.21.15.28:0/4124110807 shutdown_connections 2023-11-28T19:31:48.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.779+0000 7f47b60e9640 1 -- 172.21.15.28:0/4124110807 wait complete. 2023-11-28T19:31:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.779+0000 7f47b60e9640 1 Processor -- start 2023-11-28T19:31:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.779+0000 7f47b60e9640 1 -- start start 2023-11-28T19:31:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47b60e9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b00b8f30 0x7f47b013dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47b60e9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b014c860 0x7f47b013e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47b60e9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b014ccc0 0x7f47b0141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47b60e9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b013e020 con 0x7f47b014ccc0 2023-11-28T19:31:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47b60e9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47b01e3d00 con 0x7f47b014c860 2023-11-28T19:31:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47b60e9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47b013ef00 con 0x7f47b00b8f30 2023-11-28T19:31:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47affff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b014ccc0 0x7f47b0141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:48.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47affff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b014ccc0 0x7f47b0141390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50860/0 (socket says 172.21.15.28:50860) 2023-11-28T19:31:48.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47affff640 1 -- 172.21.15.28:0/1626018061 learned_addr learned my addr 172.21.15.28:0/1626018061 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:48.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47aeffd640 1 --2- 172.21.15.28:0/1626018061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b014c860 0x7f47b013e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:48.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47af7fe640 1 --2- 172.21.15.28:0/1626018061 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b00b8f30 0x7f47b013dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:48.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47affff640 1 -- 172.21.15.28:0/1626018061 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b00b8f30 msgr2=0x7f47b013dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:48.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47affff640 1 --2- 172.21.15.28:0/1626018061 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b00b8f30 0x7f47b013dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47affff640 1 -- 172.21.15.28:0/1626018061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b014c860 msgr2=0x7f47b013e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:48.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47affff640 1 --2- 172.21.15.28:0/1626018061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b014c860 0x7f47b013e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47affff640 1 -- 172.21.15.28:0/1626018061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a8009b30 con 0x7f47b014ccc0 2023-11-28T19:31:48.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47affff640 1 --2- 172.21.15.28:0/1626018061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b014ccc0 0x7f47b0141390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f47a0006e90 tx=0x7f47a000d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:48.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47a7fff640 1 -- 172.21.15.28:0/1626018061 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a00125f0 con 0x7f47b014ccc0 2023-11-28T19:31:48.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47a7fff640 1 -- 172.21.15.28:0/1626018061 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47a0012750 con 0x7f47b014ccc0 2023-11-28T19:31:48.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47b60e9640 1 -- 172.21.15.28:0/1626018061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b01e3fa0 con 0x7f47b014ccc0 2023-11-28T19:31:48.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47a7fff640 1 -- 172.21.15.28:0/1626018061 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47a0012b00 con 0x7f47b014ccc0 2023-11-28T19:31:48.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47b60e9640 1 -- 172.21.15.28:0/1626018061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b01e4560 con 0x7f47b014ccc0 2023-11-28T19:31:48.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47b60e9640 1 -- 172.21.15.28:0/1626018061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47b01e4780 con 0x7f47b014ccc0 2023-11-28T19:31:48.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47a7fff640 1 -- 172.21.15.28:0/1626018061 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f47a0012c60 con 0x7f47b014ccc0 2023-11-28T19:31:48.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47a7fff640 1 --2- 172.21.15.28:0/1626018061 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4794066470 0x7f4794068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:48.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.783+0000 7f47a7fff640 1 -- 172.21.15.28:0/1626018061 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47a00842e0 con 0x7f47b014ccc0 2023-11-28T19:31:48.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.787+0000 7f47af7fe640 1 --2- 172.21.15.28:0/1626018061 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4794066470 0x7f4794068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:48.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.787+0000 7f47af7fe640 1 --2- 172.21.15.28:0/1626018061 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4794066470 0x7f4794068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f47a80ae000 tx=0x7f47a80a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:48.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.791+0000 7f47a7fff640 1 -- 172.21.15.28:0/1626018061 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f47a0051760 con 0x7f47b014ccc0 2023-11-28T19:31:48.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.943+0000 7f47b60e9640 1 -- 172.21.15.28:0/1626018061 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47b0074a90 con 0x7f47b014ccc0 2023-11-28T19:31:48.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.947+0000 7f47a7fff640 1 -- 172.21.15.28:0/1626018061 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f47a0054d80 con 0x7f47b014ccc0 2023-11-28T19:31:48.950 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:48.951 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:48.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.947+0000 7f47b60e9640 1 -- 172.21.15.28:0/1626018061 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4794066470 msgr2=0x7f4794068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:48.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.947+0000 7f47b60e9640 1 --2- 172.21.15.28:0/1626018061 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4794066470 0x7f4794068930 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f47a80ae000 tx=0x7f47a80a7070 comp rx=0 tx=0).stop 2023-11-28T19:31:48.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.947+0000 7f47b60e9640 1 -- 172.21.15.28:0/1626018061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b014ccc0 msgr2=0x7f47b0141390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:48.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.947+0000 7f47b60e9640 1 --2- 172.21.15.28:0/1626018061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b014ccc0 0x7f47b0141390 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f47a0006e90 tx=0x7f47a000d9e0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.947+0000 7f47b60e9640 1 -- 172.21.15.28:0/1626018061 shutdown_connections 2023-11-28T19:31:48.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.947+0000 7f47b60e9640 1 --2- 172.21.15.28:0/1626018061 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4794066470 0x7f4794068930 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.947+0000 7f47b60e9640 1 --2- 172.21.15.28:0/1626018061 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47b014ccc0 0x7f47b0141390 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.947+0000 7f47b60e9640 1 --2- 172.21.15.28:0/1626018061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47b014c860 0x7f47b013e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.947+0000 7f47b60e9640 1 --2- 172.21.15.28:0/1626018061 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47b00b8f30 0x7f47b013dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:48.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.947+0000 7f47b60e9640 1 -- 172.21.15.28:0/1626018061 >> 172.21.15.28:0/1626018061 conn(0x7f47b00bcb40 msgr2=0x7f47b014b880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:48.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.947+0000 7f47b60e9640 1 -- 172.21.15.28:0/1626018061 shutdown_connections 2023-11-28T19:31:48.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:48.947+0000 7f47b60e9640 1 -- 172.21.15.28:0/1626018061 wait complete. 2023-11-28T19:31:48.971 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T19:31:48.972 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T19:31:49.088 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.083+0000 7ff0e5f46640 1 Processor -- start 2023-11-28T19:31:49.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.083+0000 7ff0e5f46640 1 -- start start 2023-11-28T19:31:49.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0e5f46640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff0e014ccc0 0x7ff0e0154c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0e5f46640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e006f780 con 0x7ff0e014c860 2023-11-28T19:31:49.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0e5f46640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0e0072320 con 0x7ff0e00b8f30 2023-11-28T19:31:49.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0e5f46640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0e0143aa0 con 0x7ff0e014ccc0 2023-11-28T19:31:49.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0deffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff0e014c860 0x7ff0e00b6250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49516/0 (socket says 172.21.15.28:49516) 2023-11-28T19:31:49.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0dffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff0e014ccc0 0x7ff0e0154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0deffd640 1 -- 172.21.15.28:0/3997455214 learned_addr learned my addr 172.21.15.28:0/3997455214 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:49.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0dffff640 1 -- 172.21.15.28:0/3997455214 >> v1:172.21.15.131:6789/0 conn(0x7ff0e00b8f30 legacy=0x7ff0e0071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:49.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0dffff640 1 -- 172.21.15.28:0/3997455214 >> v1:172.21.15.28:6789/0 conn(0x7ff0e014c860 legacy=0x7ff0e00b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0dffff640 1 -- 172.21.15.28:0/3997455214 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e006fcf0 con 0x7ff0e014ccc0 2023-11-28T19:31:49.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0de7fc640 1 -- 172.21.15.28:0/3997455214 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257590633 0 0) 0x7ff0d4001120 con 0x7ff0e014c860 2023-11-28T19:31:49.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0dffff640 1 --2- 172.21.15.28:0/3997455214 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0e014ccc0 0x7ff0e0154c00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009d90 tx=0x7ff0d801c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff4a8318ecdbb14 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:49.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0de7fc640 1 -- 172.21.15.28:0/3997455214 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d80a5810 con 0x7ff0e014ccc0 2023-11-28T19:31:49.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0de7fc640 1 -- 172.21.15.28:0/3997455214 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d80a5970 con 0x7ff0e014ccc0 2023-11-28T19:31:49.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0de7fc640 1 -- 172.21.15.28:0/3997455214 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d80a5d00 con 0x7ff0e014ccc0 2023-11-28T19:31:49.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0e5f46640 1 -- 172.21.15.28:0/3997455214 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0e014ccc0 msgr2=0x7ff0e0154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0e5f46640 1 --2- 172.21.15.28:0/3997455214 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0e014ccc0 0x7ff0e0154c00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009d90 tx=0x7ff0d801c950 comp rx=0 tx=0).stop 2023-11-28T19:31:49.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0e5f46640 1 -- 172.21.15.28:0/3997455214 shutdown_connections 2023-11-28T19:31:49.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0e5f46640 1 --2- 172.21.15.28:0/3997455214 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0e014ccc0 0x7ff0e0154c00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0e5f46640 1 -- 172.21.15.28:0/3997455214 >> 172.21.15.28:0/3997455214 conn(0x7ff0e00bcb40 msgr2=0x7ff0e00bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:49.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.087+0000 7ff0e5f46640 1 -- 172.21.15.28:0/3997455214 shutdown_connections 2023-11-28T19:31:49.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0e5f46640 1 -- 172.21.15.28:0/3997455214 wait complete. 2023-11-28T19:31:49.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0e5f46640 1 Processor -- start 2023-11-28T19:31:49.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0e5f46640 1 -- start start 2023-11-28T19:31:49.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0e5f46640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e00b8f30 0x7ff0e01e2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0e5f46640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0e014c860 0x7ff0e0140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0e5f46640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0e014ccc0 0x7ff0e0136dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0e5f46640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e0137310 con 0x7ff0e014ccc0 2023-11-28T19:31:49.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0e5f46640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e01e24b0 con 0x7ff0e00b8f30 2023-11-28T19:31:49.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0e5f46640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e014a430 con 0x7ff0e014c860 2023-11-28T19:31:49.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0dffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0e014ccc0 0x7ff0e0136dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0dffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0e014ccc0 0x7ff0e0136dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50878/0 (socket says 172.21.15.28:50878) 2023-11-28T19:31:49.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0dffff640 1 -- 172.21.15.28:0/2912440929 learned_addr learned my addr 172.21.15.28:0/2912440929 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:49.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0deffd640 1 --2- 172.21.15.28:0/2912440929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0e014c860 0x7ff0e0140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0df7fe640 1 --2- 172.21.15.28:0/2912440929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e00b8f30 0x7ff0e01e2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0dffff640 1 -- 172.21.15.28:0/2912440929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0e014c860 msgr2=0x7ff0e0140a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0dffff640 1 --2- 172.21.15.28:0/2912440929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0e014c860 0x7ff0e0140a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0dffff640 1 -- 172.21.15.28:0/2912440929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e00b8f30 msgr2=0x7ff0e01e2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0dffff640 1 --2- 172.21.15.28:0/2912440929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e00b8f30 0x7ff0e01e2940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0dffff640 1 -- 172.21.15.28:0/2912440929 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d8009a70 con 0x7ff0e014ccc0 2023-11-28T19:31:49.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0dffff640 1 --2- 172.21.15.28:0/2912440929 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0e014ccc0 0x7ff0e0136dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff0d801a580 tx=0x7ff0d80196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:49.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0c7fff640 1 -- 172.21.15.28:0/2912440929 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d80b9860 con 0x7ff0e014ccc0 2023-11-28T19:31:49.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0c7fff640 1 -- 172.21.15.28:0/2912440929 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0d80a5800 con 0x7ff0e014ccc0 2023-11-28T19:31:49.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0e5f46640 1 -- 172.21.15.28:0/2912440929 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e013b930 con 0x7ff0e014ccc0 2023-11-28T19:31:49.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0c7fff640 1 -- 172.21.15.28:0/2912440929 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d80b9bc0 con 0x7ff0e014ccc0 2023-11-28T19:31:49.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0e5f46640 1 -- 172.21.15.28:0/2912440929 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e01e2140 con 0x7ff0e014ccc0 2023-11-28T19:31:49.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.091+0000 7ff0e5f46640 1 -- 172.21.15.28:0/2912440929 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0e0074a90 con 0x7ff0e014ccc0 2023-11-28T19:31:49.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.095+0000 7ff0c7fff640 1 -- 172.21.15.28:0/2912440929 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff0d80b9d20 con 0x7ff0e014ccc0 2023-11-28T19:31:49.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.095+0000 7ff0c7fff640 1 --2- 172.21.15.28:0/2912440929 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff0cc066470 0x7ff0cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.095+0000 7ff0c7fff640 1 -- 172.21.15.28:0/2912440929 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0d811f3e0 con 0x7ff0e014ccc0 2023-11-28T19:31:49.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.095+0000 7ff0df7fe640 1 --2- 172.21.15.28:0/2912440929 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff0cc066470 0x7ff0cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.099 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.095+0000 7ff0df7fe640 1 --2- 172.21.15.28:0/2912440929 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff0cc066470 0x7ff0cc068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0000f70 tx=0x7ff0d0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:49.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.099+0000 7ff0c7fff640 1 -- 172.21.15.28:0/2912440929 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff0d80ec750 con 0x7ff0e014ccc0 2023-11-28T19:31:49.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.251+0000 7ff0e5f46640 1 -- 172.21.15.28:0/2912440929 --> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff0e01e25f0 con 0x7ff0cc066470 2023-11-28T19:31:49.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.271+0000 7ff0c7fff640 1 -- 172.21.15.28:0/2912440929 <== mgr.4100 v2:172.21.15.131:6832/3367043860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264592 (secure 0 0 0) 0x7ff0e01e25f0 con 0x7ff0cc066470 2023-11-28T19:31:49.277 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:49.281 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-28T19:31:49.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.275+0000 7ff0e5f46640 1 -- 172.21.15.28:0/2912440929 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff0cc066470 msgr2=0x7ff0cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.275+0000 7ff0e5f46640 1 --2- 172.21.15.28:0/2912440929 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff0cc066470 0x7ff0cc068930 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0000f70 tx=0x7ff0d0009040 comp rx=0 tx=0).stop 2023-11-28T19:31:49.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.275+0000 7ff0e5f46640 1 -- 172.21.15.28:0/2912440929 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0e014ccc0 msgr2=0x7ff0e0136dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.275+0000 7ff0e5f46640 1 --2- 172.21.15.28:0/2912440929 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0e014ccc0 0x7ff0e0136dd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff0d801a580 tx=0x7ff0d80196f0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.275+0000 7ff0e5f46640 1 -- 172.21.15.28:0/2912440929 shutdown_connections 2023-11-28T19:31:49.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.275+0000 7ff0e5f46640 1 --2- 172.21.15.28:0/2912440929 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff0cc066470 0x7ff0cc068930 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.275+0000 7ff0e5f46640 1 --2- 172.21.15.28:0/2912440929 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff0e014ccc0 0x7ff0e0136dd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.275+0000 7ff0e5f46640 1 --2- 172.21.15.28:0/2912440929 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff0e014c860 0x7ff0e0140a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.275+0000 7ff0e5f46640 1 --2- 172.21.15.28:0/2912440929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0e00b8f30 0x7ff0e01e2940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.275+0000 7ff0e5f46640 1 -- 172.21.15.28:0/2912440929 >> 172.21.15.28:0/2912440929 conn(0x7ff0e00bcb40 msgr2=0x7ff0e014ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.275+0000 7ff0e5f46640 1 -- 172.21.15.28:0/2912440929 shutdown_connections 2023-11-28T19:31:49.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.275+0000 7ff0e5f46640 1 -- 172.21.15.28:0/2912440929 wait complete. 2023-11-28T19:31:49.300 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-28T19:31:49.135785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235672,"kb_used_data":2860,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739048,"statfs":{"total":773094113280,"available":772852785152,"internally_reserved":0,"allocated":2928640,"data_stored":1758704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,5,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":71,"apply_latency_ms":71,"commit_latency_ns":71000000,"apply_latency_ns":71000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.929539"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.136073+0000","last_change":"2023-11-28T19:31:45.117939+0000","last_active":"2023-11-28T19:31:45.136073+0000","last_peered":"2023-11-28T19:31:45.136073+0000","last_clean":"2023-11-28T19:31:45.136073+0000","last_became_active":"2023-11-28T19:31:45.116596+0000","last_became_peered":"2023-11-28T19:31:45.116596+0000","last_unstale":"2023-11-28T19:31:45.136073+0000","last_undegraded":"2023-11-28T19:31:45.136073+0000","last_fullsized":"2023-11-28T19:31:45.136073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:10.179262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.113887+0000","last_change":"2023-11-28T19:31:45.108670+0000","last_active":"2023-11-28T19:31:45.113887+0000","last_peered":"2023-11-28T19:31:45.113887+0000","last_clean":"2023-11-28T19:31:45.113887+0000","last_became_active":"2023-11-28T19:31:45.107887+0000","last_became_peered":"2023-11-28T19:31:45.107887+0000","last_unstale":"2023-11-28T19:31:45.113887+0000","last_undegraded":"2023-11-28T19:31:45.113887+0000","last_fullsized":"2023-11-28T19:31:45.113887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:14.608349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.120536+0000","last_change":"2023-11-28T19:31:45.114729+0000","last_active":"2023-11-28T19:31:45.120536+0000","last_peered":"2023-11-28T19:31:45.120536+0000","last_clean":"2023-11-28T19:31:45.120536+0000","last_became_active":"2023-11-28T19:31:45.113974+0000","last_became_peered":"2023-11-28T19:31:45.113974+0000","last_unstale":"2023-11-28T19:31:45.120536+0000","last_undegraded":"2023-11-28T19:31:45.120536+0000","last_fullsized":"2023-11-28T19:31:45.120536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:55.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081481+0000","last_change":"2023-11-28T19:31:45.127387+0000","last_active":"2023-11-28T19:31:46.081481+0000","last_peered":"2023-11-28T19:31:46.081481+0000","last_clean":"2023-11-28T19:31:46.081481+0000","last_became_active":"2023-11-28T19:31:45.126614+0000","last_became_peered":"2023-11-28T19:31:45.126614+0000","last_unstale":"2023-11-28T19:31:46.081481+0000","last_undegraded":"2023-11-28T19:31:46.081481+0000","last_fullsized":"2023-11-28T19:31:46.081481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:03.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.114659+0000","last_change":"2023-11-28T19:31:45.100132+0000","last_active":"2023-11-28T19:31:45.114659+0000","last_peered":"2023-11-28T19:31:45.114659+0000","last_clean":"2023-11-28T19:31:45.114659+0000","last_became_active":"2023-11-28T19:31:45.099229+0000","last_became_peered":"2023-11-28T19:31:45.099229+0000","last_unstale":"2023-11-28T19:31:45.114659+0000","last_undegraded":"2023-11-28T19:31:45.114659+0000","last_fullsized":"2023-11-28T19:31:45.114659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:14.608349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081218+0000","last_change":"2023-11-28T19:31:45.125593+0000","last_active":"2023-11-28T19:31:46.081218+0000","last_peered":"2023-11-28T19:31:46.081218+0000","last_clean":"2023-11-28T19:31:46.081218+0000","last_became_active":"2023-11-28T19:31:45.124811+0000","last_became_peered":"2023-11-28T19:31:45.124811+0000","last_unstale":"2023-11-28T19:31:46.081218+0000","last_undegraded":"2023-11-28T19:31:46.081218+0000","last_fullsized":"2023-11-28T19:31:46.081218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:59:45.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.114791+0000","last_change":"2023-11-28T19:31:45.104970+0000","last_active":"2023-11-28T19:31:45.114791+0000","last_peered":"2023-11-28T19:31:45.114791+0000","last_clean":"2023-11-28T19:31:45.114791+0000","last_became_active":"2023-11-28T19:31:45.104131+0000","last_became_peered":"2023-11-28T19:31:45.104131+0000","last_unstale":"2023-11-28T19:31:45.114791+0000","last_undegraded":"2023-11-28T19:31:45.114791+0000","last_fullsized":"2023-11-28T19:31:45.114791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:22:58.641123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402100+0000","last_change":"2023-11-28T19:31:45.130940+0000","last_active":"2023-11-28T19:31:46.402100+0000","last_peered":"2023-11-28T19:31:46.402100+0000","last_clean":"2023-11-28T19:31:46.402100+0000","last_became_active":"2023-11-28T19:31:45.130171+0000","last_became_peered":"2023-11-28T19:31:45.130171+0000","last_unstale":"2023-11-28T19:31:46.402100+0000","last_undegraded":"2023-11-28T19:31:46.402100+0000","last_fullsized":"2023-11-28T19:31:46.402100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:31.344915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.139131+0000","last_change":"2023-11-28T19:31:45.130835+0000","last_active":"2023-11-28T19:31:45.139131+0000","last_peered":"2023-11-28T19:31:45.139131+0000","last_clean":"2023-11-28T19:31:45.139131+0000","last_became_active":"2023-11-28T19:31:45.130194+0000","last_became_peered":"2023-11-28T19:31:45.130194+0000","last_unstale":"2023-11-28T19:31:45.139131+0000","last_undegraded":"2023-11-28T19:31:45.139131+0000","last_fullsized":"2023-11-28T19:31:45.139131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:54.812488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999097+0000","last_change":"2023-11-28T19:31:45.127252+0000","last_active":"2023-11-28T19:31:46.999097+0000","last_peered":"2023-11-28T19:31:46.999097+0000","last_clean":"2023-11-28T19:31:46.999097+0000","last_became_active":"2023-11-28T19:31:45.125570+0000","last_became_peered":"2023-11-28T19:31:45.125570+0000","last_unstale":"2023-11-28T19:31:46.999097+0000","last_undegraded":"2023-11-28T19:31:46.999097+0000","last_fullsized":"2023-11-28T19:31:46.999097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998852+0000","last_change":"2023-11-28T19:31:45.127138+0000","last_active":"2023-11-28T19:31:46.998852+0000","last_peered":"2023-11-28T19:31:46.998852+0000","last_clean":"2023-11-28T19:31:46.998852+0000","last_became_active":"2023-11-28T19:31:45.126392+0000","last_became_peered":"2023-11-28T19:31:45.126392+0000","last_unstale":"2023-11-28T19:31:46.998852+0000","last_undegraded":"2023-11-28T19:31:46.998852+0000","last_fullsized":"2023-11-28T19:31:46.998852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.132390+0000","last_change":"2023-11-28T19:31:45.116329+0000","last_active":"2023-11-28T19:31:45.132390+0000","last_peered":"2023-11-28T19:31:45.132390+0000","last_clean":"2023-11-28T19:31:45.132390+0000","last_became_active":"2023-11-28T19:31:45.115691+0000","last_became_peered":"2023-11-28T19:31:45.115691+0000","last_unstale":"2023-11-28T19:31:45.132390+0000","last_undegraded":"2023-11-28T19:31:45.132390+0000","last_fullsized":"2023-11-28T19:31:45.132390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:35.665785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402092+0000","last_change":"2023-11-28T19:31:45.118954+0000","last_active":"2023-11-28T19:31:46.402092+0000","last_peered":"2023-11-28T19:31:46.402092+0000","last_clean":"2023-11-28T19:31:46.402092+0000","last_became_active":"2023-11-28T19:31:45.116311+0000","last_became_peered":"2023-11-28T19:31:45.116311+0000","last_unstale":"2023-11-28T19:31:46.402092+0000","last_undegraded":"2023-11-28T19:31:46.402092+0000","last_fullsized":"2023-11-28T19:31:46.402092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:02.633458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.116602+0000","last_change":"2023-11-28T19:31:45.104928+0000","last_active":"2023-11-28T19:31:45.116602+0000","last_peered":"2023-11-28T19:31:45.116602+0000","last_clean":"2023-11-28T19:31:45.116602+0000","last_became_active":"2023-11-28T19:31:45.104131+0000","last_became_peered":"2023-11-28T19:31:45.104131+0000","last_unstale":"2023-11-28T19:31:45.116602+0000","last_undegraded":"2023-11-28T19:31:45.116602+0000","last_fullsized":"2023-11-28T19:31:45.116602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:36.369814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.110972+0000","last_change":"2023-11-28T19:31:45.104838+0000","last_active":"2023-11-28T19:31:45.110972+0000","last_peered":"2023-11-28T19:31:45.110972+0000","last_clean":"2023-11-28T19:31:45.110972+0000","last_became_active":"2023-11-28T19:31:45.104087+0000","last_became_peered":"2023-11-28T19:31:45.104087+0000","last_unstale":"2023-11-28T19:31:45.110972+0000","last_undegraded":"2023-11-28T19:31:45.110972+0000","last_fullsized":"2023-11-28T19:31:45.110972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:09.743296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.080886+0000","last_change":"2023-11-28T19:31:45.124848+0000","last_active":"2023-11-28T19:31:46.080886+0000","last_peered":"2023-11-28T19:31:46.080886+0000","last_clean":"2023-11-28T19:31:46.080886+0000","last_became_active":"2023-11-28T19:31:45.124031+0000","last_became_peered":"2023-11-28T19:31:45.124031+0000","last_unstale":"2023-11-28T19:31:46.080886+0000","last_undegraded":"2023-11-28T19:31:46.080886+0000","last_fullsized":"2023-11-28T19:31:46.080886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082592+0000","last_change":"2023-11-28T19:31:45.134085+0000","last_active":"2023-11-28T19:31:46.082592+0000","last_peered":"2023-11-28T19:31:46.082592+0000","last_clean":"2023-11-28T19:31:46.082592+0000","last_became_active":"2023-11-28T19:31:45.132979+0000","last_became_peered":"2023-11-28T19:31:45.132979+0000","last_unstale":"2023-11-28T19:31:46.082592+0000","last_undegraded":"2023-11-28T19:31:46.082592+0000","last_fullsized":"2023-11-28T19:31:46.082592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:11.287539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077713+0000","last_change":"2023-11-28T19:31:45.117122+0000","last_active":"2023-11-28T19:31:46.077713+0000","last_peered":"2023-11-28T19:31:46.077713+0000","last_clean":"2023-11-28T19:31:46.077713+0000","last_became_active":"2023-11-28T19:31:45.116462+0000","last_became_peered":"2023-11-28T19:31:45.116462+0000","last_unstale":"2023-11-28T19:31:46.077713+0000","last_undegraded":"2023-11-28T19:31:46.077713+0000","last_fullsized":"2023-11-28T19:31:46.077713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:55.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.135734+0000","last_change":"2023-11-28T19:31:45.114295+0000","last_active":"2023-11-28T19:31:45.135734+0000","last_peered":"2023-11-28T19:31:45.135734+0000","last_clean":"2023-11-28T19:31:45.135734+0000","last_became_active":"2023-11-28T19:31:45.113478+0000","last_became_peered":"2023-11-28T19:31:45.113478+0000","last_unstale":"2023-11-28T19:31:45.135734+0000","last_undegraded":"2023-11-28T19:31:45.135734+0000","last_fullsized":"2023-11-28T19:31:45.135734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998559+0000","last_change":"2023-11-28T19:31:45.121559+0000","last_active":"2023-11-28T19:31:46.998559+0000","last_peered":"2023-11-28T19:31:46.998559+0000","last_clean":"2023-11-28T19:31:46.998559+0000","last_became_active":"2023-11-28T19:31:45.120810+0000","last_became_peered":"2023-11-28T19:31:45.120810+0000","last_unstale":"2023-11-28T19:31:46.998559+0000","last_undegraded":"2023-11-28T19:31:46.998559+0000","last_fullsized":"2023-11-28T19:31:46.998559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:31.344915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.121037+0000","last_change":"2023-11-28T19:31:45.110520+0000","last_active":"2023-11-28T19:31:45.121037+0000","last_peered":"2023-11-28T19:31:45.121037+0000","last_clean":"2023-11-28T19:31:45.121037+0000","last_became_active":"2023-11-28T19:31:45.109508+0000","last_became_peered":"2023-11-28T19:31:45.109508+0000","last_unstale":"2023-11-28T19:31:45.121037+0000","last_undegraded":"2023-11-28T19:31:45.121037+0000","last_fullsized":"2023-11-28T19:31:45.121037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:19.783090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081502+0000","last_change":"2023-11-28T19:31:45.135559+0000","last_active":"2023-11-28T19:31:46.081502+0000","last_peered":"2023-11-28T19:31:46.081502+0000","last_clean":"2023-11-28T19:31:46.081502+0000","last_became_active":"2023-11-28T19:31:45.134957+0000","last_became_peered":"2023-11-28T19:31:45.134957+0000","last_unstale":"2023-11-28T19:31:46.081502+0000","last_undegraded":"2023-11-28T19:31:46.081502+0000","last_fullsized":"2023-11-28T19:31:46.081502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:17.751045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402000+0000","last_change":"2023-11-28T19:31:45.106729+0000","last_active":"2023-11-28T19:31:46.402000+0000","last_peered":"2023-11-28T19:31:46.402000+0000","last_clean":"2023-11-28T19:31:46.402000+0000","last_became_active":"2023-11-28T19:31:45.104514+0000","last_became_peered":"2023-11-28T19:31:45.104514+0000","last_unstale":"2023-11-28T19:31:46.402000+0000","last_undegraded":"2023-11-28T19:31:46.402000+0000","last_fullsized":"2023-11-28T19:31:46.402000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:25.412721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081110+0000","last_change":"2023-11-28T19:31:45.128458+0000","last_active":"2023-11-28T19:31:46.081110+0000","last_peered":"2023-11-28T19:31:46.081110+0000","last_clean":"2023-11-28T19:31:46.081110+0000","last_became_active":"2023-11-28T19:31:45.127309+0000","last_became_peered":"2023-11-28T19:31:45.127309+0000","last_unstale":"2023-11-28T19:31:46.081110+0000","last_undegraded":"2023-11-28T19:31:46.081110+0000","last_fullsized":"2023-11-28T19:31:46.081110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402857+0000","last_change":"2023-11-28T19:31:45.106194+0000","last_active":"2023-11-28T19:31:46.402857+0000","last_peered":"2023-11-28T19:31:46.402857+0000","last_clean":"2023-11-28T19:31:46.402857+0000","last_became_active":"2023-11-28T19:31:45.105417+0000","last_became_peered":"2023-11-28T19:31:45.105417+0000","last_unstale":"2023-11-28T19:31:46.402857+0000","last_undegraded":"2023-11-28T19:31:46.402857+0000","last_fullsized":"2023-11-28T19:31:46.402857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:17.751045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999358+0000","last_change":"2023-11-28T19:31:45.113263+0000","last_active":"2023-11-28T19:31:46.999358+0000","last_peered":"2023-11-28T19:31:46.999358+0000","last_clean":"2023-11-28T19:31:46.999358+0000","last_became_active":"2023-11-28T19:31:45.112503+0000","last_became_peered":"2023-11-28T19:31:45.112503+0000","last_unstale":"2023-11-28T19:31:46.999358+0000","last_undegraded":"2023-11-28T19:31:46.999358+0000","last_fullsized":"2023-11-28T19:31:46.999358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:59:45.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.110543+0000","last_change":"2023-11-28T19:31:45.102175+0000","last_active":"2023-11-28T19:31:45.110543+0000","last_peered":"2023-11-28T19:31:45.110543+0000","last_clean":"2023-11-28T19:31:45.110543+0000","last_became_active":"2023-11-28T19:31:45.101399+0000","last_became_peered":"2023-11-28T19:31:45.101399+0000","last_unstale":"2023-11-28T19:31:45.110543+0000","last_undegraded":"2023-11-28T19:31:45.110543+0000","last_fullsized":"2023-11-28T19:31:45.110543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:27.231075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402766+0000","last_change":"2023-11-28T19:31:45.105446+0000","last_active":"2023-11-28T19:31:46.402766+0000","last_peered":"2023-11-28T19:31:46.402766+0000","last_clean":"2023-11-28T19:31:46.402766+0000","last_became_active":"2023-11-28T19:31:45.103114+0000","last_became_peered":"2023-11-28T19:31:45.103114+0000","last_unstale":"2023-11-28T19:31:46.402766+0000","last_undegraded":"2023-11-28T19:31:46.402766+0000","last_fullsized":"2023-11-28T19:31:46.402766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:03.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.117497+0000","last_change":"2023-11-28T19:31:45.102194+0000","last_active":"2023-11-28T19:31:45.117497+0000","last_peered":"2023-11-28T19:31:45.117497+0000","last_clean":"2023-11-28T19:31:45.117497+0000","last_became_active":"2023-11-28T19:31:45.101351+0000","last_became_peered":"2023-11-28T19:31:45.101351+0000","last_unstale":"2023-11-28T19:31:45.117497+0000","last_undegraded":"2023-11-28T19:31:45.117497+0000","last_fullsized":"2023-11-28T19:31:45.117497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:27.231075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081971+0000","last_change":"2023-11-28T19:31:45.126943+0000","last_active":"2023-11-28T19:31:46.081971+0000","last_peered":"2023-11-28T19:31:46.081971+0000","last_clean":"2023-11-28T19:31:46.081971+0000","last_became_active":"2023-11-28T19:31:45.126265+0000","last_became_peered":"2023-11-28T19:31:45.126265+0000","last_unstale":"2023-11-28T19:31:46.081971+0000","last_undegraded":"2023-11-28T19:31:46.081971+0000","last_fullsized":"2023-11-28T19:31:46.081971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:29.133063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077767+0000","last_change":"2023-11-28T19:31:45.126324+0000","last_active":"2023-11-28T19:31:46.077767+0000","last_peered":"2023-11-28T19:31:46.077767+0000","last_clean":"2023-11-28T19:31:46.077767+0000","last_became_active":"2023-11-28T19:31:45.125509+0000","last_became_peered":"2023-11-28T19:31:45.125509+0000","last_unstale":"2023-11-28T19:31:46.077767+0000","last_undegraded":"2023-11-28T19:31:46.077767+0000","last_fullsized":"2023-11-28T19:31:46.077767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:39.981654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998359+0000","last_change":"2023-11-28T19:31:45.114020+0000","last_active":"2023-11-28T19:31:46.998359+0000","last_peered":"2023-11-28T19:31:46.998359+0000","last_clean":"2023-11-28T19:31:46.998359+0000","last_became_active":"2023-11-28T19:31:45.113322+0000","last_became_peered":"2023-11-28T19:31:45.113322+0000","last_unstale":"2023-11-28T19:31:46.998359+0000","last_undegraded":"2023-11-28T19:31:46.998359+0000","last_fullsized":"2023-11-28T19:31:46.998359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:25.412721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.117702+0000","last_change":"2023-11-28T19:31:45.099021+0000","last_active":"2023-11-28T19:31:45.117702+0000","last_peered":"2023-11-28T19:31:45.117702+0000","last_clean":"2023-11-28T19:31:45.117702+0000","last_became_active":"2023-11-28T19:31:45.098188+0000","last_became_peered":"2023-11-28T19:31:45.098188+0000","last_unstale":"2023-11-28T19:31:45.117702+0000","last_undegraded":"2023-11-28T19:31:45.117702+0000","last_fullsized":"2023-11-28T19:31:45.117702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:46.535706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402337+0000","last_change":"2023-11-28T19:31:44.264140+0000","last_active":"2023-11-28T19:31:46.402337+0000","last_peered":"2023-11-28T19:31:46.402337+0000","last_clean":"2023-11-28T19:31:46.402337+0000","last_became_active":"2023-11-28T19:31:44.263733+0000","last_became_peered":"2023-11-28T19:31:44.263733+0000","last_unstale":"2023-11-28T19:31:46.402337+0000","last_undegraded":"2023-11-28T19:31:46.402337+0000","last_fullsized":"2023-11-28T19:31:46.402337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:18.770787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.122850+0000","last_change":"2023-11-28T19:31:45.120512+0000","last_active":"2023-11-28T19:31:45.122850+0000","last_peered":"2023-11-28T19:31:45.122850+0000","last_clean":"2023-11-28T19:31:45.122850+0000","last_became_active":"2023-11-28T19:31:45.119585+0000","last_became_peered":"2023-11-28T19:31:45.119585+0000","last_unstale":"2023-11-28T19:31:45.122850+0000","last_undegraded":"2023-11-28T19:31:45.122850+0000","last_fullsized":"2023-11-28T19:31:45.122850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:39.981654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998328+0000","last_change":"2023-11-28T19:31:44.262529+0000","last_active":"2023-11-28T19:31:46.998328+0000","last_peered":"2023-11-28T19:31:46.998328+0000","last_clean":"2023-11-28T19:31:46.998328+0000","last_became_active":"2023-11-28T19:31:44.261833+0000","last_became_peered":"2023-11-28T19:31:44.261833+0000","last_unstale":"2023-11-28T19:31:46.998328+0000","last_undegraded":"2023-11-28T19:31:46.998328+0000","last_fullsized":"2023-11-28T19:31:46.998328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.401940+0000","last_change":"2023-11-28T19:31:44.247016+0000","last_active":"2023-11-28T19:31:46.401940+0000","last_peered":"2023-11-28T19:31:46.401940+0000","last_clean":"2023-11-28T19:31:46.401940+0000","last_became_active":"2023-11-28T19:31:44.246381+0000","last_became_peered":"2023-11-28T19:31:44.246381+0000","last_unstale":"2023-11-28T19:31:46.401940+0000","last_undegraded":"2023-11-28T19:31:46.401940+0000","last_fullsized":"2023-11-28T19:31:46.401940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:09.166959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402003+0000","last_change":"2023-11-28T19:31:45.118713+0000","last_active":"2023-11-28T19:31:46.402003+0000","last_peered":"2023-11-28T19:31:46.402003+0000","last_clean":"2023-11-28T19:31:46.402003+0000","last_became_active":"2023-11-28T19:31:45.114163+0000","last_became_peered":"2023-11-28T19:31:45.114163+0000","last_unstale":"2023-11-28T19:31:46.402003+0000","last_undegraded":"2023-11-28T19:31:46.402003+0000","last_fullsized":"2023-11-28T19:31:46.402003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:41.003464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081114+0000","last_change":"2023-11-28T19:31:44.262743+0000","last_active":"2023-11-28T19:31:46.081114+0000","last_peered":"2023-11-28T19:31:46.081114+0000","last_clean":"2023-11-28T19:31:46.081114+0000","last_became_active":"2023-11-28T19:31:44.261828+0000","last_became_peered":"2023-11-28T19:31:44.261828+0000","last_unstale":"2023-11-28T19:31:46.081114+0000","last_undegraded":"2023-11-28T19:31:46.081114+0000","last_fullsized":"2023-11-28T19:31:46.081114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:13.596047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.110658+0000","last_change":"2023-11-28T19:31:45.102566+0000","last_active":"2023-11-28T19:31:45.110658+0000","last_peered":"2023-11-28T19:31:45.110658+0000","last_clean":"2023-11-28T19:31:45.110658+0000","last_became_active":"2023-11-28T19:31:45.101723+0000","last_became_peered":"2023-11-28T19:31:45.101723+0000","last_unstale":"2023-11-28T19:31:45.110658+0000","last_undegraded":"2023-11-28T19:31:45.110658+0000","last_fullsized":"2023-11-28T19:31:45.110658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:19.783090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999059+0000","last_change":"2023-11-28T19:31:44.265457+0000","last_active":"2023-11-28T19:31:46.999059+0000","last_peered":"2023-11-28T19:31:46.999059+0000","last_clean":"2023-11-28T19:31:46.999059+0000","last_became_active":"2023-11-28T19:31:44.264577+0000","last_became_peered":"2023-11-28T19:31:44.264577+0000","last_unstale":"2023-11-28T19:31:46.999059+0000","last_undegraded":"2023-11-28T19:31:46.999059+0000","last_fullsized":"2023-11-28T19:31:46.999059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:22:57.628821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082306+0000","last_change":"2023-11-28T19:31:45.133755+0000","last_active":"2023-11-28T19:31:46.082306+0000","last_peered":"2023-11-28T19:31:46.082306+0000","last_clean":"2023-11-28T19:31:46.082306+0000","last_became_active":"2023-11-28T19:31:45.132947+0000","last_became_peered":"2023-11-28T19:31:45.132947+0000","last_unstale":"2023-11-28T19:31:46.082306+0000","last_undegraded":"2023-11-28T19:31:46.082306+0000","last_fullsized":"2023-11-28T19:31:46.082306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:28:56.420413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082283+0000","last_change":"2023-11-28T19:31:44.271305+0000","last_active":"2023-11-28T19:31:46.082283+0000","last_peered":"2023-11-28T19:31:46.082283+0000","last_clean":"2023-11-28T19:31:46.082283+0000","last_became_active":"2023-11-28T19:31:44.270176+0000","last_became_peered":"2023-11-28T19:31:44.270176+0000","last_unstale":"2023-11-28T19:31:46.082283+0000","last_undegraded":"2023-11-28T19:31:46.082283+0000","last_fullsized":"2023-11-28T19:31:46.082283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:26.218772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.130622+0000","last_change":"2023-11-28T19:31:45.127548+0000","last_active":"2023-11-28T19:31:45.130622+0000","last_peered":"2023-11-28T19:31:45.130622+0000","last_clean":"2023-11-28T19:31:45.130622+0000","last_became_active":"2023-11-28T19:31:45.126841+0000","last_became_peered":"2023-11-28T19:31:45.126841+0000","last_unstale":"2023-11-28T19:31:45.130622+0000","last_undegraded":"2023-11-28T19:31:45.130622+0000","last_fullsized":"2023-11-28T19:31:45.130622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:09.743296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.274494+0000","last_change":"2023-11-28T19:31:44.260935+0000","last_active":"2023-11-28T19:31:45.274494+0000","last_peered":"2023-11-28T19:31:45.274494+0000","last_clean":"2023-11-28T19:31:45.274494+0000","last_became_active":"2023-11-28T19:31:44.260504+0000","last_became_peered":"2023-11-28T19:31:44.260504+0000","last_unstale":"2023-11-28T19:31:45.274494+0000","last_undegraded":"2023-11-28T19:31:45.274494+0000","last_fullsized":"2023-11-28T19:31:45.274494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:54.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.132325+0000","last_change":"2023-11-28T19:31:45.109031+0000","last_active":"2023-11-28T19:31:45.132325+0000","last_peered":"2023-11-28T19:31:45.132325+0000","last_clean":"2023-11-28T19:31:45.132325+0000","last_became_active":"2023-11-28T19:31:45.104913+0000","last_became_peered":"2023-11-28T19:31:45.104913+0000","last_unstale":"2023-11-28T19:31:45.132325+0000","last_undegraded":"2023-11-28T19:31:45.132325+0000","last_fullsized":"2023-11-28T19:31:45.132325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:26:49.643044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998735+0000","last_change":"2023-11-28T19:31:44.250020+0000","last_active":"2023-11-28T19:31:46.998735+0000","last_peered":"2023-11-28T19:31:46.998735+0000","last_clean":"2023-11-28T19:31:46.998735+0000","last_became_active":"2023-11-28T19:31:44.247440+0000","last_became_peered":"2023-11-28T19:31:44.247440+0000","last_unstale":"2023-11-28T19:31:46.998735+0000","last_undegraded":"2023-11-28T19:31:46.998735+0000","last_fullsized":"2023-11-28T19:31:46.998735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:38.969351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.128460+0000","last_change":"2023-11-28T19:31:45.108120+0000","last_active":"2023-11-28T19:31:45.128460+0000","last_peered":"2023-11-28T19:31:45.128460+0000","last_clean":"2023-11-28T19:31:45.128460+0000","last_became_active":"2023-11-28T19:31:45.107361+0000","last_became_peered":"2023-11-28T19:31:45.107361+0000","last_unstale":"2023-11-28T19:31:45.128460+0000","last_undegraded":"2023-11-28T19:31:45.128460+0000","last_fullsized":"2023-11-28T19:31:45.128460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:41.003464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.272793+0000","last_change":"2023-11-28T19:31:44.232624+0000","last_active":"2023-11-28T19:31:45.272793+0000","last_peered":"2023-11-28T19:31:45.272793+0000","last_clean":"2023-11-28T19:31:45.272793+0000","last_became_active":"2023-11-28T19:31:44.231887+0000","last_became_peered":"2023-11-28T19:31:44.231887+0000","last_unstale":"2023-11-28T19:31:45.272793+0000","last_undegraded":"2023-11-28T19:31:45.272793+0000","last_fullsized":"2023-11-28T19:31:45.272793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.116559+0000","last_change":"2023-11-28T19:31:45.103017+0000","last_active":"2023-11-28T19:31:45.116559+0000","last_peered":"2023-11-28T19:31:45.116559+0000","last_clean":"2023-11-28T19:31:45.116559+0000","last_became_active":"2023-11-28T19:31:45.102246+0000","last_became_peered":"2023-11-28T19:31:45.102246+0000","last_unstale":"2023-11-28T19:31:45.116559+0000","last_undegraded":"2023-11-28T19:31:45.116559+0000","last_fullsized":"2023-11-28T19:31:45.116559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:54.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081739+0000","last_change":"2023-11-28T19:31:44.260611+0000","last_active":"2023-11-28T19:31:46.081739+0000","last_peered":"2023-11-28T19:31:46.081739+0000","last_clean":"2023-11-28T19:31:46.081739+0000","last_became_active":"2023-11-28T19:31:44.259673+0000","last_became_peered":"2023-11-28T19:31:44.259673+0000","last_unstale":"2023-11-28T19:31:46.081739+0000","last_undegraded":"2023-11-28T19:31:46.081739+0000","last_fullsized":"2023-11-28T19:31:46.081739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:24.400418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.135934+0000","last_change":"2023-11-28T19:31:45.119213+0000","last_active":"2023-11-28T19:31:45.135934+0000","last_peered":"2023-11-28T19:31:45.135934+0000","last_clean":"2023-11-28T19:31:45.135934+0000","last_became_active":"2023-11-28T19:31:45.118566+0000","last_became_peered":"2023-11-28T19:31:45.118566+0000","last_unstale":"2023-11-28T19:31:45.135934+0000","last_undegraded":"2023-11-28T19:31:45.135934+0000","last_fullsized":"2023-11-28T19:31:45.135934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:39.981654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998481+0000","last_change":"2023-11-28T19:31:44.264660+0000","last_active":"2023-11-28T19:31:46.998481+0000","last_peered":"2023-11-28T19:31:46.998481+0000","last_clean":"2023-11-28T19:31:46.998481+0000","last_became_active":"2023-11-28T19:31:44.263913+0000","last_became_peered":"2023-11-28T19:31:44.263913+0000","last_unstale":"2023-11-28T19:31:46.998481+0000","last_undegraded":"2023-11-28T19:31:46.998481+0000","last_fullsized":"2023-11-28T19:31:46.998481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:09.166959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998511+0000","last_change":"2023-11-28T19:31:45.114551+0000","last_active":"2023-11-28T19:31:46.998511+0000","last_peered":"2023-11-28T19:31:46.998511+0000","last_clean":"2023-11-28T19:31:46.998511+0000","last_became_active":"2023-11-28T19:31:45.112479+0000","last_became_peered":"2023-11-28T19:31:45.112479+0000","last_unstale":"2023-11-28T19:31:46.998511+0000","last_undegraded":"2023-11-28T19:31:46.998511+0000","last_fullsized":"2023-11-28T19:31:46.998511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:02.633458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077642+0000","last_change":"2023-11-28T19:31:44.252177+0000","last_active":"2023-11-28T19:31:46.077642+0000","last_peered":"2023-11-28T19:31:46.077642+0000","last_clean":"2023-11-28T19:31:46.077642+0000","last_became_active":"2023-11-28T19:31:44.251637+0000","last_became_peered":"2023-11-28T19:31:44.251637+0000","last_unstale":"2023-11-28T19:31:46.077642+0000","last_undegraded":"2023-11-28T19:31:46.077642+0000","last_fullsized":"2023-11-28T19:31:46.077642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:35.357511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.136020+0000","last_change":"2023-11-28T19:31:45.123799+0000","last_active":"2023-11-28T19:31:45.136020+0000","last_peered":"2023-11-28T19:31:45.136020+0000","last_clean":"2023-11-28T19:31:45.136020+0000","last_became_active":"2023-11-28T19:31:45.123023+0000","last_became_peered":"2023-11-28T19:31:45.123023+0000","last_unstale":"2023-11-28T19:31:45.136020+0000","last_undegraded":"2023-11-28T19:31:45.136020+0000","last_fullsized":"2023-11-28T19:31:45.136020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:44:01.822717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.269813+0000","last_change":"2023-11-28T19:31:44.247638+0000","last_active":"2023-11-28T19:31:45.269813+0000","last_peered":"2023-11-28T19:31:45.269813+0000","last_clean":"2023-11-28T19:31:45.269813+0000","last_became_active":"2023-11-28T19:31:44.244818+0000","last_became_peered":"2023-11-28T19:31:44.244818+0000","last_unstale":"2023-11-28T19:31:45.269813+0000","last_undegraded":"2023-11-28T19:31:45.269813+0000","last_fullsized":"2023-11-28T19:31:45.269813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:35.357511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.136043+0000","last_change":"2023-11-28T19:31:45.119195+0000","last_active":"2023-11-28T19:31:45.136043+0000","last_peered":"2023-11-28T19:31:45.136043+0000","last_clean":"2023-11-28T19:31:45.136043+0000","last_became_active":"2023-11-28T19:31:45.118457+0000","last_became_peered":"2023-11-28T19:31:45.118457+0000","last_unstale":"2023-11-28T19:31:45.136043+0000","last_undegraded":"2023-11-28T19:31:45.136043+0000","last_fullsized":"2023-11-28T19:31:45.136043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:27.231075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077969+0000","last_change":"2023-11-28T19:31:44.237773+0000","last_active":"2023-11-28T19:31:46.077969+0000","last_peered":"2023-11-28T19:31:46.077969+0000","last_clean":"2023-11-28T19:31:46.077969+0000","last_became_active":"2023-11-28T19:31:44.237376+0000","last_became_peered":"2023-11-28T19:31:44.237376+0000","last_unstale":"2023-11-28T19:31:46.077969+0000","last_undegraded":"2023-11-28T19:31:46.077969+0000","last_fullsized":"2023-11-28T19:31:46.077969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:18.770787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.139173+0000","last_change":"2023-11-28T19:31:45.133333+0000","last_active":"2023-11-28T19:31:45.139173+0000","last_peered":"2023-11-28T19:31:45.139173+0000","last_clean":"2023-11-28T19:31:45.139173+0000","last_became_active":"2023-11-28T19:31:45.132771+0000","last_became_peered":"2023-11-28T19:31:45.132771+0000","last_unstale":"2023-11-28T19:31:45.139173+0000","last_undegraded":"2023-11-28T19:31:45.139173+0000","last_fullsized":"2023-11-28T19:31:45.139173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:25.412721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.273018+0000","last_change":"2023-11-28T19:31:44.262514+0000","last_active":"2023-11-28T19:31:45.273018+0000","last_peered":"2023-11-28T19:31:45.273018+0000","last_clean":"2023-11-28T19:31:45.273018+0000","last_became_active":"2023-11-28T19:31:44.262050+0000","last_became_peered":"2023-11-28T19:31:44.262050+0000","last_unstale":"2023-11-28T19:31:45.273018+0000","last_undegraded":"2023-11-28T19:31:45.273018+0000","last_fullsized":"2023-11-28T19:31:45.273018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082192+0000","last_change":"2023-11-28T19:31:45.128723+0000","last_active":"2023-11-28T19:31:46.082192+0000","last_peered":"2023-11-28T19:31:46.082192+0000","last_clean":"2023-11-28T19:31:46.082192+0000","last_became_active":"2023-11-28T19:31:45.128010+0000","last_became_peered":"2023-11-28T19:31:45.128010+0000","last_unstale":"2023-11-28T19:31:46.082192+0000","last_undegraded":"2023-11-28T19:31:46.082192+0000","last_fullsized":"2023-11-28T19:31:46.082192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:21.761617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077647+0000","last_change":"2023-11-28T19:31:44.260788+0000","last_active":"2023-11-28T19:31:46.077647+0000","last_peered":"2023-11-28T19:31:46.077647+0000","last_clean":"2023-11-28T19:31:46.077647+0000","last_became_active":"2023-11-28T19:31:44.260313+0000","last_became_peered":"2023-11-28T19:31:44.260313+0000","last_unstale":"2023-11-28T19:31:46.077647+0000","last_undegraded":"2023-11-28T19:31:46.077647+0000","last_fullsized":"2023-11-28T19:31:46.077647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:22.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.139217+0000","last_change":"2023-11-28T19:31:45.131013+0000","last_active":"2023-11-28T19:31:45.139217+0000","last_peered":"2023-11-28T19:31:45.139217+0000","last_clean":"2023-11-28T19:31:45.139217+0000","last_became_active":"2023-11-28T19:31:45.130317+0000","last_became_peered":"2023-11-28T19:31:45.130317+0000","last_unstale":"2023-11-28T19:31:45.139217+0000","last_undegraded":"2023-11-28T19:31:45.139217+0000","last_fullsized":"2023-11-28T19:31:45.139217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:02.633458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T19:31:44.242574+0000","last_change":"2023-11-28T19:31:35.378105+0000","last_active":"2023-11-28T19:31:44.242574+0000","last_peered":"2023-11-28T19:31:44.242574+0000","last_clean":"2023-11-28T19:31:44.242574+0000","last_became_active":"2023-11-28T19:31:35.375035+0000","last_became_peered":"2023-11-28T19:31:35.375035+0000","last_unstale":"2023-11-28T19:31:44.242574+0000","last_undegraded":"2023-11-28T19:31:44.242574+0000","last_fullsized":"2023-11-28T19:31:44.242574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_clean_scrub_stamp":"2023-11-28T19:31:33.813158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:07.043315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081118+0000","last_change":"2023-11-28T19:31:44.261114+0000","last_active":"2023-11-28T19:31:46.081118+0000","last_peered":"2023-11-28T19:31:46.081118+0000","last_clean":"2023-11-28T19:31:46.081118+0000","last_became_active":"2023-11-28T19:31:44.260407+0000","last_became_peered":"2023-11-28T19:31:44.260407+0000","last_unstale":"2023-11-28T19:31:46.081118+0000","last_undegraded":"2023-11-28T19:31:46.081118+0000","last_fullsized":"2023-11-28T19:31:46.081118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:53.627798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402195+0000","last_change":"2023-11-28T19:31:45.128856+0000","last_active":"2023-11-28T19:31:46.402195+0000","last_peered":"2023-11-28T19:31:46.402195+0000","last_clean":"2023-11-28T19:31:46.402195+0000","last_became_active":"2023-11-28T19:31:45.128241+0000","last_became_peered":"2023-11-28T19:31:45.128241+0000","last_unstale":"2023-11-28T19:31:46.402195+0000","last_undegraded":"2023-11-28T19:31:46.402195+0000","last_fullsized":"2023-11-28T19:31:46.402195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.084393+0000","last_change":"2023-11-28T19:31:44.265109+0000","last_active":"2023-11-28T19:31:45.084393+0000","last_peered":"2023-11-28T19:31:45.084393+0000","last_clean":"2023-11-28T19:31:45.084393+0000","last_became_active":"2023-11-28T19:31:44.264507+0000","last_became_peered":"2023-11-28T19:31:44.264507+0000","last_unstale":"2023-11-28T19:31:45.084393+0000","last_undegraded":"2023-11-28T19:31:45.084393+0000","last_fullsized":"2023-11-28T19:31:45.084393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:54.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.125733+0000","last_change":"2023-11-28T19:31:45.123742+0000","last_active":"2023-11-28T19:31:45.125733+0000","last_peered":"2023-11-28T19:31:45.125733+0000","last_clean":"2023-11-28T19:31:45.125733+0000","last_became_active":"2023-11-28T19:31:45.123195+0000","last_became_peered":"2023-11-28T19:31:45.123195+0000","last_unstale":"2023-11-28T19:31:45.125733+0000","last_undegraded":"2023-11-28T19:31:45.125733+0000","last_fullsized":"2023-11-28T19:31:45.125733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:46.535706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077843+0000","last_change":"2023-11-28T19:31:44.237115+0000","last_active":"2023-11-28T19:31:46.077843+0000","last_peered":"2023-11-28T19:31:46.077843+0000","last_clean":"2023-11-28T19:31:46.077843+0000","last_became_active":"2023-11-28T19:31:44.236631+0000","last_became_peered":"2023-11-28T19:31:44.236631+0000","last_unstale":"2023-11-28T19:31:46.077843+0000","last_undegraded":"2023-11-28T19:31:46.077843+0000","last_fullsized":"2023-11-28T19:31:46.077843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:08.730993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.089969+0000","last_change":"2023-11-28T19:31:45.081631+0000","last_active":"2023-11-28T19:31:45.089969+0000","last_peered":"2023-11-28T19:31:45.089969+0000","last_clean":"2023-11-28T19:31:45.089969+0000","last_became_active":"2023-11-28T19:31:45.080848+0000","last_became_peered":"2023-11-28T19:31:45.080848+0000","last_unstale":"2023-11-28T19:31:45.089969+0000","last_undegraded":"2023-11-28T19:31:45.089969+0000","last_fullsized":"2023-11-28T19:31:45.089969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:36.369814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081959+0000","last_change":"2023-11-28T19:31:44.262145+0000","last_active":"2023-11-28T19:31:46.081959+0000","last_peered":"2023-11-28T19:31:46.081959+0000","last_clean":"2023-11-28T19:31:46.081959+0000","last_became_active":"2023-11-28T19:31:44.261242+0000","last_became_peered":"2023-11-28T19:31:44.261242+0000","last_unstale":"2023-11-28T19:31:46.081959+0000","last_undegraded":"2023-11-28T19:31:46.081959+0000","last_fullsized":"2023-11-28T19:31:46.081959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:01.621155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.132288+0000","last_change":"2023-11-28T19:31:45.112331+0000","last_active":"2023-11-28T19:31:45.132288+0000","last_peered":"2023-11-28T19:31:45.132288+0000","last_clean":"2023-11-28T19:31:45.132288+0000","last_became_active":"2023-11-28T19:31:45.111524+0000","last_became_peered":"2023-11-28T19:31:45.111524+0000","last_unstale":"2023-11-28T19:31:45.132288+0000","last_undegraded":"2023-11-28T19:31:45.132288+0000","last_fullsized":"2023-11-28T19:31:45.132288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:54.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.076358+0000","last_change":"2023-11-28T19:31:44.248811+0000","last_active":"2023-11-28T19:31:45.076358+0000","last_peered":"2023-11-28T19:31:45.076358+0000","last_clean":"2023-11-28T19:31:45.076358+0000","last_became_active":"2023-11-28T19:31:44.248328+0000","last_became_peered":"2023-11-28T19:31:44.248328+0000","last_unstale":"2023-11-28T19:31:45.076358+0000","last_undegraded":"2023-11-28T19:31:45.076358+0000","last_fullsized":"2023-11-28T19:31:45.076358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:44:00.810414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081853+0000","last_change":"2023-11-28T19:31:45.127384+0000","last_active":"2023-11-28T19:31:46.081853+0000","last_peered":"2023-11-28T19:31:46.081853+0000","last_clean":"2023-11-28T19:31:46.081853+0000","last_became_active":"2023-11-28T19:31:45.126812+0000","last_became_peered":"2023-11-28T19:31:45.126812+0000","last_unstale":"2023-11-28T19:31:46.081853+0000","last_undegraded":"2023-11-28T19:31:46.081853+0000","last_fullsized":"2023-11-28T19:31:46.081853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:19.825586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.096916+0000","last_change":"2023-11-28T19:31:44.266569+0000","last_active":"2023-11-28T19:31:45.096916+0000","last_peered":"2023-11-28T19:31:45.096916+0000","last_clean":"2023-11-28T19:31:45.096916+0000","last_became_active":"2023-11-28T19:31:44.265844+0000","last_became_peered":"2023-11-28T19:31:44.265844+0000","last_unstale":"2023-11-28T19:31:45.096916+0000","last_undegraded":"2023-11-28T19:31:45.096916+0000","last_fullsized":"2023-11-28T19:31:45.096916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:08.528057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.096894+0000","last_change":"2023-11-28T19:31:45.093284+0000","last_active":"2023-11-28T19:31:45.096894+0000","last_peered":"2023-11-28T19:31:45.096894+0000","last_clean":"2023-11-28T19:31:45.096894+0000","last_became_active":"2023-11-28T19:31:45.092507+0000","last_became_peered":"2023-11-28T19:31:45.092507+0000","last_unstale":"2023-11-28T19:31:45.096894+0000","last_undegraded":"2023-11-28T19:31:45.096894+0000","last_fullsized":"2023-11-28T19:31:45.096894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:22:58.641123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.074892+0000","last_change":"2023-11-28T19:31:44.259605+0000","last_active":"2023-11-28T19:31:45.074892+0000","last_peered":"2023-11-28T19:31:45.074892+0000","last_clean":"2023-11-28T19:31:45.074892+0000","last_became_active":"2023-11-28T19:31:44.259061+0000","last_became_peered":"2023-11-28T19:31:44.259061+0000","last_unstale":"2023-11-28T19:31:45.074892+0000","last_undegraded":"2023-11-28T19:31:45.074892+0000","last_fullsized":"2023-11-28T19:31:45.074892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:38.969351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402960+0000","last_change":"2023-11-28T19:31:45.115755+0000","last_active":"2023-11-28T19:31:46.402960+0000","last_peered":"2023-11-28T19:31:46.402960+0000","last_clean":"2023-11-28T19:31:46.402960+0000","last_became_active":"2023-11-28T19:31:45.114511+0000","last_became_peered":"2023-11-28T19:31:45.114511+0000","last_unstale":"2023-11-28T19:31:46.402960+0000","last_undegraded":"2023-11-28T19:31:46.402960+0000","last_fullsized":"2023-11-28T19:31:46.402960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:28:05.070597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999199+0000","last_change":"2023-11-28T19:31:44.270120+0000","last_active":"2023-11-28T19:31:46.999199+0000","last_peered":"2023-11-28T19:31:46.999199+0000","last_clean":"2023-11-28T19:31:46.999199+0000","last_became_active":"2023-11-28T19:31:44.269323+0000","last_became_peered":"2023-11-28T19:31:44.269323+0000","last_unstale":"2023-11-28T19:31:46.999199+0000","last_undegraded":"2023-11-28T19:31:46.999199+0000","last_fullsized":"2023-11-28T19:31:46.999199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:44:00.810414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.109684+0000","last_change":"2023-11-28T19:31:45.097994+0000","last_active":"2023-11-28T19:31:45.109684+0000","last_peered":"2023-11-28T19:31:45.109684+0000","last_clean":"2023-11-28T19:31:45.109684+0000","last_became_active":"2023-11-28T19:31:45.096610+0000","last_became_peered":"2023-11-28T19:31:45.096610+0000","last_unstale":"2023-11-28T19:31:45.109684+0000","last_undegraded":"2023-11-28T19:31:45.109684+0000","last_fullsized":"2023-11-28T19:31:45.109684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:35.665785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.083757+0000","last_change":"2023-11-28T19:31:44.263898+0000","last_active":"2023-11-28T19:31:45.083757+0000","last_peered":"2023-11-28T19:31:45.083757+0000","last_clean":"2023-11-28T19:31:45.083757+0000","last_became_active":"2023-11-28T19:31:44.263298+0000","last_became_peered":"2023-11-28T19:31:44.263298+0000","last_unstale":"2023-11-28T19:31:45.083757+0000","last_undegraded":"2023-11-28T19:31:45.083757+0000","last_fullsized":"2023-11-28T19:31:45.083757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:18.770787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.104912+0000","last_change":"2023-11-28T19:31:45.091928+0000","last_active":"2023-11-28T19:31:45.104912+0000","last_peered":"2023-11-28T19:31:45.104912+0000","last_clean":"2023-11-28T19:31:45.104912+0000","last_became_active":"2023-11-28T19:31:45.091151+0000","last_became_peered":"2023-11-28T19:31:45.091151+0000","last_unstale":"2023-11-28T19:31:45.104912+0000","last_undegraded":"2023-11-28T19:31:45.104912+0000","last_fullsized":"2023-11-28T19:31:45.104912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:00.894833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.075451+0000","last_change":"2023-11-28T19:31:44.264492+0000","last_active":"2023-11-28T19:31:45.075451+0000","last_peered":"2023-11-28T19:31:45.075451+0000","last_clean":"2023-11-28T19:31:45.075451+0000","last_became_active":"2023-11-28T19:31:44.263854+0000","last_became_peered":"2023-11-28T19:31:44.263854+0000","last_unstale":"2023-11-28T19:31:45.075451+0000","last_undegraded":"2023-11-28T19:31:45.075451+0000","last_fullsized":"2023-11-28T19:31:45.075451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:09.166959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402342+0000","last_change":"2023-11-28T19:31:45.102246+0000","last_active":"2023-11-28T19:31:46.402342+0000","last_peered":"2023-11-28T19:31:46.402342+0000","last_clean":"2023-11-28T19:31:46.402342+0000","last_became_active":"2023-11-28T19:31:45.099999+0000","last_became_peered":"2023-11-28T19:31:45.099999+0000","last_unstale":"2023-11-28T19:31:46.402342+0000","last_undegraded":"2023-11-28T19:31:46.402342+0000","last_fullsized":"2023-11-28T19:31:46.402342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:59:45.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.073860+0000","last_change":"2023-11-28T19:31:44.245502+0000","last_active":"2023-11-28T19:31:45.073860+0000","last_peered":"2023-11-28T19:31:45.073860+0000","last_clean":"2023-11-28T19:31:45.073860+0000","last_became_active":"2023-11-28T19:31:44.240313+0000","last_became_peered":"2023-11-28T19:31:44.240313+0000","last_unstale":"2023-11-28T19:31:45.073860+0000","last_undegraded":"2023-11-28T19:31:45.073860+0000","last_fullsized":"2023-11-28T19:31:45.073860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:22.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402134+0000","last_change":"2023-11-28T19:31:45.107221+0000","last_active":"2023-11-28T19:31:46.402134+0000","last_peered":"2023-11-28T19:31:46.402134+0000","last_clean":"2023-11-28T19:31:46.402134+0000","last_became_active":"2023-11-28T19:31:45.106355+0000","last_became_peered":"2023-11-28T19:31:45.106355+0000","last_unstale":"2023-11-28T19:31:46.402134+0000","last_undegraded":"2023-11-28T19:31:46.402134+0000","last_fullsized":"2023-11-28T19:31:46.402134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.272798+0000","last_change":"2023-11-28T19:31:44.268098+0000","last_active":"2023-11-28T19:31:45.272798+0000","last_peered":"2023-11-28T19:31:45.272798+0000","last_clean":"2023-11-28T19:31:45.272798+0000","last_became_active":"2023-11-28T19:31:44.266655+0000","last_became_peered":"2023-11-28T19:31:44.266655+0000","last_unstale":"2023-11-28T19:31:45.272798+0000","last_undegraded":"2023-11-28T19:31:45.272798+0000","last_fullsized":"2023-11-28T19:31:45.272798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998444+0000","last_change":"2023-11-28T19:31:45.119730+0000","last_active":"2023-11-28T19:31:46.998444+0000","last_peered":"2023-11-28T19:31:46.998444+0000","last_clean":"2023-11-28T19:31:46.998444+0000","last_became_active":"2023-11-28T19:31:45.118799+0000","last_became_peered":"2023-11-28T19:31:45.118799+0000","last_unstale":"2023-11-28T19:31:46.998444+0000","last_undegraded":"2023-11-28T19:31:46.998444+0000","last_fullsized":"2023-11-28T19:31:46.998444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:41.003464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081836+0000","last_change":"2023-11-28T19:31:45.134703+0000","last_active":"2023-11-28T19:31:46.081836+0000","last_peered":"2023-11-28T19:31:46.081836+0000","last_clean":"2023-11-28T19:31:46.081836+0000","last_became_active":"2023-11-28T19:31:45.134050+0000","last_became_peered":"2023-11-28T19:31:45.134050+0000","last_unstale":"2023-11-28T19:31:46.081836+0000","last_undegraded":"2023-11-28T19:31:46.081836+0000","last_fullsized":"2023-11-28T19:31:46.081836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:28:05.070597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.272877+0000","last_change":"2023-11-28T19:31:44.268054+0000","last_active":"2023-11-28T19:31:45.272877+0000","last_peered":"2023-11-28T19:31:45.272877+0000","last_clean":"2023-11-28T19:31:45.272877+0000","last_became_active":"2023-11-28T19:31:44.267025+0000","last_became_peered":"2023-11-28T19:31:44.267025+0000","last_unstale":"2023-11-28T19:31:45.272877+0000","last_undegraded":"2023-11-28T19:31:45.272877+0000","last_fullsized":"2023-11-28T19:31:45.272877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:22.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081848+0000","last_change":"2023-11-28T19:31:45.134583+0000","last_active":"2023-11-28T19:31:46.081848+0000","last_peered":"2023-11-28T19:31:46.081848+0000","last_clean":"2023-11-28T19:31:46.081848+0000","last_became_active":"2023-11-28T19:31:45.133796+0000","last_became_peered":"2023-11-28T19:31:45.133796+0000","last_unstale":"2023-11-28T19:31:46.081848+0000","last_undegraded":"2023-11-28T19:31:46.081848+0000","last_fullsized":"2023-11-28T19:31:46.081848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:33:50.981202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.275488+0000","last_change":"2023-11-28T19:31:44.271727+0000","last_active":"2023-11-28T19:31:45.275488+0000","last_peered":"2023-11-28T19:31:45.275488+0000","last_clean":"2023-11-28T19:31:45.275488+0000","last_became_active":"2023-11-28T19:31:44.271039+0000","last_became_peered":"2023-11-28T19:31:44.271039+0000","last_unstale":"2023-11-28T19:31:45.275488+0000","last_undegraded":"2023-11-28T19:31:45.275488+0000","last_fullsized":"2023-11-28T19:31:45.275488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:30.332612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.132210+0000","last_change":"2023-11-28T19:31:45.130263+0000","last_active":"2023-11-28T19:31:45.132210+0000","last_peered":"2023-11-28T19:31:45.132210+0000","last_clean":"2023-11-28T19:31:45.132210+0000","last_became_active":"2023-11-28T19:31:45.129426+0000","last_became_peered":"2023-11-28T19:31:45.129426+0000","last_unstale":"2023-11-28T19:31:45.132210+0000","last_undegraded":"2023-11-28T19:31:45.132210+0000","last_fullsized":"2023-11-28T19:31:45.132210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:23.494544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402936+0000","last_change":"2023-11-28T19:31:44.239191+0000","last_active":"2023-11-28T19:31:46.402936+0000","last_peered":"2023-11-28T19:31:46.402936+0000","last_clean":"2023-11-28T19:31:46.402936+0000","last_became_active":"2023-11-28T19:31:44.238364+0000","last_became_peered":"2023-11-28T19:31:44.238364+0000","last_unstale":"2023-11-28T19:31:46.402936+0000","last_undegraded":"2023-11-28T19:31:46.402936+0000","last_fullsized":"2023-11-28T19:31:46.402936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:38.969351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402940+0000","last_change":"2023-11-28T19:31:45.118725+0000","last_active":"2023-11-28T19:31:46.402940+0000","last_peered":"2023-11-28T19:31:46.402940+0000","last_clean":"2023-11-28T19:31:46.402940+0000","last_became_active":"2023-11-28T19:31:45.115412+0000","last_became_peered":"2023-11-28T19:31:45.115412+0000","last_unstale":"2023-11-28T19:31:46.402940+0000","last_undegraded":"2023-11-28T19:31:46.402940+0000","last_fullsized":"2023-11-28T19:31:46.402940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:29.133063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.275997+0000","last_change":"2023-11-28T19:31:44.255229+0000","last_active":"2023-11-28T19:31:45.275997+0000","last_peered":"2023-11-28T19:31:45.275997+0000","last_clean":"2023-11-28T19:31:45.275997+0000","last_became_active":"2023-11-28T19:31:44.254618+0000","last_became_peered":"2023-11-28T19:31:44.254618+0000","last_unstale":"2023-11-28T19:31:45.275997+0000","last_undegraded":"2023-11-28T19:31:45.275997+0000","last_fullsized":"2023-11-28T19:31:45.275997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:13.596047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":660231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,5,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3239999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":70893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":69407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":212992,"data_stored":69441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":660287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T19:31:49.311 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T19:31:49.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.455+0000 7f74eb3eb640 1 Processor -- start 2023-11-28T19:31:49.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.455+0000 7f74eb3eb640 1 -- start start 2023-11-28T19:31:49.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74eb3eb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f74e4142560 0x7f74e40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74eb3eb640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f74e40b5dd0 0x7f74e40b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74eb3eb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e4142940 con 0x7f74e40b6470 2023-11-28T19:31:49.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74eb3eb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e406f950 con 0x7f74e4142560 2023-11-28T19:31:49.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74eb3eb640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e414bb40 con 0x7f74e40b5dd0 2023-11-28T19:31:49.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74e9187640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f74e4142560 0x7f74e40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74e9988640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f74e40b6470 0x7f74e40b68e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49530/0 (socket says 172.21.15.28:49530) 2023-11-28T19:31:49.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74e9988640 1 -- 172.21.15.28:0/2637403297 learned_addr learned my addr 172.21.15.28:0/2637403297 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:49.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74e8986640 1 --2- 172.21.15.28:0/2637403297 >> v2:172.21.15.131:3300/0 conn(0x7f74e40b5dd0 0x7f74e40b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74e9187640 1 -- 172.21.15.28:0/2637403297 >> v2:172.21.15.131:3300/0 conn(0x7f74e40b5dd0 msgr2=0x7f74e40b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:49.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74e9187640 1 --2- 172.21.15.28:0/2637403297 >> v2:172.21.15.131:3300/0 conn(0x7f74e40b5dd0 0x7f74e40b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74e9187640 1 -- 172.21.15.28:0/2637403297 >> v1:172.21.15.28:6789/0 conn(0x7f74e40b6470 legacy=0x7f74e40b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74d7fff640 1 -- 172.21.15.28:0/2637403297 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 603063856 0 0) 0x7f74e4142940 con 0x7f74e40b6470 2023-11-28T19:31:49.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74e9187640 1 -- 172.21.15.28:0/2637403297 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e414be20 con 0x7f74e4142560 2023-11-28T19:31:49.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.459+0000 7f74e9187640 1 --2- 172.21.15.28:0/2637403297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74e4142560 0x7f74e40b40d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f74e406ce00 tx=0x7f74e001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a65131789fcbae1f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:49.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74d7fff640 1 -- 172.21.15.28:0/2637403297 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00a8950 con 0x7f74e4142560 2023-11-28T19:31:49.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74d7fff640 1 -- 172.21.15.28:0/2637403297 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e00a8ab0 con 0x7f74e4142560 2023-11-28T19:31:49.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74d7fff640 1 -- 172.21.15.28:0/2637403297 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e00a8e40 con 0x7f74e4142560 2023-11-28T19:31:49.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 -- 172.21.15.28:0/2637403297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74e4142560 msgr2=0x7f74e40b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.466 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 --2- 172.21.15.28:0/2637403297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74e4142560 0x7f74e40b40d0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f74e406ce00 tx=0x7f74e001ec50 comp rx=0 tx=0).stop 2023-11-28T19:31:49.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 -- 172.21.15.28:0/2637403297 shutdown_connections 2023-11-28T19:31:49.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 --2- 172.21.15.28:0/2637403297 >> v2:172.21.15.131:3300/0 conn(0x7f74e40b5dd0 0x7f74e40b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 --2- 172.21.15.28:0/2637403297 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74e4142560 0x7f74e40b40d0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 -- 172.21.15.28:0/2637403297 >> 172.21.15.28:0/2637403297 conn(0x7f74e40bcb40 msgr2=0x7f74e40bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:49.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 -- 172.21.15.28:0/2637403297 shutdown_connections 2023-11-28T19:31:49.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 -- 172.21.15.28:0/2637403297 wait complete. 2023-11-28T19:31:49.467 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 Processor -- start 2023-11-28T19:31:49.468 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 -- start start 2023-11-28T19:31:49.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74e40b5dd0 0x7f74e4144f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74e40b6470 0x7f74e4146d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.469 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74e4142560 0x7f74e413b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e4147290 con 0x7f74e40b6470 2023-11-28T19:31:49.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e413b9e0 con 0x7f74e4142560 2023-11-28T19:31:49.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e4147ff0 con 0x7f74e40b5dd0 2023-11-28T19:31:49.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74e8986640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74e40b6470 0x7f74e4146d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74e8986640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74e40b6470 0x7f74e4146d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50890/0 (socket says 172.21.15.28:50890) 2023-11-28T19:31:49.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74e8986640 1 -- 172.21.15.28:0/3074927480 learned_addr learned my addr 172.21.15.28:0/3074927480 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:49.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74e9988640 1 --2- 172.21.15.28:0/3074927480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74e4142560 0x7f74e413b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74e9187640 1 --2- 172.21.15.28:0/3074927480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74e40b5dd0 0x7f74e4144f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74e8986640 1 -- 172.21.15.28:0/3074927480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74e40b5dd0 msgr2=0x7f74e4144f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74e8986640 1 --2- 172.21.15.28:0/3074927480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74e40b5dd0 0x7f74e4144f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74e8986640 1 -- 172.21.15.28:0/3074927480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74e4142560 msgr2=0x7f74e413b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.470 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74e8986640 1 --2- 172.21.15.28:0/3074927480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74e4142560 0x7f74e413b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74e8986640 1 -- 172.21.15.28:0/3074927480 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e0009420 con 0x7f74e40b6470 2023-11-28T19:31:49.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74e8986640 1 --2- 172.21.15.28:0/3074927480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74e40b6470 0x7f74e4146d50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f74d800d800 tx=0x7f74d800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:49.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74d5ffb640 1 -- 172.21.15.28:0/3074927480 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d800b6c0 con 0x7f74e40b6470 2023-11-28T19:31:49.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74d5ffb640 1 -- 172.21.15.28:0/3074927480 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d800b820 con 0x7f74e40b6470 2023-11-28T19:31:49.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 -- 172.21.15.28:0/3074927480 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e4146570 con 0x7f74e40b6470 2023-11-28T19:31:49.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74d5ffb640 1 -- 172.21.15.28:0/3074927480 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d800bbd0 con 0x7f74e40b6470 2023-11-28T19:31:49.471 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.463+0000 7f74eb3eb640 1 -- 172.21.15.28:0/3074927480 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e4148ed0 con 0x7f74e40b6470 2023-11-28T19:31:49.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.467+0000 7f74eb3eb640 1 -- 172.21.15.28:0/3074927480 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e4146a70 con 0x7f74e40b6470 2023-11-28T19:31:49.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.467+0000 7f74d5ffb640 1 -- 172.21.15.28:0/3074927480 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f74d800bd30 con 0x7f74e40b6470 2023-11-28T19:31:49.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.467+0000 7f74d5ffb640 1 --2- 172.21.15.28:0/3074927480 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f74c80664a0 0x7f74c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.467+0000 7f74d5ffb640 1 -- 172.21.15.28:0/3074927480 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74d8084370 con 0x7f74e40b6470 2023-11-28T19:31:49.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.467+0000 7f74e9187640 1 --2- 172.21.15.28:0/3074927480 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f74c80664a0 0x7f74c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.467+0000 7f74e9187640 1 --2- 172.21.15.28:0/3074927480 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f74c80664a0 0x7f74c8068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74e00b2000 tx=0x7f74e00aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:49.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.471+0000 7f74d5ffb640 1 -- 172.21.15.28:0/3074927480 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f74e4146a70 con 0x7f74e40b6470 2023-11-28T19:31:49.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.623+0000 7f74eb3eb640 1 -- 172.21.15.28:0/3074927480 --> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74e40ba5c0 con 0x7f74c80664a0 2023-11-28T19:31:49.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.643+0000 7f74d5ffb640 1 -- 172.21.15.28:0/3074927480 <== mgr.4100 v2:172.21.15.131:6832/3367043860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264592 (secure 0 0 0) 0x7f74e40ba5c0 con 0x7f74c80664a0 2023-11-28T19:31:49.649 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:49.652 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-28T19:31:49.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.647+0000 7f74eb3eb640 1 -- 172.21.15.28:0/3074927480 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f74c80664a0 msgr2=0x7f74c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.647+0000 7f74eb3eb640 1 --2- 172.21.15.28:0/3074927480 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f74c80664a0 0x7f74c8068960 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74e00b2000 tx=0x7f74e00aa070 comp rx=0 tx=0).stop 2023-11-28T19:31:49.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.647+0000 7f74eb3eb640 1 -- 172.21.15.28:0/3074927480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74e40b6470 msgr2=0x7f74e4146d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.647+0000 7f74eb3eb640 1 --2- 172.21.15.28:0/3074927480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74e40b6470 0x7f74e4146d50 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f74d800d800 tx=0x7f74d800dcc0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.647+0000 7f74eb3eb640 1 -- 172.21.15.28:0/3074927480 shutdown_connections 2023-11-28T19:31:49.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.647+0000 7f74eb3eb640 1 --2- 172.21.15.28:0/3074927480 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f74c80664a0 0x7f74c8068960 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.647+0000 7f74eb3eb640 1 --2- 172.21.15.28:0/3074927480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f74e4142560 0x7f74e413b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.647+0000 7f74eb3eb640 1 --2- 172.21.15.28:0/3074927480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f74e40b6470 0x7f74e4146d50 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.647+0000 7f74eb3eb640 1 --2- 172.21.15.28:0/3074927480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f74e40b5dd0 0x7f74e4144f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.647+0000 7f74eb3eb640 1 -- 172.21.15.28:0/3074927480 >> 172.21.15.28:0/3074927480 conn(0x7f74e40bcb40 msgr2=0x7f74e40b68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:49.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.647+0000 7f74eb3eb640 1 -- 172.21.15.28:0/3074927480 shutdown_connections 2023-11-28T19:31:49.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.647+0000 7f74eb3eb640 1 -- 172.21.15.28:0/3074927480 wait complete. 2023-11-28T19:31:49.670 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-11-28T19:31:49.135785+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":161,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235672,"kb_used_data":2860,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739048,"statfs":{"total":773094113280,"available":772852785152,"internally_reserved":0,"allocated":2928640,"data_stored":1758704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,5,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":71,"apply_latency_ms":71,"commit_latency_ns":71000000,"apply_latency_ns":71000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.929539"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.136073+0000","last_change":"2023-11-28T19:31:45.117939+0000","last_active":"2023-11-28T19:31:45.136073+0000","last_peered":"2023-11-28T19:31:45.136073+0000","last_clean":"2023-11-28T19:31:45.136073+0000","last_became_active":"2023-11-28T19:31:45.116596+0000","last_became_peered":"2023-11-28T19:31:45.116596+0000","last_unstale":"2023-11-28T19:31:45.136073+0000","last_undegraded":"2023-11-28T19:31:45.136073+0000","last_fullsized":"2023-11-28T19:31:45.136073+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:10.179262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.113887+0000","last_change":"2023-11-28T19:31:45.108670+0000","last_active":"2023-11-28T19:31:45.113887+0000","last_peered":"2023-11-28T19:31:45.113887+0000","last_clean":"2023-11-28T19:31:45.113887+0000","last_became_active":"2023-11-28T19:31:45.107887+0000","last_became_peered":"2023-11-28T19:31:45.107887+0000","last_unstale":"2023-11-28T19:31:45.113887+0000","last_undegraded":"2023-11-28T19:31:45.113887+0000","last_fullsized":"2023-11-28T19:31:45.113887+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:14.608349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.120536+0000","last_change":"2023-11-28T19:31:45.114729+0000","last_active":"2023-11-28T19:31:45.120536+0000","last_peered":"2023-11-28T19:31:45.120536+0000","last_clean":"2023-11-28T19:31:45.120536+0000","last_became_active":"2023-11-28T19:31:45.113974+0000","last_became_peered":"2023-11-28T19:31:45.113974+0000","last_unstale":"2023-11-28T19:31:45.120536+0000","last_undegraded":"2023-11-28T19:31:45.120536+0000","last_fullsized":"2023-11-28T19:31:45.120536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:55.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081481+0000","last_change":"2023-11-28T19:31:45.127387+0000","last_active":"2023-11-28T19:31:46.081481+0000","last_peered":"2023-11-28T19:31:46.081481+0000","last_clean":"2023-11-28T19:31:46.081481+0000","last_became_active":"2023-11-28T19:31:45.126614+0000","last_became_peered":"2023-11-28T19:31:45.126614+0000","last_unstale":"2023-11-28T19:31:46.081481+0000","last_undegraded":"2023-11-28T19:31:46.081481+0000","last_fullsized":"2023-11-28T19:31:46.081481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:03.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.114659+0000","last_change":"2023-11-28T19:31:45.100132+0000","last_active":"2023-11-28T19:31:45.114659+0000","last_peered":"2023-11-28T19:31:45.114659+0000","last_clean":"2023-11-28T19:31:45.114659+0000","last_became_active":"2023-11-28T19:31:45.099229+0000","last_became_peered":"2023-11-28T19:31:45.099229+0000","last_unstale":"2023-11-28T19:31:45.114659+0000","last_undegraded":"2023-11-28T19:31:45.114659+0000","last_fullsized":"2023-11-28T19:31:45.114659+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:14.608349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081218+0000","last_change":"2023-11-28T19:31:45.125593+0000","last_active":"2023-11-28T19:31:46.081218+0000","last_peered":"2023-11-28T19:31:46.081218+0000","last_clean":"2023-11-28T19:31:46.081218+0000","last_became_active":"2023-11-28T19:31:45.124811+0000","last_became_peered":"2023-11-28T19:31:45.124811+0000","last_unstale":"2023-11-28T19:31:46.081218+0000","last_undegraded":"2023-11-28T19:31:46.081218+0000","last_fullsized":"2023-11-28T19:31:46.081218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:59:45.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.114791+0000","last_change":"2023-11-28T19:31:45.104970+0000","last_active":"2023-11-28T19:31:45.114791+0000","last_peered":"2023-11-28T19:31:45.114791+0000","last_clean":"2023-11-28T19:31:45.114791+0000","last_became_active":"2023-11-28T19:31:45.104131+0000","last_became_peered":"2023-11-28T19:31:45.104131+0000","last_unstale":"2023-11-28T19:31:45.114791+0000","last_undegraded":"2023-11-28T19:31:45.114791+0000","last_fullsized":"2023-11-28T19:31:45.114791+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:22:58.641123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402100+0000","last_change":"2023-11-28T19:31:45.130940+0000","last_active":"2023-11-28T19:31:46.402100+0000","last_peered":"2023-11-28T19:31:46.402100+0000","last_clean":"2023-11-28T19:31:46.402100+0000","last_became_active":"2023-11-28T19:31:45.130171+0000","last_became_peered":"2023-11-28T19:31:45.130171+0000","last_unstale":"2023-11-28T19:31:46.402100+0000","last_undegraded":"2023-11-28T19:31:46.402100+0000","last_fullsized":"2023-11-28T19:31:46.402100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:31.344915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.139131+0000","last_change":"2023-11-28T19:31:45.130835+0000","last_active":"2023-11-28T19:31:45.139131+0000","last_peered":"2023-11-28T19:31:45.139131+0000","last_clean":"2023-11-28T19:31:45.139131+0000","last_became_active":"2023-11-28T19:31:45.130194+0000","last_became_peered":"2023-11-28T19:31:45.130194+0000","last_unstale":"2023-11-28T19:31:45.139131+0000","last_undegraded":"2023-11-28T19:31:45.139131+0000","last_fullsized":"2023-11-28T19:31:45.139131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:54.812488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999097+0000","last_change":"2023-11-28T19:31:45.127252+0000","last_active":"2023-11-28T19:31:46.999097+0000","last_peered":"2023-11-28T19:31:46.999097+0000","last_clean":"2023-11-28T19:31:46.999097+0000","last_became_active":"2023-11-28T19:31:45.125570+0000","last_became_peered":"2023-11-28T19:31:45.125570+0000","last_unstale":"2023-11-28T19:31:46.999097+0000","last_undegraded":"2023-11-28T19:31:46.999097+0000","last_fullsized":"2023-11-28T19:31:46.999097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998852+0000","last_change":"2023-11-28T19:31:45.127138+0000","last_active":"2023-11-28T19:31:46.998852+0000","last_peered":"2023-11-28T19:31:46.998852+0000","last_clean":"2023-11-28T19:31:46.998852+0000","last_became_active":"2023-11-28T19:31:45.126392+0000","last_became_peered":"2023-11-28T19:31:45.126392+0000","last_unstale":"2023-11-28T19:31:46.998852+0000","last_undegraded":"2023-11-28T19:31:46.998852+0000","last_fullsized":"2023-11-28T19:31:46.998852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.132390+0000","last_change":"2023-11-28T19:31:45.116329+0000","last_active":"2023-11-28T19:31:45.132390+0000","last_peered":"2023-11-28T19:31:45.132390+0000","last_clean":"2023-11-28T19:31:45.132390+0000","last_became_active":"2023-11-28T19:31:45.115691+0000","last_became_peered":"2023-11-28T19:31:45.115691+0000","last_unstale":"2023-11-28T19:31:45.132390+0000","last_undegraded":"2023-11-28T19:31:45.132390+0000","last_fullsized":"2023-11-28T19:31:45.132390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:35.665785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402092+0000","last_change":"2023-11-28T19:31:45.118954+0000","last_active":"2023-11-28T19:31:46.402092+0000","last_peered":"2023-11-28T19:31:46.402092+0000","last_clean":"2023-11-28T19:31:46.402092+0000","last_became_active":"2023-11-28T19:31:45.116311+0000","last_became_peered":"2023-11-28T19:31:45.116311+0000","last_unstale":"2023-11-28T19:31:46.402092+0000","last_undegraded":"2023-11-28T19:31:46.402092+0000","last_fullsized":"2023-11-28T19:31:46.402092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:02.633458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.116602+0000","last_change":"2023-11-28T19:31:45.104928+0000","last_active":"2023-11-28T19:31:45.116602+0000","last_peered":"2023-11-28T19:31:45.116602+0000","last_clean":"2023-11-28T19:31:45.116602+0000","last_became_active":"2023-11-28T19:31:45.104131+0000","last_became_peered":"2023-11-28T19:31:45.104131+0000","last_unstale":"2023-11-28T19:31:45.116602+0000","last_undegraded":"2023-11-28T19:31:45.116602+0000","last_fullsized":"2023-11-28T19:31:45.116602+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:36.369814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.110972+0000","last_change":"2023-11-28T19:31:45.104838+0000","last_active":"2023-11-28T19:31:45.110972+0000","last_peered":"2023-11-28T19:31:45.110972+0000","last_clean":"2023-11-28T19:31:45.110972+0000","last_became_active":"2023-11-28T19:31:45.104087+0000","last_became_peered":"2023-11-28T19:31:45.104087+0000","last_unstale":"2023-11-28T19:31:45.110972+0000","last_undegraded":"2023-11-28T19:31:45.110972+0000","last_fullsized":"2023-11-28T19:31:45.110972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:09.743296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.080886+0000","last_change":"2023-11-28T19:31:45.124848+0000","last_active":"2023-11-28T19:31:46.080886+0000","last_peered":"2023-11-28T19:31:46.080886+0000","last_clean":"2023-11-28T19:31:46.080886+0000","last_became_active":"2023-11-28T19:31:45.124031+0000","last_became_peered":"2023-11-28T19:31:45.124031+0000","last_unstale":"2023-11-28T19:31:46.080886+0000","last_undegraded":"2023-11-28T19:31:46.080886+0000","last_fullsized":"2023-11-28T19:31:46.080886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082592+0000","last_change":"2023-11-28T19:31:45.134085+0000","last_active":"2023-11-28T19:31:46.082592+0000","last_peered":"2023-11-28T19:31:46.082592+0000","last_clean":"2023-11-28T19:31:46.082592+0000","last_became_active":"2023-11-28T19:31:45.132979+0000","last_became_peered":"2023-11-28T19:31:45.132979+0000","last_unstale":"2023-11-28T19:31:46.082592+0000","last_undegraded":"2023-11-28T19:31:46.082592+0000","last_fullsized":"2023-11-28T19:31:46.082592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:11.287539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077713+0000","last_change":"2023-11-28T19:31:45.117122+0000","last_active":"2023-11-28T19:31:46.077713+0000","last_peered":"2023-11-28T19:31:46.077713+0000","last_clean":"2023-11-28T19:31:46.077713+0000","last_became_active":"2023-11-28T19:31:45.116462+0000","last_became_peered":"2023-11-28T19:31:45.116462+0000","last_unstale":"2023-11-28T19:31:46.077713+0000","last_undegraded":"2023-11-28T19:31:46.077713+0000","last_fullsized":"2023-11-28T19:31:46.077713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:55.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.135734+0000","last_change":"2023-11-28T19:31:45.114295+0000","last_active":"2023-11-28T19:31:45.135734+0000","last_peered":"2023-11-28T19:31:45.135734+0000","last_clean":"2023-11-28T19:31:45.135734+0000","last_became_active":"2023-11-28T19:31:45.113478+0000","last_became_peered":"2023-11-28T19:31:45.113478+0000","last_unstale":"2023-11-28T19:31:45.135734+0000","last_undegraded":"2023-11-28T19:31:45.135734+0000","last_fullsized":"2023-11-28T19:31:45.135734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998559+0000","last_change":"2023-11-28T19:31:45.121559+0000","last_active":"2023-11-28T19:31:46.998559+0000","last_peered":"2023-11-28T19:31:46.998559+0000","last_clean":"2023-11-28T19:31:46.998559+0000","last_became_active":"2023-11-28T19:31:45.120810+0000","last_became_peered":"2023-11-28T19:31:45.120810+0000","last_unstale":"2023-11-28T19:31:46.998559+0000","last_undegraded":"2023-11-28T19:31:46.998559+0000","last_fullsized":"2023-11-28T19:31:46.998559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:31.344915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.121037+0000","last_change":"2023-11-28T19:31:45.110520+0000","last_active":"2023-11-28T19:31:45.121037+0000","last_peered":"2023-11-28T19:31:45.121037+0000","last_clean":"2023-11-28T19:31:45.121037+0000","last_became_active":"2023-11-28T19:31:45.109508+0000","last_became_peered":"2023-11-28T19:31:45.109508+0000","last_unstale":"2023-11-28T19:31:45.121037+0000","last_undegraded":"2023-11-28T19:31:45.121037+0000","last_fullsized":"2023-11-28T19:31:45.121037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:19.783090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081502+0000","last_change":"2023-11-28T19:31:45.135559+0000","last_active":"2023-11-28T19:31:46.081502+0000","last_peered":"2023-11-28T19:31:46.081502+0000","last_clean":"2023-11-28T19:31:46.081502+0000","last_became_active":"2023-11-28T19:31:45.134957+0000","last_became_peered":"2023-11-28T19:31:45.134957+0000","last_unstale":"2023-11-28T19:31:46.081502+0000","last_undegraded":"2023-11-28T19:31:46.081502+0000","last_fullsized":"2023-11-28T19:31:46.081502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:17.751045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402000+0000","last_change":"2023-11-28T19:31:45.106729+0000","last_active":"2023-11-28T19:31:46.402000+0000","last_peered":"2023-11-28T19:31:46.402000+0000","last_clean":"2023-11-28T19:31:46.402000+0000","last_became_active":"2023-11-28T19:31:45.104514+0000","last_became_peered":"2023-11-28T19:31:45.104514+0000","last_unstale":"2023-11-28T19:31:46.402000+0000","last_undegraded":"2023-11-28T19:31:46.402000+0000","last_fullsized":"2023-11-28T19:31:46.402000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:25.412721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081110+0000","last_change":"2023-11-28T19:31:45.128458+0000","last_active":"2023-11-28T19:31:46.081110+0000","last_peered":"2023-11-28T19:31:46.081110+0000","last_clean":"2023-11-28T19:31:46.081110+0000","last_became_active":"2023-11-28T19:31:45.127309+0000","last_became_peered":"2023-11-28T19:31:45.127309+0000","last_unstale":"2023-11-28T19:31:46.081110+0000","last_undegraded":"2023-11-28T19:31:46.081110+0000","last_fullsized":"2023-11-28T19:31:46.081110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402857+0000","last_change":"2023-11-28T19:31:45.106194+0000","last_active":"2023-11-28T19:31:46.402857+0000","last_peered":"2023-11-28T19:31:46.402857+0000","last_clean":"2023-11-28T19:31:46.402857+0000","last_became_active":"2023-11-28T19:31:45.105417+0000","last_became_peered":"2023-11-28T19:31:45.105417+0000","last_unstale":"2023-11-28T19:31:46.402857+0000","last_undegraded":"2023-11-28T19:31:46.402857+0000","last_fullsized":"2023-11-28T19:31:46.402857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:17.751045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999358+0000","last_change":"2023-11-28T19:31:45.113263+0000","last_active":"2023-11-28T19:31:46.999358+0000","last_peered":"2023-11-28T19:31:46.999358+0000","last_clean":"2023-11-28T19:31:46.999358+0000","last_became_active":"2023-11-28T19:31:45.112503+0000","last_became_peered":"2023-11-28T19:31:45.112503+0000","last_unstale":"2023-11-28T19:31:46.999358+0000","last_undegraded":"2023-11-28T19:31:46.999358+0000","last_fullsized":"2023-11-28T19:31:46.999358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:59:45.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.110543+0000","last_change":"2023-11-28T19:31:45.102175+0000","last_active":"2023-11-28T19:31:45.110543+0000","last_peered":"2023-11-28T19:31:45.110543+0000","last_clean":"2023-11-28T19:31:45.110543+0000","last_became_active":"2023-11-28T19:31:45.101399+0000","last_became_peered":"2023-11-28T19:31:45.101399+0000","last_unstale":"2023-11-28T19:31:45.110543+0000","last_undegraded":"2023-11-28T19:31:45.110543+0000","last_fullsized":"2023-11-28T19:31:45.110543+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:27.231075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402766+0000","last_change":"2023-11-28T19:31:45.105446+0000","last_active":"2023-11-28T19:31:46.402766+0000","last_peered":"2023-11-28T19:31:46.402766+0000","last_clean":"2023-11-28T19:31:46.402766+0000","last_became_active":"2023-11-28T19:31:45.103114+0000","last_became_peered":"2023-11-28T19:31:45.103114+0000","last_unstale":"2023-11-28T19:31:46.402766+0000","last_undegraded":"2023-11-28T19:31:46.402766+0000","last_fullsized":"2023-11-28T19:31:46.402766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:03.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.117497+0000","last_change":"2023-11-28T19:31:45.102194+0000","last_active":"2023-11-28T19:31:45.117497+0000","last_peered":"2023-11-28T19:31:45.117497+0000","last_clean":"2023-11-28T19:31:45.117497+0000","last_became_active":"2023-11-28T19:31:45.101351+0000","last_became_peered":"2023-11-28T19:31:45.101351+0000","last_unstale":"2023-11-28T19:31:45.117497+0000","last_undegraded":"2023-11-28T19:31:45.117497+0000","last_fullsized":"2023-11-28T19:31:45.117497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:27.231075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081971+0000","last_change":"2023-11-28T19:31:45.126943+0000","last_active":"2023-11-28T19:31:46.081971+0000","last_peered":"2023-11-28T19:31:46.081971+0000","last_clean":"2023-11-28T19:31:46.081971+0000","last_became_active":"2023-11-28T19:31:45.126265+0000","last_became_peered":"2023-11-28T19:31:45.126265+0000","last_unstale":"2023-11-28T19:31:46.081971+0000","last_undegraded":"2023-11-28T19:31:46.081971+0000","last_fullsized":"2023-11-28T19:31:46.081971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:29.133063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077767+0000","last_change":"2023-11-28T19:31:45.126324+0000","last_active":"2023-11-28T19:31:46.077767+0000","last_peered":"2023-11-28T19:31:46.077767+0000","last_clean":"2023-11-28T19:31:46.077767+0000","last_became_active":"2023-11-28T19:31:45.125509+0000","last_became_peered":"2023-11-28T19:31:45.125509+0000","last_unstale":"2023-11-28T19:31:46.077767+0000","last_undegraded":"2023-11-28T19:31:46.077767+0000","last_fullsized":"2023-11-28T19:31:46.077767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:39.981654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998359+0000","last_change":"2023-11-28T19:31:45.114020+0000","last_active":"2023-11-28T19:31:46.998359+0000","last_peered":"2023-11-28T19:31:46.998359+0000","last_clean":"2023-11-28T19:31:46.998359+0000","last_became_active":"2023-11-28T19:31:45.113322+0000","last_became_peered":"2023-11-28T19:31:45.113322+0000","last_unstale":"2023-11-28T19:31:46.998359+0000","last_undegraded":"2023-11-28T19:31:46.998359+0000","last_fullsized":"2023-11-28T19:31:46.998359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:25.412721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.117702+0000","last_change":"2023-11-28T19:31:45.099021+0000","last_active":"2023-11-28T19:31:45.117702+0000","last_peered":"2023-11-28T19:31:45.117702+0000","last_clean":"2023-11-28T19:31:45.117702+0000","last_became_active":"2023-11-28T19:31:45.098188+0000","last_became_peered":"2023-11-28T19:31:45.098188+0000","last_unstale":"2023-11-28T19:31:45.117702+0000","last_undegraded":"2023-11-28T19:31:45.117702+0000","last_fullsized":"2023-11-28T19:31:45.117702+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:46.535706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402337+0000","last_change":"2023-11-28T19:31:44.264140+0000","last_active":"2023-11-28T19:31:46.402337+0000","last_peered":"2023-11-28T19:31:46.402337+0000","last_clean":"2023-11-28T19:31:46.402337+0000","last_became_active":"2023-11-28T19:31:44.263733+0000","last_became_peered":"2023-11-28T19:31:44.263733+0000","last_unstale":"2023-11-28T19:31:46.402337+0000","last_undegraded":"2023-11-28T19:31:46.402337+0000","last_fullsized":"2023-11-28T19:31:46.402337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:18.770787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.122850+0000","last_change":"2023-11-28T19:31:45.120512+0000","last_active":"2023-11-28T19:31:45.122850+0000","last_peered":"2023-11-28T19:31:45.122850+0000","last_clean":"2023-11-28T19:31:45.122850+0000","last_became_active":"2023-11-28T19:31:45.119585+0000","last_became_peered":"2023-11-28T19:31:45.119585+0000","last_unstale":"2023-11-28T19:31:45.122850+0000","last_undegraded":"2023-11-28T19:31:45.122850+0000","last_fullsized":"2023-11-28T19:31:45.122850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:39.981654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998328+0000","last_change":"2023-11-28T19:31:44.262529+0000","last_active":"2023-11-28T19:31:46.998328+0000","last_peered":"2023-11-28T19:31:46.998328+0000","last_clean":"2023-11-28T19:31:46.998328+0000","last_became_active":"2023-11-28T19:31:44.261833+0000","last_became_peered":"2023-11-28T19:31:44.261833+0000","last_unstale":"2023-11-28T19:31:46.998328+0000","last_undegraded":"2023-11-28T19:31:46.998328+0000","last_fullsized":"2023-11-28T19:31:46.998328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.401940+0000","last_change":"2023-11-28T19:31:44.247016+0000","last_active":"2023-11-28T19:31:46.401940+0000","last_peered":"2023-11-28T19:31:46.401940+0000","last_clean":"2023-11-28T19:31:46.401940+0000","last_became_active":"2023-11-28T19:31:44.246381+0000","last_became_peered":"2023-11-28T19:31:44.246381+0000","last_unstale":"2023-11-28T19:31:46.401940+0000","last_undegraded":"2023-11-28T19:31:46.401940+0000","last_fullsized":"2023-11-28T19:31:46.401940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:09.166959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402003+0000","last_change":"2023-11-28T19:31:45.118713+0000","last_active":"2023-11-28T19:31:46.402003+0000","last_peered":"2023-11-28T19:31:46.402003+0000","last_clean":"2023-11-28T19:31:46.402003+0000","last_became_active":"2023-11-28T19:31:45.114163+0000","last_became_peered":"2023-11-28T19:31:45.114163+0000","last_unstale":"2023-11-28T19:31:46.402003+0000","last_undegraded":"2023-11-28T19:31:46.402003+0000","last_fullsized":"2023-11-28T19:31:46.402003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:41.003464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081114+0000","last_change":"2023-11-28T19:31:44.262743+0000","last_active":"2023-11-28T19:31:46.081114+0000","last_peered":"2023-11-28T19:31:46.081114+0000","last_clean":"2023-11-28T19:31:46.081114+0000","last_became_active":"2023-11-28T19:31:44.261828+0000","last_became_peered":"2023-11-28T19:31:44.261828+0000","last_unstale":"2023-11-28T19:31:46.081114+0000","last_undegraded":"2023-11-28T19:31:46.081114+0000","last_fullsized":"2023-11-28T19:31:46.081114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:13.596047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.110658+0000","last_change":"2023-11-28T19:31:45.102566+0000","last_active":"2023-11-28T19:31:45.110658+0000","last_peered":"2023-11-28T19:31:45.110658+0000","last_clean":"2023-11-28T19:31:45.110658+0000","last_became_active":"2023-11-28T19:31:45.101723+0000","last_became_peered":"2023-11-28T19:31:45.101723+0000","last_unstale":"2023-11-28T19:31:45.110658+0000","last_undegraded":"2023-11-28T19:31:45.110658+0000","last_fullsized":"2023-11-28T19:31:45.110658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:19.783090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999059+0000","last_change":"2023-11-28T19:31:44.265457+0000","last_active":"2023-11-28T19:31:46.999059+0000","last_peered":"2023-11-28T19:31:46.999059+0000","last_clean":"2023-11-28T19:31:46.999059+0000","last_became_active":"2023-11-28T19:31:44.264577+0000","last_became_peered":"2023-11-28T19:31:44.264577+0000","last_unstale":"2023-11-28T19:31:46.999059+0000","last_undegraded":"2023-11-28T19:31:46.999059+0000","last_fullsized":"2023-11-28T19:31:46.999059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:22:57.628821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082306+0000","last_change":"2023-11-28T19:31:45.133755+0000","last_active":"2023-11-28T19:31:46.082306+0000","last_peered":"2023-11-28T19:31:46.082306+0000","last_clean":"2023-11-28T19:31:46.082306+0000","last_became_active":"2023-11-28T19:31:45.132947+0000","last_became_peered":"2023-11-28T19:31:45.132947+0000","last_unstale":"2023-11-28T19:31:46.082306+0000","last_undegraded":"2023-11-28T19:31:46.082306+0000","last_fullsized":"2023-11-28T19:31:46.082306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:28:56.420413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082283+0000","last_change":"2023-11-28T19:31:44.271305+0000","last_active":"2023-11-28T19:31:46.082283+0000","last_peered":"2023-11-28T19:31:46.082283+0000","last_clean":"2023-11-28T19:31:46.082283+0000","last_became_active":"2023-11-28T19:31:44.270176+0000","last_became_peered":"2023-11-28T19:31:44.270176+0000","last_unstale":"2023-11-28T19:31:46.082283+0000","last_undegraded":"2023-11-28T19:31:46.082283+0000","last_fullsized":"2023-11-28T19:31:46.082283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:26.218772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.130622+0000","last_change":"2023-11-28T19:31:45.127548+0000","last_active":"2023-11-28T19:31:45.130622+0000","last_peered":"2023-11-28T19:31:45.130622+0000","last_clean":"2023-11-28T19:31:45.130622+0000","last_became_active":"2023-11-28T19:31:45.126841+0000","last_became_peered":"2023-11-28T19:31:45.126841+0000","last_unstale":"2023-11-28T19:31:45.130622+0000","last_undegraded":"2023-11-28T19:31:45.130622+0000","last_fullsized":"2023-11-28T19:31:45.130622+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:09.743296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.274494+0000","last_change":"2023-11-28T19:31:44.260935+0000","last_active":"2023-11-28T19:31:45.274494+0000","last_peered":"2023-11-28T19:31:45.274494+0000","last_clean":"2023-11-28T19:31:45.274494+0000","last_became_active":"2023-11-28T19:31:44.260504+0000","last_became_peered":"2023-11-28T19:31:44.260504+0000","last_unstale":"2023-11-28T19:31:45.274494+0000","last_undegraded":"2023-11-28T19:31:45.274494+0000","last_fullsized":"2023-11-28T19:31:45.274494+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:54.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.132325+0000","last_change":"2023-11-28T19:31:45.109031+0000","last_active":"2023-11-28T19:31:45.132325+0000","last_peered":"2023-11-28T19:31:45.132325+0000","last_clean":"2023-11-28T19:31:45.132325+0000","last_became_active":"2023-11-28T19:31:45.104913+0000","last_became_peered":"2023-11-28T19:31:45.104913+0000","last_unstale":"2023-11-28T19:31:45.132325+0000","last_undegraded":"2023-11-28T19:31:45.132325+0000","last_fullsized":"2023-11-28T19:31:45.132325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:26:49.643044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998735+0000","last_change":"2023-11-28T19:31:44.250020+0000","last_active":"2023-11-28T19:31:46.998735+0000","last_peered":"2023-11-28T19:31:46.998735+0000","last_clean":"2023-11-28T19:31:46.998735+0000","last_became_active":"2023-11-28T19:31:44.247440+0000","last_became_peered":"2023-11-28T19:31:44.247440+0000","last_unstale":"2023-11-28T19:31:46.998735+0000","last_undegraded":"2023-11-28T19:31:46.998735+0000","last_fullsized":"2023-11-28T19:31:46.998735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:38.969351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.128460+0000","last_change":"2023-11-28T19:31:45.108120+0000","last_active":"2023-11-28T19:31:45.128460+0000","last_peered":"2023-11-28T19:31:45.128460+0000","last_clean":"2023-11-28T19:31:45.128460+0000","last_became_active":"2023-11-28T19:31:45.107361+0000","last_became_peered":"2023-11-28T19:31:45.107361+0000","last_unstale":"2023-11-28T19:31:45.128460+0000","last_undegraded":"2023-11-28T19:31:45.128460+0000","last_fullsized":"2023-11-28T19:31:45.128460+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:41.003464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.272793+0000","last_change":"2023-11-28T19:31:44.232624+0000","last_active":"2023-11-28T19:31:45.272793+0000","last_peered":"2023-11-28T19:31:45.272793+0000","last_clean":"2023-11-28T19:31:45.272793+0000","last_became_active":"2023-11-28T19:31:44.231887+0000","last_became_peered":"2023-11-28T19:31:44.231887+0000","last_unstale":"2023-11-28T19:31:45.272793+0000","last_undegraded":"2023-11-28T19:31:45.272793+0000","last_fullsized":"2023-11-28T19:31:45.272793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.116559+0000","last_change":"2023-11-28T19:31:45.103017+0000","last_active":"2023-11-28T19:31:45.116559+0000","last_peered":"2023-11-28T19:31:45.116559+0000","last_clean":"2023-11-28T19:31:45.116559+0000","last_became_active":"2023-11-28T19:31:45.102246+0000","last_became_peered":"2023-11-28T19:31:45.102246+0000","last_unstale":"2023-11-28T19:31:45.116559+0000","last_undegraded":"2023-11-28T19:31:45.116559+0000","last_fullsized":"2023-11-28T19:31:45.116559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:54.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081739+0000","last_change":"2023-11-28T19:31:44.260611+0000","last_active":"2023-11-28T19:31:46.081739+0000","last_peered":"2023-11-28T19:31:46.081739+0000","last_clean":"2023-11-28T19:31:46.081739+0000","last_became_active":"2023-11-28T19:31:44.259673+0000","last_became_peered":"2023-11-28T19:31:44.259673+0000","last_unstale":"2023-11-28T19:31:46.081739+0000","last_undegraded":"2023-11-28T19:31:46.081739+0000","last_fullsized":"2023-11-28T19:31:46.081739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:24.400418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.135934+0000","last_change":"2023-11-28T19:31:45.119213+0000","last_active":"2023-11-28T19:31:45.135934+0000","last_peered":"2023-11-28T19:31:45.135934+0000","last_clean":"2023-11-28T19:31:45.135934+0000","last_became_active":"2023-11-28T19:31:45.118566+0000","last_became_peered":"2023-11-28T19:31:45.118566+0000","last_unstale":"2023-11-28T19:31:45.135934+0000","last_undegraded":"2023-11-28T19:31:45.135934+0000","last_fullsized":"2023-11-28T19:31:45.135934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:39.981654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998481+0000","last_change":"2023-11-28T19:31:44.264660+0000","last_active":"2023-11-28T19:31:46.998481+0000","last_peered":"2023-11-28T19:31:46.998481+0000","last_clean":"2023-11-28T19:31:46.998481+0000","last_became_active":"2023-11-28T19:31:44.263913+0000","last_became_peered":"2023-11-28T19:31:44.263913+0000","last_unstale":"2023-11-28T19:31:46.998481+0000","last_undegraded":"2023-11-28T19:31:46.998481+0000","last_fullsized":"2023-11-28T19:31:46.998481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:09.166959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998511+0000","last_change":"2023-11-28T19:31:45.114551+0000","last_active":"2023-11-28T19:31:46.998511+0000","last_peered":"2023-11-28T19:31:46.998511+0000","last_clean":"2023-11-28T19:31:46.998511+0000","last_became_active":"2023-11-28T19:31:45.112479+0000","last_became_peered":"2023-11-28T19:31:45.112479+0000","last_unstale":"2023-11-28T19:31:46.998511+0000","last_undegraded":"2023-11-28T19:31:46.998511+0000","last_fullsized":"2023-11-28T19:31:46.998511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:02.633458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077642+0000","last_change":"2023-11-28T19:31:44.252177+0000","last_active":"2023-11-28T19:31:46.077642+0000","last_peered":"2023-11-28T19:31:46.077642+0000","last_clean":"2023-11-28T19:31:46.077642+0000","last_became_active":"2023-11-28T19:31:44.251637+0000","last_became_peered":"2023-11-28T19:31:44.251637+0000","last_unstale":"2023-11-28T19:31:46.077642+0000","last_undegraded":"2023-11-28T19:31:46.077642+0000","last_fullsized":"2023-11-28T19:31:46.077642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:35.357511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.136020+0000","last_change":"2023-11-28T19:31:45.123799+0000","last_active":"2023-11-28T19:31:45.136020+0000","last_peered":"2023-11-28T19:31:45.136020+0000","last_clean":"2023-11-28T19:31:45.136020+0000","last_became_active":"2023-11-28T19:31:45.123023+0000","last_became_peered":"2023-11-28T19:31:45.123023+0000","last_unstale":"2023-11-28T19:31:45.136020+0000","last_undegraded":"2023-11-28T19:31:45.136020+0000","last_fullsized":"2023-11-28T19:31:45.136020+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:44:01.822717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.269813+0000","last_change":"2023-11-28T19:31:44.247638+0000","last_active":"2023-11-28T19:31:45.269813+0000","last_peered":"2023-11-28T19:31:45.269813+0000","last_clean":"2023-11-28T19:31:45.269813+0000","last_became_active":"2023-11-28T19:31:44.244818+0000","last_became_peered":"2023-11-28T19:31:44.244818+0000","last_unstale":"2023-11-28T19:31:45.269813+0000","last_undegraded":"2023-11-28T19:31:45.269813+0000","last_fullsized":"2023-11-28T19:31:45.269813+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:35.357511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.136043+0000","last_change":"2023-11-28T19:31:45.119195+0000","last_active":"2023-11-28T19:31:45.136043+0000","last_peered":"2023-11-28T19:31:45.136043+0000","last_clean":"2023-11-28T19:31:45.136043+0000","last_became_active":"2023-11-28T19:31:45.118457+0000","last_became_peered":"2023-11-28T19:31:45.118457+0000","last_unstale":"2023-11-28T19:31:45.136043+0000","last_undegraded":"2023-11-28T19:31:45.136043+0000","last_fullsized":"2023-11-28T19:31:45.136043+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:27.231075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077969+0000","last_change":"2023-11-28T19:31:44.237773+0000","last_active":"2023-11-28T19:31:46.077969+0000","last_peered":"2023-11-28T19:31:46.077969+0000","last_clean":"2023-11-28T19:31:46.077969+0000","last_became_active":"2023-11-28T19:31:44.237376+0000","last_became_peered":"2023-11-28T19:31:44.237376+0000","last_unstale":"2023-11-28T19:31:46.077969+0000","last_undegraded":"2023-11-28T19:31:46.077969+0000","last_fullsized":"2023-11-28T19:31:46.077969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:18.770787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.139173+0000","last_change":"2023-11-28T19:31:45.133333+0000","last_active":"2023-11-28T19:31:45.139173+0000","last_peered":"2023-11-28T19:31:45.139173+0000","last_clean":"2023-11-28T19:31:45.139173+0000","last_became_active":"2023-11-28T19:31:45.132771+0000","last_became_peered":"2023-11-28T19:31:45.132771+0000","last_unstale":"2023-11-28T19:31:45.139173+0000","last_undegraded":"2023-11-28T19:31:45.139173+0000","last_fullsized":"2023-11-28T19:31:45.139173+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:25.412721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.273018+0000","last_change":"2023-11-28T19:31:44.262514+0000","last_active":"2023-11-28T19:31:45.273018+0000","last_peered":"2023-11-28T19:31:45.273018+0000","last_clean":"2023-11-28T19:31:45.273018+0000","last_became_active":"2023-11-28T19:31:44.262050+0000","last_became_peered":"2023-11-28T19:31:44.262050+0000","last_unstale":"2023-11-28T19:31:45.273018+0000","last_undegraded":"2023-11-28T19:31:45.273018+0000","last_fullsized":"2023-11-28T19:31:45.273018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082192+0000","last_change":"2023-11-28T19:31:45.128723+0000","last_active":"2023-11-28T19:31:46.082192+0000","last_peered":"2023-11-28T19:31:46.082192+0000","last_clean":"2023-11-28T19:31:46.082192+0000","last_became_active":"2023-11-28T19:31:45.128010+0000","last_became_peered":"2023-11-28T19:31:45.128010+0000","last_unstale":"2023-11-28T19:31:46.082192+0000","last_undegraded":"2023-11-28T19:31:46.082192+0000","last_fullsized":"2023-11-28T19:31:46.082192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:21.761617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077647+0000","last_change":"2023-11-28T19:31:44.260788+0000","last_active":"2023-11-28T19:31:46.077647+0000","last_peered":"2023-11-28T19:31:46.077647+0000","last_clean":"2023-11-28T19:31:46.077647+0000","last_became_active":"2023-11-28T19:31:44.260313+0000","last_became_peered":"2023-11-28T19:31:44.260313+0000","last_unstale":"2023-11-28T19:31:46.077647+0000","last_undegraded":"2023-11-28T19:31:46.077647+0000","last_fullsized":"2023-11-28T19:31:46.077647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:22.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.139217+0000","last_change":"2023-11-28T19:31:45.131013+0000","last_active":"2023-11-28T19:31:45.139217+0000","last_peered":"2023-11-28T19:31:45.139217+0000","last_clean":"2023-11-28T19:31:45.139217+0000","last_became_active":"2023-11-28T19:31:45.130317+0000","last_became_peered":"2023-11-28T19:31:45.130317+0000","last_unstale":"2023-11-28T19:31:45.139217+0000","last_undegraded":"2023-11-28T19:31:45.139217+0000","last_fullsized":"2023-11-28T19:31:45.139217+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:02.633458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-11-28T19:31:44.242574+0000","last_change":"2023-11-28T19:31:35.378105+0000","last_active":"2023-11-28T19:31:44.242574+0000","last_peered":"2023-11-28T19:31:44.242574+0000","last_clean":"2023-11-28T19:31:44.242574+0000","last_became_active":"2023-11-28T19:31:35.375035+0000","last_became_peered":"2023-11-28T19:31:35.375035+0000","last_unstale":"2023-11-28T19:31:44.242574+0000","last_undegraded":"2023-11-28T19:31:44.242574+0000","last_fullsized":"2023-11-28T19:31:44.242574+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_clean_scrub_stamp":"2023-11-28T19:31:33.813158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:07.043315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081118+0000","last_change":"2023-11-28T19:31:44.261114+0000","last_active":"2023-11-28T19:31:46.081118+0000","last_peered":"2023-11-28T19:31:46.081118+0000","last_clean":"2023-11-28T19:31:46.081118+0000","last_became_active":"2023-11-28T19:31:44.260407+0000","last_became_peered":"2023-11-28T19:31:44.260407+0000","last_unstale":"2023-11-28T19:31:46.081118+0000","last_undegraded":"2023-11-28T19:31:46.081118+0000","last_fullsized":"2023-11-28T19:31:46.081118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:53.627798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402195+0000","last_change":"2023-11-28T19:31:45.128856+0000","last_active":"2023-11-28T19:31:46.402195+0000","last_peered":"2023-11-28T19:31:46.402195+0000","last_clean":"2023-11-28T19:31:46.402195+0000","last_became_active":"2023-11-28T19:31:45.128241+0000","last_became_peered":"2023-11-28T19:31:45.128241+0000","last_unstale":"2023-11-28T19:31:46.402195+0000","last_undegraded":"2023-11-28T19:31:46.402195+0000","last_fullsized":"2023-11-28T19:31:46.402195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.084393+0000","last_change":"2023-11-28T19:31:44.265109+0000","last_active":"2023-11-28T19:31:45.084393+0000","last_peered":"2023-11-28T19:31:45.084393+0000","last_clean":"2023-11-28T19:31:45.084393+0000","last_became_active":"2023-11-28T19:31:44.264507+0000","last_became_peered":"2023-11-28T19:31:44.264507+0000","last_unstale":"2023-11-28T19:31:45.084393+0000","last_undegraded":"2023-11-28T19:31:45.084393+0000","last_fullsized":"2023-11-28T19:31:45.084393+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:54.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.125733+0000","last_change":"2023-11-28T19:31:45.123742+0000","last_active":"2023-11-28T19:31:45.125733+0000","last_peered":"2023-11-28T19:31:45.125733+0000","last_clean":"2023-11-28T19:31:45.125733+0000","last_became_active":"2023-11-28T19:31:45.123195+0000","last_became_peered":"2023-11-28T19:31:45.123195+0000","last_unstale":"2023-11-28T19:31:45.125733+0000","last_undegraded":"2023-11-28T19:31:45.125733+0000","last_fullsized":"2023-11-28T19:31:45.125733+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:47:46.535706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077843+0000","last_change":"2023-11-28T19:31:44.237115+0000","last_active":"2023-11-28T19:31:46.077843+0000","last_peered":"2023-11-28T19:31:46.077843+0000","last_clean":"2023-11-28T19:31:46.077843+0000","last_became_active":"2023-11-28T19:31:44.236631+0000","last_became_peered":"2023-11-28T19:31:44.236631+0000","last_unstale":"2023-11-28T19:31:46.077843+0000","last_undegraded":"2023-11-28T19:31:46.077843+0000","last_fullsized":"2023-11-28T19:31:46.077843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:08.730993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.089969+0000","last_change":"2023-11-28T19:31:45.081631+0000","last_active":"2023-11-28T19:31:45.089969+0000","last_peered":"2023-11-28T19:31:45.089969+0000","last_clean":"2023-11-28T19:31:45.089969+0000","last_became_active":"2023-11-28T19:31:45.080848+0000","last_became_peered":"2023-11-28T19:31:45.080848+0000","last_unstale":"2023-11-28T19:31:45.089969+0000","last_undegraded":"2023-11-28T19:31:45.089969+0000","last_fullsized":"2023-11-28T19:31:45.089969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:36.369814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081959+0000","last_change":"2023-11-28T19:31:44.262145+0000","last_active":"2023-11-28T19:31:46.081959+0000","last_peered":"2023-11-28T19:31:46.081959+0000","last_clean":"2023-11-28T19:31:46.081959+0000","last_became_active":"2023-11-28T19:31:44.261242+0000","last_became_peered":"2023-11-28T19:31:44.261242+0000","last_unstale":"2023-11-28T19:31:46.081959+0000","last_undegraded":"2023-11-28T19:31:46.081959+0000","last_fullsized":"2023-11-28T19:31:46.081959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:01.621155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.132288+0000","last_change":"2023-11-28T19:31:45.112331+0000","last_active":"2023-11-28T19:31:45.132288+0000","last_peered":"2023-11-28T19:31:45.132288+0000","last_clean":"2023-11-28T19:31:45.132288+0000","last_became_active":"2023-11-28T19:31:45.111524+0000","last_became_peered":"2023-11-28T19:31:45.111524+0000","last_unstale":"2023-11-28T19:31:45.132288+0000","last_undegraded":"2023-11-28T19:31:45.132288+0000","last_fullsized":"2023-11-28T19:31:45.132288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:54.640100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.076358+0000","last_change":"2023-11-28T19:31:44.248811+0000","last_active":"2023-11-28T19:31:45.076358+0000","last_peered":"2023-11-28T19:31:45.076358+0000","last_clean":"2023-11-28T19:31:45.076358+0000","last_became_active":"2023-11-28T19:31:44.248328+0000","last_became_peered":"2023-11-28T19:31:44.248328+0000","last_unstale":"2023-11-28T19:31:45.076358+0000","last_undegraded":"2023-11-28T19:31:45.076358+0000","last_fullsized":"2023-11-28T19:31:45.076358+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:44:00.810414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081853+0000","last_change":"2023-11-28T19:31:45.127384+0000","last_active":"2023-11-28T19:31:46.081853+0000","last_peered":"2023-11-28T19:31:46.081853+0000","last_clean":"2023-11-28T19:31:46.081853+0000","last_became_active":"2023-11-28T19:31:45.126812+0000","last_became_peered":"2023-11-28T19:31:45.126812+0000","last_unstale":"2023-11-28T19:31:46.081853+0000","last_undegraded":"2023-11-28T19:31:46.081853+0000","last_fullsized":"2023-11-28T19:31:46.081853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:19.825586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.096916+0000","last_change":"2023-11-28T19:31:44.266569+0000","last_active":"2023-11-28T19:31:45.096916+0000","last_peered":"2023-11-28T19:31:45.096916+0000","last_clean":"2023-11-28T19:31:45.096916+0000","last_became_active":"2023-11-28T19:31:44.265844+0000","last_became_peered":"2023-11-28T19:31:44.265844+0000","last_unstale":"2023-11-28T19:31:45.096916+0000","last_undegraded":"2023-11-28T19:31:45.096916+0000","last_fullsized":"2023-11-28T19:31:45.096916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:08.528057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.096894+0000","last_change":"2023-11-28T19:31:45.093284+0000","last_active":"2023-11-28T19:31:45.096894+0000","last_peered":"2023-11-28T19:31:45.096894+0000","last_clean":"2023-11-28T19:31:45.096894+0000","last_became_active":"2023-11-28T19:31:45.092507+0000","last_became_peered":"2023-11-28T19:31:45.092507+0000","last_unstale":"2023-11-28T19:31:45.096894+0000","last_undegraded":"2023-11-28T19:31:45.096894+0000","last_fullsized":"2023-11-28T19:31:45.096894+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:22:58.641123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.074892+0000","last_change":"2023-11-28T19:31:44.259605+0000","last_active":"2023-11-28T19:31:45.074892+0000","last_peered":"2023-11-28T19:31:45.074892+0000","last_clean":"2023-11-28T19:31:45.074892+0000","last_became_active":"2023-11-28T19:31:44.259061+0000","last_became_peered":"2023-11-28T19:31:44.259061+0000","last_unstale":"2023-11-28T19:31:45.074892+0000","last_undegraded":"2023-11-28T19:31:45.074892+0000","last_fullsized":"2023-11-28T19:31:45.074892+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:38.969351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402960+0000","last_change":"2023-11-28T19:31:45.115755+0000","last_active":"2023-11-28T19:31:46.402960+0000","last_peered":"2023-11-28T19:31:46.402960+0000","last_clean":"2023-11-28T19:31:46.402960+0000","last_became_active":"2023-11-28T19:31:45.114511+0000","last_became_peered":"2023-11-28T19:31:45.114511+0000","last_unstale":"2023-11-28T19:31:46.402960+0000","last_undegraded":"2023-11-28T19:31:46.402960+0000","last_fullsized":"2023-11-28T19:31:46.402960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:28:05.070597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999199+0000","last_change":"2023-11-28T19:31:44.270120+0000","last_active":"2023-11-28T19:31:46.999199+0000","last_peered":"2023-11-28T19:31:46.999199+0000","last_clean":"2023-11-28T19:31:46.999199+0000","last_became_active":"2023-11-28T19:31:44.269323+0000","last_became_peered":"2023-11-28T19:31:44.269323+0000","last_unstale":"2023-11-28T19:31:46.999199+0000","last_undegraded":"2023-11-28T19:31:46.999199+0000","last_fullsized":"2023-11-28T19:31:46.999199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:44:00.810414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.109684+0000","last_change":"2023-11-28T19:31:45.097994+0000","last_active":"2023-11-28T19:31:45.109684+0000","last_peered":"2023-11-28T19:31:45.109684+0000","last_clean":"2023-11-28T19:31:45.109684+0000","last_became_active":"2023-11-28T19:31:45.096610+0000","last_became_peered":"2023-11-28T19:31:45.096610+0000","last_unstale":"2023-11-28T19:31:45.109684+0000","last_undegraded":"2023-11-28T19:31:45.109684+0000","last_fullsized":"2023-11-28T19:31:45.109684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:56:35.665785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.083757+0000","last_change":"2023-11-28T19:31:44.263898+0000","last_active":"2023-11-28T19:31:45.083757+0000","last_peered":"2023-11-28T19:31:45.083757+0000","last_clean":"2023-11-28T19:31:45.083757+0000","last_became_active":"2023-11-28T19:31:44.263298+0000","last_became_peered":"2023-11-28T19:31:44.263298+0000","last_unstale":"2023-11-28T19:31:45.083757+0000","last_undegraded":"2023-11-28T19:31:45.083757+0000","last_fullsized":"2023-11-28T19:31:45.083757+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:18.770787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.104912+0000","last_change":"2023-11-28T19:31:45.091928+0000","last_active":"2023-11-28T19:31:45.104912+0000","last_peered":"2023-11-28T19:31:45.104912+0000","last_clean":"2023-11-28T19:31:45.104912+0000","last_became_active":"2023-11-28T19:31:45.091151+0000","last_became_peered":"2023-11-28T19:31:45.091151+0000","last_unstale":"2023-11-28T19:31:45.104912+0000","last_undegraded":"2023-11-28T19:31:45.104912+0000","last_fullsized":"2023-11-28T19:31:45.104912+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:37:00.894833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.075451+0000","last_change":"2023-11-28T19:31:44.264492+0000","last_active":"2023-11-28T19:31:45.075451+0000","last_peered":"2023-11-28T19:31:45.075451+0000","last_clean":"2023-11-28T19:31:45.075451+0000","last_became_active":"2023-11-28T19:31:44.263854+0000","last_became_peered":"2023-11-28T19:31:44.263854+0000","last_unstale":"2023-11-28T19:31:45.075451+0000","last_undegraded":"2023-11-28T19:31:45.075451+0000","last_fullsized":"2023-11-28T19:31:45.075451+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:09.166959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402342+0000","last_change":"2023-11-28T19:31:45.102246+0000","last_active":"2023-11-28T19:31:46.402342+0000","last_peered":"2023-11-28T19:31:46.402342+0000","last_clean":"2023-11-28T19:31:46.402342+0000","last_became_active":"2023-11-28T19:31:45.099999+0000","last_became_peered":"2023-11-28T19:31:45.099999+0000","last_unstale":"2023-11-28T19:31:46.402342+0000","last_undegraded":"2023-11-28T19:31:46.402342+0000","last_fullsized":"2023-11-28T19:31:46.402342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:59:45.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.073860+0000","last_change":"2023-11-28T19:31:44.245502+0000","last_active":"2023-11-28T19:31:45.073860+0000","last_peered":"2023-11-28T19:31:45.073860+0000","last_clean":"2023-11-28T19:31:45.073860+0000","last_became_active":"2023-11-28T19:31:44.240313+0000","last_became_peered":"2023-11-28T19:31:44.240313+0000","last_unstale":"2023-11-28T19:31:45.073860+0000","last_undegraded":"2023-11-28T19:31:45.073860+0000","last_fullsized":"2023-11-28T19:31:45.073860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:22.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402134+0000","last_change":"2023-11-28T19:31:45.107221+0000","last_active":"2023-11-28T19:31:46.402134+0000","last_peered":"2023-11-28T19:31:46.402134+0000","last_clean":"2023-11-28T19:31:46.402134+0000","last_became_active":"2023-11-28T19:31:45.106355+0000","last_became_peered":"2023-11-28T19:31:45.106355+0000","last_unstale":"2023-11-28T19:31:46.402134+0000","last_undegraded":"2023-11-28T19:31:46.402134+0000","last_fullsized":"2023-11-28T19:31:46.402134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.272798+0000","last_change":"2023-11-28T19:31:44.268098+0000","last_active":"2023-11-28T19:31:45.272798+0000","last_peered":"2023-11-28T19:31:45.272798+0000","last_clean":"2023-11-28T19:31:45.272798+0000","last_became_active":"2023-11-28T19:31:44.266655+0000","last_became_peered":"2023-11-28T19:31:44.266655+0000","last_unstale":"2023-11-28T19:31:45.272798+0000","last_undegraded":"2023-11-28T19:31:45.272798+0000","last_fullsized":"2023-11-28T19:31:45.272798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998444+0000","last_change":"2023-11-28T19:31:45.119730+0000","last_active":"2023-11-28T19:31:46.998444+0000","last_peered":"2023-11-28T19:31:46.998444+0000","last_clean":"2023-11-28T19:31:46.998444+0000","last_became_active":"2023-11-28T19:31:45.118799+0000","last_became_peered":"2023-11-28T19:31:45.118799+0000","last_unstale":"2023-11-28T19:31:46.998444+0000","last_undegraded":"2023-11-28T19:31:46.998444+0000","last_fullsized":"2023-11-28T19:31:46.998444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:41.003464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081836+0000","last_change":"2023-11-28T19:31:45.134703+0000","last_active":"2023-11-28T19:31:46.081836+0000","last_peered":"2023-11-28T19:31:46.081836+0000","last_clean":"2023-11-28T19:31:46.081836+0000","last_became_active":"2023-11-28T19:31:45.134050+0000","last_became_peered":"2023-11-28T19:31:45.134050+0000","last_unstale":"2023-11-28T19:31:46.081836+0000","last_undegraded":"2023-11-28T19:31:46.081836+0000","last_fullsized":"2023-11-28T19:31:46.081836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:28:05.070597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.272877+0000","last_change":"2023-11-28T19:31:44.268054+0000","last_active":"2023-11-28T19:31:45.272877+0000","last_peered":"2023-11-28T19:31:45.272877+0000","last_clean":"2023-11-28T19:31:45.272877+0000","last_became_active":"2023-11-28T19:31:44.267025+0000","last_became_peered":"2023-11-28T19:31:44.267025+0000","last_unstale":"2023-11-28T19:31:45.272877+0000","last_undegraded":"2023-11-28T19:31:45.272877+0000","last_fullsized":"2023-11-28T19:31:45.272877+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:22.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081848+0000","last_change":"2023-11-28T19:31:45.134583+0000","last_active":"2023-11-28T19:31:46.081848+0000","last_peered":"2023-11-28T19:31:46.081848+0000","last_clean":"2023-11-28T19:31:46.081848+0000","last_became_active":"2023-11-28T19:31:45.133796+0000","last_became_peered":"2023-11-28T19:31:45.133796+0000","last_unstale":"2023-11-28T19:31:46.081848+0000","last_undegraded":"2023-11-28T19:31:46.081848+0000","last_fullsized":"2023-11-28T19:31:46.081848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:33:50.981202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.275488+0000","last_change":"2023-11-28T19:31:44.271727+0000","last_active":"2023-11-28T19:31:45.275488+0000","last_peered":"2023-11-28T19:31:45.275488+0000","last_clean":"2023-11-28T19:31:45.275488+0000","last_became_active":"2023-11-28T19:31:44.271039+0000","last_became_peered":"2023-11-28T19:31:44.271039+0000","last_unstale":"2023-11-28T19:31:45.275488+0000","last_undegraded":"2023-11-28T19:31:45.275488+0000","last_fullsized":"2023-11-28T19:31:45.275488+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:30.332612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.132210+0000","last_change":"2023-11-28T19:31:45.130263+0000","last_active":"2023-11-28T19:31:45.132210+0000","last_peered":"2023-11-28T19:31:45.132210+0000","last_clean":"2023-11-28T19:31:45.132210+0000","last_became_active":"2023-11-28T19:31:45.129426+0000","last_became_peered":"2023-11-28T19:31:45.129426+0000","last_unstale":"2023-11-28T19:31:45.132210+0000","last_undegraded":"2023-11-28T19:31:45.132210+0000","last_fullsized":"2023-11-28T19:31:45.132210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:23.494544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402936+0000","last_change":"2023-11-28T19:31:44.239191+0000","last_active":"2023-11-28T19:31:46.402936+0000","last_peered":"2023-11-28T19:31:46.402936+0000","last_clean":"2023-11-28T19:31:46.402936+0000","last_became_active":"2023-11-28T19:31:44.238364+0000","last_became_peered":"2023-11-28T19:31:44.238364+0000","last_unstale":"2023-11-28T19:31:46.402936+0000","last_undegraded":"2023-11-28T19:31:46.402936+0000","last_fullsized":"2023-11-28T19:31:46.402936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:38.969351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402940+0000","last_change":"2023-11-28T19:31:45.118725+0000","last_active":"2023-11-28T19:31:46.402940+0000","last_peered":"2023-11-28T19:31:46.402940+0000","last_clean":"2023-11-28T19:31:46.402940+0000","last_became_active":"2023-11-28T19:31:45.115412+0000","last_became_peered":"2023-11-28T19:31:45.115412+0000","last_unstale":"2023-11-28T19:31:46.402940+0000","last_undegraded":"2023-11-28T19:31:46.402940+0000","last_fullsized":"2023-11-28T19:31:46.402940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:29.133063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.275997+0000","last_change":"2023-11-28T19:31:44.255229+0000","last_active":"2023-11-28T19:31:45.275997+0000","last_peered":"2023-11-28T19:31:45.275997+0000","last_clean":"2023-11-28T19:31:45.275997+0000","last_became_active":"2023-11-28T19:31:44.254618+0000","last_became_peered":"2023-11-28T19:31:44.254618+0000","last_unstale":"2023-11-28T19:31:45.275997+0000","last_undegraded":"2023-11-28T19:31:45.275997+0000","last_fullsized":"2023-11-28T19:31:45.275997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:13.596047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":660231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,1,5,3],"upper_bound":32},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4490000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.532}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1379999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3239999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.494}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":70893,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3640000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1160000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":217088,"data_stored":69407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.139}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81100000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2170000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.014}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.25}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27100000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31384,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340456,"statfs":{"total":96636764160,"available":96604626944,"internally_reserved":0,"allocated":212992,"data_stored":69441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.875}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31976,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339864,"statfs":{"total":96636764160,"available":96604020736,"internally_reserved":0,"allocated":811008,"data_stored":660287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93200000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.024}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T19:31:49.674 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T19:31:49.674 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-11-28T19:31:49.675 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-11-28T19:31:49.675 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-11-28T19:31:49.677 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-11-28T19:31:49.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.827+0000 7fa8d12cd640 1 Processor -- start 2023-11-28T19:31:49.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8d12cd640 1 -- start start 2023-11-28T19:31:49.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8d12cd640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa8cc0b5ee0 0x7fa8cc0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8d12cd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa8cc0b8290 0x7fa8cc0b7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8d12cd640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8cc1418f0 0x7fa8cc148140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8d12cd640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc0b6d90 con 0x7fa8cc0b8290 2023-11-28T19:31:49.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8d12cd640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8cc0b9180 con 0x7fa8cc0b5ee0 2023-11-28T19:31:49.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8d12cd640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc0b62c0 con 0x7fa8cc1418f0 2023-11-28T19:31:49.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8ca7fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa8cc0b8290 0x7fa8cc0b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8ca7fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa8cc0b8290 0x7fa8cc0b7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50894/0 (socket says 172.21.15.28:50894) 2023-11-28T19:31:49.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8ca7fc640 1 -- 172.21.15.28:0/1483462481 learned_addr learned my addr 172.21.15.28:0/1483462481 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:49.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8cb7fe640 1 --2- 172.21.15.28:0/1483462481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8cc1418f0 0x7fa8cc148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8caffd640 1 --2- 172.21.15.28:0/1483462481 >> v2:172.21.15.131:3300/0 conn(0x7fa8cc0b5ee0 0x7fa8cc0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8ca7fc640 1 -- 172.21.15.28:0/1483462481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8cc1418f0 msgr2=0x7fa8cc148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:49.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8ca7fc640 1 --2- 172.21.15.28:0/1483462481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8cc1418f0 0x7fa8cc148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8ca7fc640 1 -- 172.21.15.28:0/1483462481 >> v2:172.21.15.131:3300/0 conn(0x7fa8cc0b5ee0 msgr2=0x7fa8cc0b8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:49.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8ca7fc640 1 --2- 172.21.15.28:0/1483462481 >> v2:172.21.15.131:3300/0 conn(0x7fa8cc0b5ee0 0x7fa8cc0b8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8ca7fc640 1 -- 172.21.15.28:0/1483462481 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8cc0b64e0 con 0x7fa8cc0b8290 2023-11-28T19:31:49.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.831+0000 7fa8ca7fc640 1 --2- 172.21.15.28:0/1483462481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8cc0b8290 0x7fa8cc0b7540 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc06c290 tx=0x7fa8bc01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf5d4706ac994a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:49.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8c9ffb640 1 -- 172.21.15.28:0/1483462481 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0af400 con 0x7fa8cc0b8290 2023-11-28T19:31:49.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8c9ffb640 1 -- 172.21.15.28:0/1483462481 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8bc0ab050 con 0x7fa8cc0b8290 2023-11-28T19:31:49.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8c9ffb640 1 -- 172.21.15.28:0/1483462481 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8bc0af780 con 0x7fa8cc0b8290 2023-11-28T19:31:49.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 -- 172.21.15.28:0/1483462481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8cc0b8290 msgr2=0x7fa8cc0b7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 --2- 172.21.15.28:0/1483462481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8cc0b8290 0x7fa8cc0b7540 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc06c290 tx=0x7fa8bc01f1c0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 -- 172.21.15.28:0/1483462481 shutdown_connections 2023-11-28T19:31:49.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 --2- 172.21.15.28:0/1483462481 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8cc1418f0 0x7fa8cc148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 --2- 172.21.15.28:0/1483462481 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8cc0b8290 0x7fa8cc0b7540 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 --2- 172.21.15.28:0/1483462481 >> v2:172.21.15.131:3300/0 conn(0x7fa8cc0b5ee0 0x7fa8cc0b8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 -- 172.21.15.28:0/1483462481 >> 172.21.15.28:0/1483462481 conn(0x7fa8cc0bcb40 msgr2=0x7fa8cc0bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:49.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 -- 172.21.15.28:0/1483462481 shutdown_connections 2023-11-28T19:31:49.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 -- 172.21.15.28:0/1483462481 wait complete. 2023-11-28T19:31:49.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 Processor -- start 2023-11-28T19:31:49.839 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 -- start start 2023-11-28T19:31:49.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8cc0b5ee0 0x7fa8cc071620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8cc0b8290 0x7fa8cc139d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8cc1418f0 0x7fa8cc13a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc071b60 con 0x7fa8cc0b5ee0 2023-11-28T19:31:49.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc1420c0 con 0x7fa8cc1418f0 2023-11-28T19:31:49.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8cc143c20 con 0x7fa8cc0b8290 2023-11-28T19:31:49.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8caffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8cc0b5ee0 0x7fa8cc071620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8caffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8cc0b5ee0 0x7fa8cc071620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50906/0 (socket says 172.21.15.28:50906) 2023-11-28T19:31:49.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8caffd640 1 -- 172.21.15.28:0/3550719030 learned_addr learned my addr 172.21.15.28:0/3550719030 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:49.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8caffd640 1 -- 172.21.15.28:0/3550719030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8cc0b8290 msgr2=0x7fa8cc139d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8caffd640 1 --2- 172.21.15.28:0/3550719030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8cc0b8290 0x7fa8cc139d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8caffd640 1 -- 172.21.15.28:0/3550719030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8cc1418f0 msgr2=0x7fa8cc13a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:49.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8caffd640 1 --2- 172.21.15.28:0/3550719030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8cc1418f0 0x7fa8cc13a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:49.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8caffd640 1 -- 172.21.15.28:0/3550719030 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8bc009b30 con 0x7fa8cc0b5ee0 2023-11-28T19:31:49.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8caffd640 1 --2- 172.21.15.28:0/3550719030 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8cc0b5ee0 0x7fa8cc071620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400d830 tx=0x7fa8b400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:49.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8c37fe640 1 -- 172.21.15.28:0/3550719030 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b400b6c0 con 0x7fa8cc0b5ee0 2023-11-28T19:31:49.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8c37fe640 1 -- 172.21.15.28:0/3550719030 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b400b820 con 0x7fa8cc0b5ee0 2023-11-28T19:31:49.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 -- 172.21.15.28:0/3550719030 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8cc142310 con 0x7fa8cc0b5ee0 2023-11-28T19:31:49.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8c37fe640 1 -- 172.21.15.28:0/3550719030 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b400bb90 con 0x7fa8cc0b5ee0 2023-11-28T19:31:49.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.835+0000 7fa8d12cd640 1 -- 172.21.15.28:0/3550719030 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8cc1428d0 con 0x7fa8cc0b5ee0 2023-11-28T19:31:49.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.839+0000 7fa8d12cd640 1 -- 172.21.15.28:0/3550719030 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8cc142a60 con 0x7fa8cc0b5ee0 2023-11-28T19:31:49.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.839+0000 7fa8c37fe640 1 -- 172.21.15.28:0/3550719030 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa8b401e460 con 0x7fa8cc0b5ee0 2023-11-28T19:31:49.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.839+0000 7fa8c37fe640 1 --2- 172.21.15.28:0/3550719030 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa8ac066470 0x7fa8ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:49.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.839+0000 7fa8c37fe640 1 -- 172.21.15.28:0/3550719030 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8b4084700 con 0x7fa8cc0b5ee0 2023-11-28T19:31:49.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.839+0000 7fa8ca7fc640 1 --2- 172.21.15.28:0/3550719030 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa8ac066470 0x7fa8ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:49.844 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.839+0000 7fa8ca7fc640 1 --2- 172.21.15.28:0/3550719030 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa8ac066470 0x7fa8ac068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0b1000 tx=0x7fa8bc004ac0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:49.847 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:49.843+0000 7fa8c37fe640 1 -- 172.21.15.28:0/3550719030 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa8b4051ae0 con 0x7fa8cc0b5ee0 2023-11-28T19:31:50.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.035+0000 7fa8d12cd640 1 -- 172.21.15.28:0/3550719030 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fa8cc074a90 con 0x7fa8cc0b5ee0 2023-11-28T19:31:50.054 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.051+0000 7fa8c37fe640 1 -- 172.21.15.28:0/3550719030 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164439 (secure 0 0 0) 0x7fa8b4055100 con 0x7fa8cc0b5ee0 2023-11-28T19:31:50.056 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:50.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.051+0000 7fa8d12cd640 1 -- 172.21.15.28:0/3550719030 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa8ac066470 msgr2=0x7fa8ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.051+0000 7fa8d12cd640 1 --2- 172.21.15.28:0/3550719030 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa8ac066470 0x7fa8ac068930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa8bc0b1000 tx=0x7fa8bc004ac0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.051+0000 7fa8d12cd640 1 -- 172.21.15.28:0/3550719030 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8cc0b5ee0 msgr2=0x7fa8cc071620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.051+0000 7fa8d12cd640 1 --2- 172.21.15.28:0/3550719030 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8cc0b5ee0 0x7fa8cc071620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa8b400d830 tx=0x7fa8b400dcf0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.055+0000 7fa8d12cd640 1 -- 172.21.15.28:0/3550719030 shutdown_connections 2023-11-28T19:31:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.055+0000 7fa8d12cd640 1 --2- 172.21.15.28:0/3550719030 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa8ac066470 0x7fa8ac068930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.055+0000 7fa8d12cd640 1 --2- 172.21.15.28:0/3550719030 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8cc1418f0 0x7fa8cc13a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.055+0000 7fa8d12cd640 1 --2- 172.21.15.28:0/3550719030 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa8cc0b8290 0x7fa8cc139d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.055+0000 7fa8d12cd640 1 --2- 172.21.15.28:0/3550719030 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa8cc0b5ee0 0x7fa8cc071620 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.055+0000 7fa8d12cd640 1 -- 172.21.15.28:0/3550719030 >> 172.21.15.28:0/3550719030 conn(0x7fa8cc0bcb40 msgr2=0x7fa8cc1461f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.055+0000 7fa8d12cd640 1 -- 172.21.15.28:0/3550719030 shutdown_connections 2023-11-28T19:31:50.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.055+0000 7fa8d12cd640 1 -- 172.21.15.28:0/3550719030 wait complete. 2023-11-28T19:31:50.076 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":5,"active_gid":4100,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":3367043860},{"type":"v1","addr":"172.21.15.131:6833","nonce":3367043860}]},"active_addr":"172.21.15.131:6833/3367043860","active_change":"2023-11-28T19:31:25.116854+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":4250150748}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":3238494484}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":1377185199}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":3287154469}]}]} 2023-11-28T19:31:50.079 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-11-28T19:31:50.079 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-11-28T19:31:50.079 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:50.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.203+0000 7fddb07d6640 1 Processor -- start 2023-11-28T19:31:50.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.203+0000 7fddb07d6640 1 -- start start 2023-11-28T19:31:50.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddb07d6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdda80bb150 0x7fdda806d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddb07d6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda806bbd0 con 0x7fdda80b8ec0 2023-11-28T19:31:50.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddb07d6640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdda806b610 con 0x7fdda806e270 2023-11-28T19:31:50.212 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddb07d6640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdda806b400 con 0x7fdda80bb150 2023-11-28T19:31:50.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddadd71640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdda80b8ec0 0x7fdda8145360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49540/0 (socket says 172.21.15.28:49540) 2023-11-28T19:31:50.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddadd71640 1 -- 172.21.15.28:0/4014782602 learned_addr learned my addr 172.21.15.28:0/4014782602 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:50.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddae572640 1 --2- 172.21.15.28:0/4014782602 >> v2:172.21.15.131:3300/0 conn(0x7fdda80bb150 0x7fdda806d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 -- 172.21.15.28:0/4014782602 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497549706 0 0) 0x7fdda806bbd0 con 0x7fdda80b8ec0 2023-11-28T19:31:50.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 -- 172.21.15.28:0/4014782602 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd94003530 con 0x7fdda80b8ec0 2023-11-28T19:31:50.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 -- 172.21.15.28:0/4014782602 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4190408396 0 0) 0x7fdd94003530 con 0x7fdda80b8ec0 2023-11-28T19:31:50.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 -- 172.21.15.28:0/4014782602 >> v2:172.21.15.131:3300/0 conn(0x7fdda80bb150 msgr2=0x7fdda806d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:50.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 --2- 172.21.15.28:0/4014782602 >> v2:172.21.15.131:3300/0 conn(0x7fdda80bb150 0x7fdda806d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 -- 172.21.15.28:0/4014782602 >> v1:172.21.15.131:6789/0 conn(0x7fdda806e270 legacy=0x7fdda8155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 -- 172.21.15.28:0/4014782602 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda806b8f0 con 0x7fdda80b8ec0 2023-11-28T19:31:50.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 -- 172.21.15.28:0/4014782602 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7fdd9c001680 con 0x7fdda80b8ec0 2023-11-28T19:31:50.213 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 -- 172.21.15.28:0/4014782602 >> v1:172.21.15.28:6789/0 conn(0x7fdda80b8ec0 legacy=0x7fdda8145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 --2- 172.21.15.28:0/4014782602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd94003980 0x7fdd94003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 --2- 172.21.15.28:0/4014782602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd94004380 0x7fdd94004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 --2- 172.21.15.28:0/4014782602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd94005050 0x7fdd9400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 -- 172.21.15.28:0/4014782602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda806b400 con 0x7fdd94004380 2023-11-28T19:31:50.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 -- 172.21.15.28:0/4014782602 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9400bfb0 con 0x7fdd94005050 2023-11-28T19:31:50.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddad570640 1 -- 172.21.15.28:0/4014782602 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9400c170 con 0x7fdd94003980 2023-11-28T19:31:50.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddadd71640 1 --2- 172.21.15.28:0/4014782602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd94004380 0x7fdd94004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddaed73640 1 --2- 172.21.15.28:0/4014782602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd94005050 0x7fdd9400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddae572640 1 --2- 172.21.15.28:0/4014782602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd94003980 0x7fdd94003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddadd71640 1 -- 172.21.15.28:0/4014782602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd94003980 msgr2=0x7fdd94003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:50.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddadd71640 1 --2- 172.21.15.28:0/4014782602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd94003980 0x7fdd94003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddadd71640 1 -- 172.21.15.28:0/4014782602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd94005050 msgr2=0x7fdd9400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:50.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddadd71640 1 --2- 172.21.15.28:0/4014782602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd94005050 0x7fdd9400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddadd71640 1 -- 172.21.15.28:0/4014782602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd94003530 con 0x7fdd94004380 2023-11-28T19:31:50.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.207+0000 7fddaed73640 1 -- 172.21.15.28:0/4014782602 reap_dead start 2023-11-28T19:31:50.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddadd71640 1 --2- 172.21.15.28:0/4014782602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd94004380 0x7fdd94004850 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdda80695a0 tx=0x7fdd9c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5befbcd9c0f189eb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddad570640 1 -- 172.21.15.28:0/4014782602 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c005ae0 con 0x7fdd94004380 2023-11-28T19:31:50.216 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddad570640 1 -- 172.21.15.28:0/4014782602 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd9c005c60 con 0x7fdd94004380 2023-11-28T19:31:50.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddad570640 1 -- 172.21.15.28:0/4014782602 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c0a5b00 con 0x7fdd94004380 2023-11-28T19:31:50.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 -- 172.21.15.28:0/4014782602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd94004380 msgr2=0x7fdd94004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 --2- 172.21.15.28:0/4014782602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd94004380 0x7fdd94004850 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdda80695a0 tx=0x7fdd9c01cc00 comp rx=0 tx=0).stop 2023-11-28T19:31:50.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 -- 172.21.15.28:0/4014782602 shutdown_connections 2023-11-28T19:31:50.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 --2- 172.21.15.28:0/4014782602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd94004380 0x7fdd94004850 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 -- 172.21.15.28:0/4014782602 >> 172.21.15.28:0/4014782602 conn(0x7fdda80bed00 msgr2=0x7fdda80bf110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 -- 172.21.15.28:0/4014782602 shutdown_connections 2023-11-28T19:31:50.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 -- 172.21.15.28:0/4014782602 wait complete. 2023-11-28T19:31:50.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 Processor -- start 2023-11-28T19:31:50.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 -- start start 2023-11-28T19:31:50.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd94004380 0x7fdda814e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda814e930 0x7fdda814d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdda814db40 0x7fdda81e75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda814f480 con 0x7fdd94004380 2023-11-28T19:31:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda814f0d0 con 0x7fdda814e930 2023-11-28T19:31:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddb07d6640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda81d8c00 con 0x7fdda814db40 2023-11-28T19:31:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddae572640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd94004380 0x7fdda814e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddae572640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd94004380 0x7fdda814e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50924/0 (socket says 172.21.15.28:50924) 2023-11-28T19:31:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.211+0000 7fddae572640 1 -- 172.21.15.28:0/559221680 learned_addr learned my addr 172.21.15.28:0/559221680 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fddaed73640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdda814db40 0x7fdda81e75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fddadd71640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda814e930 0x7fdda814d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fddae572640 1 -- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdda814db40 msgr2=0x7fdda81e75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fddae572640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdda814db40 0x7fdda81e75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fddae572640 1 -- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda814e930 msgr2=0x7fdda814d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fddae572640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda814e930 0x7fdda814d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fddae572640 1 -- 172.21.15.28:0/559221680 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda814edf0 con 0x7fdd94004380 2023-11-28T19:31:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fddadd71640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda814e930 0x7fdda814d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fddae572640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd94004380 0x7fdda814e3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009f30 tx=0x7fdda00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fdd9affd640 1 -- 172.21.15.28:0/559221680 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda000e030 con 0x7fdd94004380 2023-11-28T19:31:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fdd9affd640 1 -- 172.21.15.28:0/559221680 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda0016470 con 0x7fdd94004380 2023-11-28T19:31:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fdd9affd640 1 -- 172.21.15.28:0/559221680 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda0016820 con 0x7fdd94004380 2023-11-28T19:31:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fddb07d6640 1 -- 172.21.15.28:0/559221680 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda814ce00 con 0x7fdd94004380 2023-11-28T19:31:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fddb07d6640 1 -- 172.21.15.28:0/559221680 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda813eae0 con 0x7fdd94004380 2023-11-28T19:31:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fdd98ff9640 1 -- 172.21.15.28:0/559221680 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd84005260 con 0x7fdd94004380 2023-11-28T19:31:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fdd9affd640 1 -- 172.21.15.28:0/559221680 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdda0016980 con 0x7fdd94004380 2023-11-28T19:31:50.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fdd9affd640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdd8c066470 0x7fdd8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fdd9affd640 1 -- 172.21.15.28:0/559221680 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdda000f070 con 0x7fdd94004380 2023-11-28T19:31:50.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fddadd71640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdd8c066470 0x7fdd8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.215+0000 7fddadd71640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdd8c066470 0x7fdd8c068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0ab000 tx=0x7fdd9c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.219+0000 7fdd9affd640 1 -- 172.21.15.28:0/559221680 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdda0051ec0 con 0x7fdd94004380 2023-11-28T19:31:50.377 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.371+0000 7fdd98ff9640 1 -- 172.21.15.28:0/559221680 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd840057e0 con 0x7fdd94004380 2023-11-28T19:31:50.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.375+0000 7fdd9affd640 1 -- 172.21.15.28:0/559221680 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fdda00554e0 con 0x7fdd94004380 2023-11-28T19:31:50.379 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:50.380 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:50.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.379+0000 7fdd98ff9640 1 -- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdd8c066470 msgr2=0x7fdd8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.382 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.379+0000 7fdd98ff9640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdd8c066470 0x7fdd8c068930 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c0ab000 tx=0x7fdd9c0a7070 comp rx=0 tx=0).stop 2023-11-28T19:31:50.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.379+0000 7fdd98ff9640 1 -- 172.21.15.28:0/559221680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd94004380 msgr2=0x7fdda814e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.379+0000 7fdd98ff9640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd94004380 0x7fdda814e3f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdda0009f30 tx=0x7fdda00115a0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.379+0000 7fdd98ff9640 1 -- 172.21.15.28:0/559221680 shutdown_connections 2023-11-28T19:31:50.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.379+0000 7fdd98ff9640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdd8c066470 0x7fdd8c068930 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.379+0000 7fdd98ff9640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdda814db40 0x7fdda81e75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.379+0000 7fdd98ff9640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda814e930 0x7fdda814d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.379+0000 7fdd98ff9640 1 --2- 172.21.15.28:0/559221680 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd94004380 0x7fdda814e3f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.379+0000 7fdd98ff9640 1 -- 172.21.15.28:0/559221680 >> 172.21.15.28:0/559221680 conn(0x7fdda80bed00 msgr2=0x7fdda80bcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.379+0000 7fdd98ff9640 1 -- 172.21.15.28:0/559221680 shutdown_connections 2023-11-28T19:31:50.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.379+0000 7fdd98ff9640 1 -- 172.21.15.28:0/559221680 wait complete. 2023-11-28T19:31:50.398 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-11-28T19:31:50.398 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:50.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.511+0000 7fdd185a5640 1 Processor -- start 2023-11-28T19:31:50.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.511+0000 7fdd185a5640 1 -- start start 2023-11-28T19:31:50.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd185a5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdd10072490 0x7fdd100b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd185a5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd1014c090 0x7fdd10155e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd185a5640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd100b6a30 con 0x7fdd10072870 2023-11-28T19:31:50.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd185a5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd100b50a0 con 0x7fdd10072490 2023-11-28T19:31:50.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd185a5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd100b5840 con 0x7fdd1014c090 2023-11-28T19:31:50.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd16341640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdd10072490 0x7fdd100b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd16341640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdd10072490 0x7fdd100b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50938/0 (socket says 172.21.15.28:50938) 2023-11-28T19:31:50.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd16341640 1 -- 172.21.15.28:0/2225532673 learned_addr learned my addr 172.21.15.28:0/2225532673 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:50.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd16341640 1 -- 172.21.15.28:0/2225532673 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd1014c090 msgr2=0x7fdd10155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:50.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd16b42640 1 --2- 172.21.15.28:0/2225532673 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd1014c090 0x7fdd10155e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd16341640 1 --2- 172.21.15.28:0/2225532673 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd1014c090 0x7fdd10155e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd16341640 1 -- 172.21.15.28:0/2225532673 >> v1:172.21.15.131:6789/0 conn(0x7fdd10072870 legacy=0x7fdd1014b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:50.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd16341640 1 -- 172.21.15.28:0/2225532673 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd100b5b20 con 0x7fdd10072490 2023-11-28T19:31:50.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd16b42640 1 --2- 172.21.15.28:0/2225532673 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd1014c090 0x7fdd10155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:50.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd16341640 1 --2- 172.21.15.28:0/2225532673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd10072490 0x7fdd100b44f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009870 tx=0x7fdd0c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40ef38632f023ed2 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd1533f640 1 -- 172.21.15.28:0/2225532673 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c0ad640 con 0x7fdd10072490 2023-11-28T19:31:50.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd1533f640 1 -- 172.21.15.28:0/2225532673 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd0c0ad7a0 con 0x7fdd10072490 2023-11-28T19:31:50.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.515+0000 7fdd1533f640 1 -- 172.21.15.28:0/2225532673 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c0adb30 con 0x7fdd10072490 2023-11-28T19:31:50.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 -- 172.21.15.28:0/2225532673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd10072490 msgr2=0x7fdd100b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 --2- 172.21.15.28:0/2225532673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd10072490 0x7fdd100b44f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009870 tx=0x7fdd0c01c500 comp rx=0 tx=0).stop 2023-11-28T19:31:50.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 -- 172.21.15.28:0/2225532673 shutdown_connections 2023-11-28T19:31:50.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 --2- 172.21.15.28:0/2225532673 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd1014c090 0x7fdd10155e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 --2- 172.21.15.28:0/2225532673 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd10072490 0x7fdd100b44f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 -- 172.21.15.28:0/2225532673 >> 172.21.15.28:0/2225532673 conn(0x7fdd100bcb40 msgr2=0x7fdd100bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 -- 172.21.15.28:0/2225532673 shutdown_connections 2023-11-28T19:31:50.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 -- 172.21.15.28:0/2225532673 wait complete. 2023-11-28T19:31:50.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 Processor -- start 2023-11-28T19:31:50.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 -- start start 2023-11-28T19:31:50.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd10072490 0x7fdd1013e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd10072870 0x7fdd101e7360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd1014c090 0x7fdd101e78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1014c9e0 con 0x7fdd10072870 2023-11-28T19:31:50.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1014cbd0 con 0x7fdd1014c090 2023-11-28T19:31:50.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1014a7a0 con 0x7fdd10072490 2023-11-28T19:31:50.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd15b40640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd10072870 0x7fdd101e7360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd15b40640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd10072870 0x7fdd101e7360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:50950/0 (socket says 172.21.15.28:50950) 2023-11-28T19:31:50.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd15b40640 1 -- 172.21.15.28:0/2418238347 learned_addr learned my addr 172.21.15.28:0/2418238347 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:50.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd16341640 1 --2- 172.21.15.28:0/2418238347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd10072490 0x7fdd1013e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd16b42640 1 --2- 172.21.15.28:0/2418238347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd1014c090 0x7fdd101e78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd15b40640 1 -- 172.21.15.28:0/2418238347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd10072490 msgr2=0x7fdd1013e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd15b40640 1 --2- 172.21.15.28:0/2418238347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd10072490 0x7fdd1013e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd15b40640 1 -- 172.21.15.28:0/2418238347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd1014c090 msgr2=0x7fdd101e78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd15b40640 1 --2- 172.21.15.28:0/2418238347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd1014c090 0x7fdd101e78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.525 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd15b40640 1 -- 172.21.15.28:0/2418238347 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd0c0094d0 con 0x7fdd10072870 2023-11-28T19:31:50.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd15b40640 1 --2- 172.21.15.28:0/2418238347 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd10072870 0x7fdd101e7360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000c450 tx=0x7fdd0000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd06ffd640 1 -- 172.21.15.28:0/2418238347 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00012830 con 0x7fdd10072870 2023-11-28T19:31:50.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd06ffd640 1 -- 172.21.15.28:0/2418238347 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd000129b0 con 0x7fdd10072870 2023-11-28T19:31:50.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 -- 172.21.15.28:0/2418238347 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd1014c700 con 0x7fdd10072870 2023-11-28T19:31:50.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd06ffd640 1 -- 172.21.15.28:0/2418238347 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd00012d60 con 0x7fdd10072870 2023-11-28T19:31:50.526 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.519+0000 7fdd185a5640 1 -- 172.21.15.28:0/2418238347 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd10141e50 con 0x7fdd10072870 2023-11-28T19:31:50.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.523+0000 7fdd185a5640 1 -- 172.21.15.28:0/2418238347 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd101e7080 con 0x7fdd10072870 2023-11-28T19:31:50.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.523+0000 7fdd06ffd640 1 -- 172.21.15.28:0/2418238347 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdd0001c460 con 0x7fdd10072870 2023-11-28T19:31:50.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.523+0000 7fdd06ffd640 1 --2- 172.21.15.28:0/2418238347 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdcf4066470 0x7fdcf4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.523+0000 7fdd06ffd640 1 -- 172.21.15.28:0/2418238347 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd00083c00 con 0x7fdd10072870 2023-11-28T19:31:50.527 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.523+0000 7fdd16341640 1 --2- 172.21.15.28:0/2418238347 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdcf4066470 0x7fdcf4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.528 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.523+0000 7fdd16341640 1 --2- 172.21.15.28:0/2418238347 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdcf4066470 0x7fdcf4068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0af000 tx=0x7fdd0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.530 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.527+0000 7fdd06ffd640 1 -- 172.21.15.28:0/2418238347 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdd101e7080 con 0x7fdd10072870 2023-11-28T19:31:50.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.683+0000 7fdd185a5640 1 -- 172.21.15.28:0/2418238347 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd101e7080 con 0x7fdd10072870 2023-11-28T19:31:50.688 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.683+0000 7fdd06ffd640 1 -- 172.21.15.28:0/2418238347 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fdd101e7080 con 0x7fdd10072870 2023-11-28T19:31:50.689 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:50.689 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.687+0000 7fdd185a5640 1 -- 172.21.15.28:0/2418238347 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdcf4066470 msgr2=0x7fdcf4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.687+0000 7fdd185a5640 1 --2- 172.21.15.28:0/2418238347 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdcf4066470 0x7fdcf4068930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c0af000 tx=0x7fdd0c008040 comp rx=0 tx=0).stop 2023-11-28T19:31:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.687+0000 7fdd185a5640 1 -- 172.21.15.28:0/2418238347 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd10072870 msgr2=0x7fdd101e7360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.687+0000 7fdd185a5640 1 --2- 172.21.15.28:0/2418238347 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd10072870 0x7fdd101e7360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000c450 tx=0x7fdd0000c910 comp rx=0 tx=0).stop 2023-11-28T19:31:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.687+0000 7fdd185a5640 1 -- 172.21.15.28:0/2418238347 shutdown_connections 2023-11-28T19:31:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.687+0000 7fdd185a5640 1 --2- 172.21.15.28:0/2418238347 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdcf4066470 0x7fdcf4068930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.687+0000 7fdd185a5640 1 --2- 172.21.15.28:0/2418238347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd1014c090 0x7fdd101e78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.691 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.687+0000 7fdd185a5640 1 --2- 172.21.15.28:0/2418238347 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd10072870 0x7fdd101e7360 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.687+0000 7fdd185a5640 1 --2- 172.21.15.28:0/2418238347 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd10072490 0x7fdd1013e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.687+0000 7fdd185a5640 1 -- 172.21.15.28:0/2418238347 >> 172.21.15.28:0/2418238347 conn(0x7fdd100bcb40 msgr2=0x7fdd1014a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.687+0000 7fdd185a5640 1 -- 172.21.15.28:0/2418238347 shutdown_connections 2023-11-28T19:31:50.692 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.687+0000 7fdd185a5640 1 -- 172.21.15.28:0/2418238347 wait complete. 2023-11-28T19:31:50.709 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-11-28T19:31:50.709 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-11-28T19:31:50.710 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-11-28T19:31:50.710 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-11-28T19:31:50.711 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-11-28T19:31:50.711 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-11-28T19:31:50.711 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-11-28T19:31:50.712 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-11-28T19:31:50.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f9742084640 1 Processor -- start 2023-11-28T19:31:50.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f9742084640 1 -- start start 2023-11-28T19:31:50.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f567f59e640 1 Processor -- start 2023-11-28T19:31:50.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f567f59e640 1 -- start start 2023-11-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f9742084640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f973c0bd1f0 0x7f973c147be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f9742084640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0b8980 0x7f973c148120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f9742084640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973c0bb380 con 0x7f973c0ba680 2023-11-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f9742084640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973c0a1df0 con 0x7f973c0bd1f0 2023-11-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f9742084640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c0bb5d0 con 0x7f973c0b8980 2023-11-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f973affd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f973c0ba680 0x7f973c0b8270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49542/0 (socket says 172.21.15.28:49542) 2023-11-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f973affd640 1 -- 172.21.15.28:0/3902078650 learned_addr learned my addr 172.21.15.28:0/3902078650 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:50.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f973b7fe640 1 --2- 172.21.15.28:0/3902078650 >> v2:172.21.15.28:3300/0 conn(0x7f973c0bd1f0 0x7f973c147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f567f59e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56800b7710 0x7f56800bc230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f567f59e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56800bb600 con 0x7f56800b1e60 2023-11-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f567f59e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56800bb850 con 0x7f568014f0b0 2023-11-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f567f59e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56800bbb30 con 0x7f56800b7710 2023-11-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f973bfff640 1 --2- 172.21.15.28:0/3902078650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0b8980 0x7f973c148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.893 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f973a7fc640 1 -- 172.21.15.28:0/3902078650 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2059947204 0 0) 0x7f973c0bb380 con 0x7f973c0ba680 2023-11-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f973a7fc640 1 -- 172.21.15.28:0/3902078650 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9724003530 con 0x7f973c0ba680 2023-11-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f567ed9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f56800b1e60 0x7f5680155dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49554/0 (socket says 172.21.15.28:49554) 2023-11-28T19:31:50.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f567ed9d640 1 -- 172.21.15.28:0/460431629 learned_addr learned my addr 172.21.15.28:0/460431629 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f973bfff640 1 -- 172.21.15.28:0/3902078650 >> v2:172.21.15.28:3300/0 conn(0x7f973c0bd1f0 msgr2=0x7f973c147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f973bfff640 1 --2- 172.21.15.28:0/3902078650 >> v2:172.21.15.28:3300/0 conn(0x7f973c0bd1f0 0x7f973c147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f973bfff640 1 -- 172.21.15.28:0/3902078650 >> v1:172.21.15.28:6789/0 conn(0x7f973c0ba680 legacy=0x7f973c0b8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f973bfff640 1 -- 172.21.15.28:0/3902078650 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973c0bb8b0 con 0x7f973c0b8980 2023-11-28T19:31:50.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f567e59c640 1 --2- 172.21.15.28:0/460431629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56800b7710 0x7f56800bc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7fd3d0729640 1 Processor -- start 2023-11-28T19:31:50.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7fd3d0729640 1 -- start start 2023-11-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f567d59a640 1 -- 172.21.15.28:0/460431629 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185476669 0 0) 0x7f56800bb600 con 0x7f56800b1e60 2023-11-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f567d59a640 1 -- 172.21.15.28:0/460431629 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5668003530 con 0x7f56800b1e60 2023-11-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f567e59c640 1 -- 172.21.15.28:0/460431629 >> v1:172.21.15.131:6789/0 conn(0x7f568014f0b0 legacy=0x7f56800b1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f567e59c640 1 -- 172.21.15.28:0/460431629 >> v1:172.21.15.28:6789/0 conn(0x7f56800b1e60 legacy=0x7f5680155dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7f567e59c640 1 -- 172.21.15.28:0/460431629 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f568006b850 con 0x7f56800b7710 2023-11-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7fc2934fb640 1 Processor -- start 2023-11-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.887+0000 7fc2934fb640 1 -- start start 2023-11-28T19:31:50.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cbf1dc640 1 Processor -- start 2023-11-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fd3d0729640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd3c003d870 0x7fd3c00cd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fc2934fb640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc28c14fe80 0x7fc28c1502c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fc2934fb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc28c152d30 0x7fc28c1531c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fc2934fb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc28c153700 con 0x7fc28c09bfe0 2023-11-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fc2934fb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc28c0bc020 con 0x7fc28c152d30 2023-11-28T19:31:50.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fc2934fb640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c0bd6a0 con 0x7fc28c14fe80 2023-11-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fd3ce4c5640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd3c003d870 0x7fd3c00cd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fd3ce4c5640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd3c003d870 0x7fd3c00cd7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:47878/0 (socket says 172.21.15.28:47878) 2023-11-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fd3ce4c5640 1 -- 172.21.15.28:0/2714561049 learned_addr learned my addr 172.21.15.28:0/2714561049 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fd3d0729640 1 --2- 172.21.15.28:0/2714561049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3c00cae90 0x7fd3c00cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fd3d0729640 1 -- 172.21.15.28:0/2714561049 --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c00363b0 con 0x7fd3c003e710 2023-11-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fc291297640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc28c09bfe0 0x7fc28c0bcf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49560/0 (socket says 172.21.15.28:49560) 2023-11-28T19:31:50.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fc291297640 1 -- 172.21.15.28:0/1378400136 learned_addr learned my addr 172.21.15.28:0/1378400136 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:50.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fc291a98640 1 --2- 172.21.15.28:0/1378400136 >> v2:172.21.15.28:3300/0 conn(0x7fc28c152d30 0x7fc28c1531c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fc290a96640 1 --2- 172.21.15.28:0/1378400136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc28c14fe80 0x7fc28c1502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fd3d0729640 1 -- 172.21.15.28:0/2714561049 --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c0036600 con 0x7fd3c003d870 2023-11-28T19:31:50.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fd3cecc6640 1 --2- 172.21.15.28:0/2714561049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3c00cae90 0x7fd3c00cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.901 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f1c4b6b4640 1 Processor -- start 2023-11-28T19:31:50.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fc291a98640 1 -- 172.21.15.28:0/1378400136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc28c14fe80 msgr2=0x7fc28c1502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:50.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fc291a98640 1 --2- 172.21.15.28:0/1378400136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc28c14fe80 0x7fc28c1502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fc291a98640 1 -- 172.21.15.28:0/1378400136 >> v1:172.21.15.28:6789/0 conn(0x7fc28c09bfe0 legacy=0x7fc28c0bcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fc291a98640 1 -- 172.21.15.28:0/1378400136 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c0bad00 con 0x7fc28c152d30 2023-11-28T19:31:50.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cbf1dc640 1 -- start start 2023-11-28T19:31:50.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cbf1dc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2cb80ba680 0x7f2cb80bad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cbf1dc640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb80b8220 con 0x7f2cb80b94e0 2023-11-28T19:31:50.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cbf1dc640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb80bab60 con 0x7f2cb80bb2a0 2023-11-28T19:31:50.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cbf1dc640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cb80bb6e0 con 0x7f2cb80ba680 2023-11-28T19:31:50.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fd3d0729640 1 -- 172.21.15.28:0/2714561049 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00cb320 con 0x7fd3c00cae90 2023-11-28T19:31:50.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f973bfff640 1 --2- 172.21.15.28:0/3902078650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0b8980 0x7f973c148120 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f972c0097c0 tx=0x7f972c01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c6aa14f675f0057 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f1c4b6b4640 1 -- start start 2023-11-28T19:31:50.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cbcf78640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2cb80b94e0 0x7f2cb80b7610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49576/0 (socket says 172.21.15.28:49576) 2023-11-28T19:31:50.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cb7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2cb80ba680 0x7f2cb80bad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cbcf78640 1 -- 172.21.15.28:0/2511460761 learned_addr learned my addr 172.21.15.28:0/2511460761 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:50.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cb77fe640 1 -- 172.21.15.28:0/2511460761 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1830338524 0 0) 0x7f2cb80b8220 con 0x7f2cb80b94e0 2023-11-28T19:31:50.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cb77fe640 1 -- 172.21.15.28:0/2511460761 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ca8003530 con 0x7f2cb80b94e0 2023-11-28T19:31:50.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f1c4b6b4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1c440ba680 0x7f1c440bad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f1c4b6b4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c440bb2a0 0x7f1c44153480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f1c4b6b4640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c440b8220 con 0x7f1c440b94e0 2023-11-28T19:31:50.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f1c4b6b4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c440bb710 con 0x7f1c440ba680 2023-11-28T19:31:50.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f1c4b6b4640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c440bab60 con 0x7f1c440bb2a0 2023-11-28T19:31:50.905 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f567e59c640 1 --2- 172.21.15.28:0/460431629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56800b7710 0x7f56800bc230 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f56700097d0 tx=0x7f567001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9814d1e29dc739 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f1c48c4f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1c440ba680 0x7f1c440bad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fd3cd4c3640 1 -- 172.21.15.28:0/2714561049 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208516723 0 0) 0x7fd3c00363b0 con 0x7fd3c003e710 2023-11-28T19:31:50.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fd3cd4c3640 1 -- 172.21.15.28:0/2714561049 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd3b4003510 con 0x7fd3c003e710 2023-11-28T19:31:50.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fd3ce4c5640 1 -- 172.21.15.28:0/2714561049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3c00cae90 msgr2=0x7fd3c00cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:50.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7fd3ce4c5640 1 --2- 172.21.15.28:0/2714561049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3c00cae90 0x7fd3c00cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f973a7fc640 1 -- 172.21.15.28:0/3902078650 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0ab650 con 0x7f973c0b8980 2023-11-28T19:31:50.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f973a7fc640 1 -- 172.21.15.28:0/3902078650 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972c0ab7b0 con 0x7f973c0b8980 2023-11-28T19:31:50.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f973a7fc640 1 -- 172.21.15.28:0/3902078650 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972c0abb40 con 0x7f973c0b8980 2023-11-28T19:31:50.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f567d59a640 1 -- 172.21.15.28:0/460431629 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56700ab600 con 0x7f56800b7710 2023-11-28T19:31:50.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f567d59a640 1 -- 172.21.15.28:0/460431629 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56700a7050 con 0x7f56800b7710 2023-11-28T19:31:50.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f1c48c4f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1c440ba680 0x7f1c440bad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51004/0 (socket says 172.21.15.28:51004) 2023-11-28T19:31:50.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f1c49450640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1c440b94e0 0x7f1c440b7610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49580/0 (socket says 172.21.15.28:49580) 2023-11-28T19:31:50.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f1c48c4f640 1 -- 172.21.15.28:0/4139087597 learned_addr learned my addr 172.21.15.28:0/4139087597 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:50.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f1c49c51640 1 --2- 172.21.15.28:0/4139087597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c440bb2a0 0x7f1c44153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f1c3bfff640 1 -- 172.21.15.28:0/4139087597 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 324081213 0 0) 0x7f1c440b8220 con 0x7f1c440b94e0 2023-11-28T19:31:50.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f1c3bfff640 1 -- 172.21.15.28:0/4139087597 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c30003530 con 0x7f1c440b94e0 2023-11-28T19:31:50.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f1c49c51640 1 -- 172.21.15.28:0/4139087597 >> v2:172.21.15.28:3300/0 conn(0x7f1c440ba680 msgr2=0x7f1c440bad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:50.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f1c49c51640 1 --2- 172.21.15.28:0/4139087597 >> v2:172.21.15.28:3300/0 conn(0x7f1c440ba680 0x7f1c440bad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f1c49c51640 1 -- 172.21.15.28:0/4139087597 >> v1:172.21.15.28:6789/0 conn(0x7f1c440b94e0 legacy=0x7f1c440b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f1c3bfff640 1 -- 172.21.15.28:0/4139087597 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3672114467 0 0) 0x7f1c30003530 con 0x7f1c440b94e0 2023-11-28T19:31:50.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f1c49c51640 1 -- 172.21.15.28:0/4139087597 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c440b8aa0 con 0x7f1c440bb2a0 2023-11-28T19:31:50.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cb77fe640 1 -- 172.21.15.28:0/2511460761 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3114209667 0 0) 0x7f2ca8003530 con 0x7f2cb80b94e0 2023-11-28T19:31:50.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cb7fff640 1 -- 172.21.15.28:0/2511460761 >> v1:172.21.15.131:6789/0 conn(0x7f2cb80bb2a0 legacy=0x7f2cb8153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cb7fff640 1 -- 172.21.15.28:0/2511460761 >> v1:172.21.15.28:6789/0 conn(0x7f2cb80b94e0 legacy=0x7f2cb80b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7f2cb7fff640 1 -- 172.21.15.28:0/2511460761 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb80b8aa0 con 0x7f2cb80ba680 2023-11-28T19:31:50.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 -- 172.21.15.28:0/3902078650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0b8980 msgr2=0x7f973c148120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 --2- 172.21.15.28:0/3902078650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0b8980 0x7f973c148120 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f972c0097c0 tx=0x7f972c01c450 comp rx=0 tx=0).stop 2023-11-28T19:31:50.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fd3ce4c5640 1 -- 172.21.15.28:0/2714561049 >> v1:172.21.15.28:6789/0 conn(0x7fd3c003e710 legacy=0x7fd3c00ca780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fd3ce4c5640 1 -- 172.21.15.28:0/2714561049 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c003ef40 con 0x7fd3c003d870 2023-11-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7faa75e0d640 1 Processor -- start 2023-11-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.891+0000 7faa75e0d640 1 -- start start 2023-11-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7faa75e0d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faa700b1ab0 0x7faa7015b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7faa75e0d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa700b2b90 con 0x7faa700b8a90 2023-11-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7faa75e0d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7006cdd0 con 0x7faa700724b0 2023-11-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7faa75e0d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa700b2230 con 0x7faa700b1ab0 2023-11-28T19:31:50.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fd3cecc6640 1 --2- 172.21.15.28:0/2714561049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3c00cae90 0x7fd3c00cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:50.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 -- 172.21.15.28:0/3902078650 shutdown_connections 2023-11-28T19:31:50.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 --2- 172.21.15.28:0/3902078650 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0b8980 0x7f973c148120 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 --2- 172.21.15.28:0/3902078650 >> v2:172.21.15.28:3300/0 conn(0x7f973c0bd1f0 0x7f973c147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 -- 172.21.15.28:0/3902078650 >> 172.21.15.28:0/3902078650 conn(0x7f973c0a25a0 msgr2=0x7f973c0bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 -- 172.21.15.28:0/3902078650 shutdown_connections 2023-11-28T19:31:50.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 -- 172.21.15.28:0/3902078650 wait complete. 2023-11-28T19:31:50.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 -- 172.21.15.28:0/460431629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56800b7710 msgr2=0x7f56800bc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 --2- 172.21.15.28:0/460431629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56800b7710 0x7f56800bc230 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f56700097d0 tx=0x7f567001c410 comp rx=0 tx=0).stop 2023-11-28T19:31:50.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 -- 172.21.15.28:0/460431629 shutdown_connections 2023-11-28T19:31:50.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 --2- 172.21.15.28:0/460431629 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56800b7710 0x7f56800bc230 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 -- 172.21.15.28:0/460431629 >> 172.21.15.28:0/460431629 conn(0x7f56800bc7f0 msgr2=0x7f56800bcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 -- 172.21.15.28:0/460431629 shutdown_connections 2023-11-28T19:31:50.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7faa6f7fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7faa700724b0 0x7faa7006c6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:42586/0 (socket says 172.21.15.28:42586) 2023-11-28T19:31:50.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7faa6f7fe640 1 -- 172.21.15.28:0/2103551095 learned_addr learned my addr 172.21.15.28:0/2103551095 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:50.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fc291a98640 1 --2- 172.21.15.28:0/1378400136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28c152d30 0x7fc28c1531c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc2880097c0 tx=0x7fc28801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3579fbe9e12c49cb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fc283fff640 1 -- 172.21.15.28:0/1378400136 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2880a8970 con 0x7fc28c152d30 2023-11-28T19:31:50.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fc283fff640 1 -- 172.21.15.28:0/1378400136 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2880a8ad0 con 0x7fc28c152d30 2023-11-28T19:31:50.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fc283fff640 1 -- 172.21.15.28:0/1378400136 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2880a8e60 con 0x7fc28c152d30 2023-11-28T19:31:50.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 Processor -- start 2023-11-28T19:31:50.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 -- start start 2023-11-28T19:31:50.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f2cb7fff640 1 --2- 172.21.15.28:0/2511460761 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb80ba680 0x7f2cb80bad60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0097c0 tx=0x7f2cac01c300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e42186451d02bb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 -- 172.21.15.28:0/460431629 wait complete. 2023-11-28T19:31:50.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f2cb77fe640 1 -- 172.21.15.28:0/2511460761 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4001680 con 0x7f2cb80ba680 2023-11-28T19:31:50.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 Processor -- start 2023-11-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f2cb77fe640 1 -- 172.21.15.28:0/2511460761 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cac0a7050 con 0x7f2cb80ba680 2023-11-28T19:31:50.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fa62493b640 1 Processor -- start 2023-11-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fc2934fb640 1 -- 172.21.15.28:0/1378400136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28c152d30 msgr2=0x7fc28c1531c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fc2934fb640 1 --2- 172.21.15.28:0/1378400136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28c152d30 0x7fc28c1531c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc2880097c0 tx=0x7fc28801ec70 comp rx=0 tx=0).stop 2023-11-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fc2934fb640 1 -- 172.21.15.28:0/1378400136 shutdown_connections 2023-11-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fc2934fb640 1 --2- 172.21.15.28:0/1378400136 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28c152d30 0x7fc28c1531c0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fc2934fb640 1 --2- 172.21.15.28:0/1378400136 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc28c14fe80 0x7fc28c1502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fc2934fb640 1 -- 172.21.15.28:0/1378400136 >> 172.21.15.28:0/1378400136 conn(0x7fc28c0a25a0 msgr2=0x7fc28c0bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f973c0b8980 0x7f973c1d9a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f973c0ba680 0x7f973c143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0bd1f0 0x7f973c1395b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c1d9fb0 con 0x7f973c0ba680 2023-11-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973c1444b0 con 0x7f973c0b8980 2023-11-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f9742084640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973c140130 con 0x7f973c0bd1f0 2023-11-28T19:31:50.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f2cb77fe640 1 -- 172.21.15.28:0/2511460761 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac0ab620 con 0x7f2cb80ba680 2023-11-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f973affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f973c0ba680 0x7f973c143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f973affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f973c0ba680 0x7f973c143f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51024/0 (socket says 172.21.15.28:51024) 2023-11-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f973affd640 1 -- 172.21.15.28:0/931795098 learned_addr learned my addr 172.21.15.28:0/931795098 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:50.919 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7faa6ffff640 1 --2- 172.21.15.28:0/2103551095 >> v2:172.21.15.28:3300/0 conn(0x7faa700b1ab0 0x7faa7015b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f973bfff640 1 --2- 172.21.15.28:0/931795098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0bd1f0 0x7f973c1395b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7faa6e7fc640 1 -- 172.21.15.28:0/2103551095 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3862587346 0 0) 0x7faa700b2b90 con 0x7faa700b8a90 2023-11-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7faa6e7fc640 1 -- 172.21.15.28:0/2103551095 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa58003530 con 0x7faa700b8a90 2023-11-28T19:31:50.920 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f973b7fe640 1 --2- 172.21.15.28:0/931795098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f973c0b8980 0x7f973c1d9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7faa6ffff640 1 -- 172.21.15.28:0/2103551095 >> v1:172.21.15.131:6789/0 conn(0x7faa700724b0 legacy=0x7faa7006c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:50.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7faa6ffff640 1 -- 172.21.15.28:0/2103551095 >> v1:172.21.15.28:6789/0 conn(0x7faa700b8a90 legacy=0x7faa7014f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7faa6ffff640 1 -- 172.21.15.28:0/2103551095 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa700b2820 con 0x7faa700b1ab0 2023-11-28T19:31:50.921 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fc2934fb640 1 -- 172.21.15.28:0/1378400136 shutdown_connections 2023-11-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 -- start start 2023-11-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56800b1e60 0x7f568009b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56800b7710 0x7f56800b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568014f0b0 0x7f56801e7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568009b860 con 0x7f568014f0b0 2023-11-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56800a25a0 con 0x7f56800b1e60 2023-11-28T19:31:50.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f567f59e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56800b6840 con 0x7f56800b7710 2023-11-28T19:31:50.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f973affd640 1 -- 172.21.15.28:0/931795098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0bd1f0 msgr2=0x7f973c1395b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f973affd640 1 --2- 172.21.15.28:0/931795098 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f973c0bd1f0 0x7f973c1395b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f973affd640 1 -- 172.21.15.28:0/931795098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f973c0b8980 msgr2=0x7f973c1d9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f973affd640 1 --2- 172.21.15.28:0/931795098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f973c0b8980 0x7f973c1d9a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7f973affd640 1 -- 172.21.15.28:0/931795098 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972c009420 con 0x7f973c0ba680 2023-11-28T19:31:50.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f973affd640 1 --2- 172.21.15.28:0/931795098 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f973c0ba680 0x7f973c143f70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f973400c870 tx=0x7f973400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f567ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568014f0b0 0x7f56801e7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f567ed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568014f0b0 0x7f56801e7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51036/0 (socket says 172.21.15.28:51036) 2023-11-28T19:31:50.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f567ed9d640 1 -- 172.21.15.28:0/3963604293 learned_addr learned my addr 172.21.15.28:0/3963604293 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:50.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f567e59c640 1 --2- 172.21.15.28:0/3963604293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56800b1e60 0x7f568009b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f1c49c51640 1 --2- 172.21.15.28:0/4139087597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c440bb2a0 0x7f1c44153480 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1c340097c0 tx=0x7f1c3401c020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=584f444796dbb459 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.924 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fc2934fb640 1 -- 172.21.15.28:0/1378400136 wait complete. 2023-11-28T19:31:50.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2511460761 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb80ba680 msgr2=0x7f2cb80bad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f2cbf1dc640 1 --2- 172.21.15.28:0/2511460761 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb80ba680 0x7f2cb80bad60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0097c0 tx=0x7f2cac01c300 comp rx=0 tx=0).stop 2023-11-28T19:31:50.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.895+0000 7fa62493b640 1 -- start start 2023-11-28T19:31:50.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa62493b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa6180070e0 0x7fa61803c360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa62493b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa61803e000 0x7fa61803a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa62493b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa61803a2b0 con 0x7fa61803aca0 2023-11-28T19:31:50.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa62493b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa61803e590 con 0x7fa6180070e0 2023-11-28T19:31:50.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa62493b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa61803e870 con 0x7fa61803e000 2023-11-28T19:31:50.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f1c3bfff640 1 -- 172.21.15.28:0/4139087597 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c40001680 con 0x7f1c440bb2a0 2023-11-28T19:31:50.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f1c3bfff640 1 -- 172.21.15.28:0/4139087597 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c340a7050 con 0x7f1c440bb2a0 2023-11-28T19:31:50.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f567ed9d640 1 -- 172.21.15.28:0/3963604293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56800b7710 msgr2=0x7f56800b6300 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-11-28T19:31:50.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f567ed9d640 1 --2- 172.21.15.28:0/3963604293 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f56800b7710 0x7f56800b6300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f567ed9d640 1 -- 172.21.15.28:0/3963604293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56800b1e60 msgr2=0x7f568009b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f567ed9d640 1 --2- 172.21.15.28:0/3963604293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56800b1e60 0x7f568009b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f567ed9d640 1 -- 172.21.15.28:0/3963604293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56700093b0 con 0x7f568014f0b0 2023-11-28T19:31:50.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f567ed9d640 1 --2- 172.21.15.28:0/3963604293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568014f0b0 0x7f56801e7c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f567400c3c0 tx=0x7f567400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.927 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f1c3bfff640 1 -- 172.21.15.28:0/4139087597 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c340ab620 con 0x7f1c440bb2a0 2023-11-28T19:31:50.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fc2934fb640 1 Processor -- start 2023-11-28T19:31:50.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa61dd9b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa61803e000 0x7fa61803a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa61e59c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa6180070e0 0x7fa61803c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa61e59c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa6180070e0 0x7fa61803c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:47914/0 (socket says 172.21.15.28:47914) 2023-11-28T19:31:50.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa61ed9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa61803aca0 0x7fa6180d25f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49604/0 (socket says 172.21.15.28:49604) 2023-11-28T19:31:50.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa61ed9d640 1 -- 172.21.15.28:0/3717789117 learned_addr learned my addr 172.21.15.28:0/3717789117 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:50.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa61d59a640 1 -- 172.21.15.28:0/3717789117 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2772064327 0 0) 0x7fa61803a2b0 con 0x7fa61803aca0 2023-11-28T19:31:50.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/4139087597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c440bb2a0 msgr2=0x7f1c44153480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f1c4b6b4640 1 --2- 172.21.15.28:0/4139087597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c440bb2a0 0x7f1c44153480 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1c340097c0 tx=0x7f1c3401c020 comp rx=0 tx=0).stop 2023-11-28T19:31:50.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa61d59a640 1 -- 172.21.15.28:0/3717789117 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa608003530 con 0x7fa61803aca0 2023-11-28T19:31:50.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f9723fff640 1 -- 172.21.15.28:0/931795098 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973400aa50 con 0x7f973c0ba680 2023-11-28T19:31:50.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f9723fff640 1 -- 172.21.15.28:0/931795098 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973400abb0 con 0x7f973c0ba680 2023-11-28T19:31:50.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f9742084640 1 -- 172.21.15.28:0/931795098 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973c1e70d0 con 0x7f973c0ba680 2023-11-28T19:31:50.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f9723fff640 1 -- 172.21.15.28:0/931795098 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9734012420 con 0x7f973c0ba680 2023-11-28T19:31:50.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f9742084640 1 -- 172.21.15.28:0/931795098 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973c1e7690 con 0x7f973c0ba680 2023-11-28T19:31:50.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f9742084640 1 -- 172.21.15.28:0/931795098 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f971c000fd0 con 0x7f973c0ba680 2023-11-28T19:31:50.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f566effd640 1 -- 172.21.15.28:0/3963604293 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5674005cf0 con 0x7f568014f0b0 2023-11-28T19:31:50.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/4139087597 shutdown_connections 2023-11-28T19:31:50.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f1c4b6b4640 1 --2- 172.21.15.28:0/4139087597 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c440bb2a0 0x7f1c44153480 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f1c4b6b4640 1 --2- 172.21.15.28:0/4139087597 >> v2:172.21.15.28:3300/0 conn(0x7f1c440ba680 0x7f1c440bad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/4139087597 >> 172.21.15.28:0/4139087597 conn(0x7f1c440bc880 msgr2=0x7f1c440bcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2511460761 shutdown_connections 2023-11-28T19:31:50.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f2cbf1dc640 1 --2- 172.21.15.28:0/2511460761 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb80ba680 0x7f2cb80bad60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2511460761 >> 172.21.15.28:0/2511460761 conn(0x7f2cb80bc880 msgr2=0x7f2cb80bcc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2511460761 shutdown_connections 2023-11-28T19:31:50.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f567f59e640 1 -- 172.21.15.28:0/3963604293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56800a27b0 con 0x7f568014f0b0 2023-11-28T19:31:50.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f567f59e640 1 -- 172.21.15.28:0/3963604293 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56801ebbf0 con 0x7f568014f0b0 2023-11-28T19:31:50.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa61dd9b640 1 -- 172.21.15.28:0/3717789117 >> v2:172.21.15.131:3300/0 conn(0x7fa6180070e0 msgr2=0x7fa61803c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:50.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa61dd9b640 1 --2- 172.21.15.28:0/3717789117 >> v2:172.21.15.131:3300/0 conn(0x7fa6180070e0 0x7fa61803c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa61dd9b640 1 -- 172.21.15.28:0/3717789117 >> v1:172.21.15.28:6789/0 conn(0x7fa61803aca0 legacy=0x7fa6180d25f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fa61dd9b640 1 -- 172.21.15.28:0/3717789117 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6180d2d00 con 0x7fa61803e000 2023-11-28T19:31:50.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7faa6ffff640 1 --2- 172.21.15.28:0/2103551095 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa700b1ab0 0x7faa7015b000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faa600097c0 tx=0x7faa6001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5596de737172c647 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/4139087597 shutdown_connections 2023-11-28T19:31:50.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f566effd640 1 -- 172.21.15.28:0/3963604293 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5674005e50 con 0x7f568014f0b0 2023-11-28T19:31:50.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fc2934fb640 1 -- start start 2023-11-28T19:31:50.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fc2934fb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc28c09bfe0 0x7fc28c152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2511460761 wait complete. 2023-11-28T19:31:50.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fc2934fb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28c14fe80 0x7fc28c09fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fc2934fb640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc28c152d30 0x7fc28c150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fc291297640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc28c09bfe0 0x7fc28c152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fc291297640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc28c09bfe0 0x7fc28c152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:47918/0 (socket says 172.21.15.28:47918) 2023-11-28T19:31:50.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fc291297640 1 -- 172.21.15.28:0/638840124 learned_addr learned my addr 172.21.15.28:0/638840124 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:50.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fc2934fb640 1 -- 172.21.15.28:0/638840124 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c152bb0 con 0x7fc28c14fe80 2023-11-28T19:31:50.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fc290a96640 1 --2- 172.21.15.28:0/638840124 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28c14fe80 0x7fc28c09fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fc291a98640 1 --2- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc28c152d30 0x7fc28c150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fc2934fb640 1 -- 172.21.15.28:0/638840124 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c1e8290 con 0x7fc28c09bfe0 2023-11-28T19:31:50.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7fc2934fb640 1 -- 172.21.15.28:0/638840124 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c09ff70 con 0x7fc28c152d30 2023-11-28T19:31:50.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7f566effd640 1 -- 172.21.15.28:0/3963604293 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5674007310 con 0x7f568014f0b0 2023-11-28T19:31:50.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f9723fff640 1 -- 172.21.15.28:0/931795098 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9734012580 con 0x7f973c0ba680 2023-11-28T19:31:50.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbf1dc640 1 Processor -- start 2023-11-28T19:31:50.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7faa6e7fc640 1 -- 172.21.15.28:0/2103551095 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60004230 con 0x7faa700b1ab0 2023-11-28T19:31:50.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7faa6e7fc640 1 -- 172.21.15.28:0/2103551095 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa600a7050 con 0x7faa700b1ab0 2023-11-28T19:31:50.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.899+0000 7faa6e7fc640 1 -- 172.21.15.28:0/2103551095 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa60003620 con 0x7faa700b1ab0 2023-11-28T19:31:50.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7faa75e0d640 1 -- 172.21.15.28:0/2103551095 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa700b1ab0 msgr2=0x7faa7015b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7faa75e0d640 1 --2- 172.21.15.28:0/2103551095 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa700b1ab0 0x7faa7015b000 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7faa600097c0 tx=0x7faa6001c440 comp rx=0 tx=0).stop 2023-11-28T19:31:50.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbf1dc640 1 -- start start 2023-11-28T19:31:50.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fc290a96640 1 -- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc28c152d30 msgr2=0x7fc28c150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fc290a96640 1 --2- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc28c152d30 0x7fc28c150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fc290a96640 1 -- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc28c09bfe0 msgr2=0x7fc28c152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fc290a96640 1 --2- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc28c09bfe0 0x7fc28c152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fc290a96640 1 -- 172.21.15.28:0/638840124 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc288009420 con 0x7fc28c14fe80 2023-11-28T19:31:50.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f9723fff640 1 --2- 172.21.15.28:0/931795098 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f97280664a0 0x7f9728068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f9723fff640 1 -- 172.21.15.28:0/931795098 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9734083e80 con 0x7f973c0ba680 2023-11-28T19:31:50.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f9723fff640 1 --2- 172.21.15.28:0/931795098 >> [v2:172.21.15.28:6816/1703441975,v1:172.21.15.28:6817/1703441975] conn(0x7f972806e640 0x7f9728070a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f9723fff640 1 -- 172.21.15.28:0/931795098 --> [v2:172.21.15.28:6816/1703441975,v1:172.21.15.28:6817/1703441975] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9728071110 con 0x7f972806e640 2023-11-28T19:31:50.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f9723fff640 1 -- 172.21.15.28:0/931795098 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97340076b0 con 0x7f973c0ba680 2023-11-28T19:31:50.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f973b7fe640 1 --2- 172.21.15.28:0/931795098 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f97280664a0 0x7f9728068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fc290a96640 1 --2- 172.21.15.28:0/638840124 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28c14fe80 0x7fc28c09fa30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00d5f0 tx=0x7fc27c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7faa75e0d640 1 -- 172.21.15.28:0/2103551095 shutdown_connections 2023-11-28T19:31:50.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7faa75e0d640 1 --2- 172.21.15.28:0/2103551095 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa700b1ab0 0x7faa7015b000 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7faa75e0d640 1 -- 172.21.15.28:0/2103551095 >> 172.21.15.28:0/2103551095 conn(0x7faa700b9150 msgr2=0x7faa700b9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f973bfff640 1 --2- 172.21.15.28:0/931795098 >> [v2:172.21.15.28:6816/1703441975,v1:172.21.15.28:6817/1703441975] conn(0x7f972806e640 0x7f9728070a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f566effd640 1 -- 172.21.15.28:0/3963604293 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5674007530 con 0x7f568014f0b0 2023-11-28T19:31:50.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f566effd640 1 --2- 172.21.15.28:0/3963604293 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f56600664a0 0x7f5660068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f566effd640 1 -- 172.21.15.28:0/3963604293 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5674083350 con 0x7f568014f0b0 2023-11-28T19:31:50.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbf1dc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb80b94e0 0x7f2cb81e88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbf1dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cb80ba680 0x7f2cb80b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbf1dc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cb80bb2a0 0x7f2cb8141180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbf1dc640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80b39e0 con 0x7f2cb80b94e0 2023-11-28T19:31:50.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbf1dc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80b2d70 con 0x7f2cb80ba680 2023-11-28T19:31:50.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbf1dc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb8145540 con 0x7f2cb80bb2a0 2023-11-28T19:31:50.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f567e59c640 1 --2- 172.21.15.28:0/3963604293 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f56600664a0 0x7f5660068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/4139087597 wait complete. 2023-11-28T19:31:50.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbcf78640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb80b94e0 0x7f2cb81e88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fd3ce4c5640 1 --2- 172.21.15.28:0/2714561049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c003d870 0x7fd3c00cd7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8073460 tx=0x7fd3c8096a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75f6e0b9ee5de503 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fd3cd4c3640 1 -- 172.21.15.28:0/2714561049 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8001680 con 0x7fd3c003d870 2023-11-28T19:31:50.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f973bfff640 1 --2- 172.21.15.28:0/931795098 >> [v2:172.21.15.28:6816/1703441975,v1:172.21.15.28:6817/1703441975] conn(0x7f972806e640 0x7f9728070a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f1c4b6b4640 1 Processor -- start 2023-11-28T19:31:50.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fd3cd4c3640 1 -- 172.21.15.28:0/2714561049 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c811f630 con 0x7fd3c003d870 2023-11-28T19:31:50.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fd3cd4c3640 1 -- 172.21.15.28:0/2714561049 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c811fa60 con 0x7fd3c003d870 2023-11-28T19:31:50.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f1c4b6b4640 1 -- start start 2023-11-28T19:31:50.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fa61dd9b640 1 --2- 172.21.15.28:0/3717789117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa61803e000 0x7fa61803a760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa6140097c0 tx=0x7fa61401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec90c83f785625a6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbcf78640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb80b94e0 0x7f2cb81e88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51056/0 (socket says 172.21.15.28:51056) 2023-11-28T19:31:50.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbcf78640 1 -- 172.21.15.28:0/2590619240 learned_addr learned my addr 172.21.15.28:0/2590619240 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:50.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbd779640 1 --2- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cb80bb2a0 0x7f2cb8141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cb7fff640 1 --2- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cb80ba680 0x7f2cb80b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fc281ffb640 1 -- 172.21.15.28:0/638840124 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c0125f0 con 0x7fc28c14fe80 2023-11-28T19:31:50.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fc281ffb640 1 -- 172.21.15.28:0/638840124 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27c012750 con 0x7fc28c14fe80 2023-11-28T19:31:50.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fc281ffb640 1 -- 172.21.15.28:0/638840124 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c012ae0 con 0x7fc28c14fe80 2023-11-28T19:31:50.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fa61d59a640 1 -- 172.21.15.28:0/3717789117 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6140ab600 con 0x7fa61803e000 2023-11-28T19:31:50.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fc2934fb640 1 -- 172.21.15.28:0/638840124 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28c1e84e0 con 0x7fc28c14fe80 2023-11-28T19:31:50.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fa61d59a640 1 -- 172.21.15.28:0/3717789117 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6140a7050 con 0x7fa61803e000 2023-11-28T19:31:50.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fa61d59a640 1 -- 172.21.15.28:0/3717789117 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6140ab960 con 0x7fa61803e000 2023-11-28T19:31:50.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f567e59c640 1 --2- 172.21.15.28:0/3963604293 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f56600664a0 0x7f5660068960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56700ad000 tx=0x7f56700a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.947 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbcf78640 1 -- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cb80bb2a0 msgr2=0x7f2cb8141180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbcf78640 1 --2- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2cb80bb2a0 0x7f2cb8141180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbcf78640 1 -- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cb80ba680 msgr2=0x7f2cb80b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbcf78640 1 --2- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2cb80ba680 0x7f2cb80b2830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbcf78640 1 -- 172.21.15.28:0/2590619240 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cac009420 con 0x7f2cb80b94e0 2023-11-28T19:31:50.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f1c4b6b4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c440b94e0 0x7f1c440713b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f1c4b6b4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c440ba680 0x7f1c44070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f1c4b6b4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c440bb2a0 0x7f1c4409e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f973b7fe640 1 --2- 172.21.15.28:0/931795098 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f97280664a0 0x7f9728068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f973000aac0 tx=0x7f9730009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f1c4b6b4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4406f750 con 0x7f1c440ba680 2023-11-28T19:31:50.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f1c4b6b4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4406fa30 con 0x7f1c440bb2a0 2023-11-28T19:31:50.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f1c4b6b4640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4409e330 con 0x7f1c440b94e0 2023-11-28T19:31:50.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f2cbcf78640 1 --2- 172.21.15.28:0/2590619240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb80b94e0 0x7f2cb81e88d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400c760 tx=0x7f2ca400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f567f59e640 1 --2- 172.21.15.28:0/3963604293 >> [v2:172.21.15.28:6800/2167220471,v1:172.21.15.28:6801/2167220471] conn(0x7f56640015f0 0x7f5664003ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f567f59e640 1 -- 172.21.15.28:0/3963604293 --> [v2:172.21.15.28:6800/2167220471,v1:172.21.15.28:6801/2167220471] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5664006b50 con 0x7f56640015f0 2023-11-28T19:31:50.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f9723fff640 1 -- 172.21.15.28:0/931795098 <== osd.2 v2:172.21.15.28:6816/1703441975 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f9728071110 con 0x7f972806e640 2023-11-28T19:31:50.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f1c48c4f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c440ba680 0x7f1c44070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fd3d0729640 1 -- 172.21.15.28:0/2714561049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c003d870 msgr2=0x7fd3c00cd7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fd3d0729640 1 --2- 172.21.15.28:0/2714561049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c003d870 0x7fd3c00cd7a0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8073460 tx=0x7fd3c8096a90 comp rx=0 tx=0).stop 2023-11-28T19:31:50.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f1c48c4f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c440ba680 0x7f1c44070810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51058/0 (socket says 172.21.15.28:51058) 2023-11-28T19:31:50.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f1c48c4f640 1 -- 172.21.15.28:0/2652068633 learned_addr learned my addr 172.21.15.28:0/2652068633 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:50.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f1c49c51640 1 --2- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c440bb2a0 0x7f1c4409e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7faa75e0d640 1 -- 172.21.15.28:0/2103551095 shutdown_connections 2023-11-28T19:31:50.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7faa75e0d640 1 -- 172.21.15.28:0/2103551095 wait complete. 2023-11-28T19:31:50.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fa62493b640 1 -- 172.21.15.28:0/3717789117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa61803e000 msgr2=0x7fa61803a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fa62493b640 1 --2- 172.21.15.28:0/3717789117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa61803e000 0x7fa61803a760 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa6140097c0 tx=0x7fa61401c3f0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f567dd9b640 1 --2- 172.21.15.28:0/3963604293 >> [v2:172.21.15.28:6800/2167220471,v1:172.21.15.28:6801/2167220471] conn(0x7f56640015f0 0x7f5664003ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fa62493b640 1 -- 172.21.15.28:0/3717789117 shutdown_connections 2023-11-28T19:31:50.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fa62493b640 1 --2- 172.21.15.28:0/3717789117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa61803e000 0x7fa61803a760 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa6140097c0 tx=0x7fa61401c3f0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fa62493b640 1 --2- 172.21.15.28:0/3717789117 >> v2:172.21.15.131:3300/0 conn(0x7fa6180070e0 0x7fa61803c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fa62493b640 1 -- 172.21.15.28:0/3717789117 >> 172.21.15.28:0/3717789117 conn(0x7fa61803ee00 msgr2=0x7fa61803f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fd3d0729640 1 -- 172.21.15.28:0/2714561049 shutdown_connections 2023-11-28T19:31:50.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fd3d0729640 1 --2- 172.21.15.28:0/2714561049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3c00cae90 0x7fd3c00cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fd3d0729640 1 --2- 172.21.15.28:0/2714561049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c003d870 0x7fd3c00cd7a0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fd3d0729640 1 -- 172.21.15.28:0/2714561049 >> 172.21.15.28:0/2714561049 conn(0x7fd3c003f710 msgr2=0x7fd3c003fb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fd3d0729640 1 -- 172.21.15.28:0/2714561049 shutdown_connections 2023-11-28T19:31:50.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7f1c49450640 1 --2- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c440b94e0 0x7f1c440713b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f567dd9b640 1 --2- 172.21.15.28:0/3963604293 >> [v2:172.21.15.28:6800/2167220471,v1:172.21.15.28:6801/2167220471] conn(0x7f56640015f0 0x7f5664003ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f1c48c4f640 1 -- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c440b94e0 msgr2=0x7f1c440713b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f1c48c4f640 1 --2- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c440b94e0 0x7f1c440713b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f1c48c4f640 1 -- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c440bb2a0 msgr2=0x7f1c4409e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f1c48c4f640 1 --2- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c440bb2a0 0x7f1c4409e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f1c48c4f640 1 -- 172.21.15.28:0/2652068633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c34009420 con 0x7f1c440ba680 2023-11-28T19:31:50.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f1c48c4f640 1 --2- 172.21.15.28:0/2652068633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c440ba680 0x7f1c44070810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c007bd0 tx=0x7f1c3c00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f2cb57fa640 1 -- 172.21.15.28:0/2590619240 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4005ae0 con 0x7f2cb80b94e0 2023-11-28T19:31:50.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f2cb57fa640 1 -- 172.21.15.28:0/2590619240 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca4005c40 con 0x7f2cb80b94e0 2023-11-28T19:31:50.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f2cb57fa640 1 -- 172.21.15.28:0/2590619240 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca4007070 con 0x7f2cb80b94e0 2023-11-28T19:31:50.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f1c39ffb640 1 -- 172.21.15.28:0/2652068633 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c017070 con 0x7f1c440ba680 2023-11-28T19:31:50.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f1c39ffb640 1 -- 172.21.15.28:0/2652068633 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c00f040 con 0x7f1c440ba680 2023-11-28T19:31:50.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2590619240 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb81e7df0 con 0x7f2cb80b94e0 2023-11-28T19:31:50.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fc2934fb640 1 -- 172.21.15.28:0/638840124 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c1e8aa0 con 0x7fc28c14fe80 2023-11-28T19:31:50.957 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fc281ffb640 1 -- 172.21.15.28:0/638840124 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc27c012c40 con 0x7fc28c14fe80 2023-11-28T19:31:50.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fc281ffb640 1 --2- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc2700664c0 0x7fc270068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fc2934fb640 1 -- 172.21.15.28:0/638840124 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc28c0bb5a0 con 0x7fc28c14fe80 2023-11-28T19:31:50.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.903+0000 7fd3d0729640 1 -- 172.21.15.28:0/2714561049 wait complete. 2023-11-28T19:31:50.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3d0729640 1 Processor -- start 2023-11-28T19:31:50.958 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fa62493b640 1 -- 172.21.15.28:0/3717789117 shutdown_connections 2023-11-28T19:31:50.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fc291297640 1 --2- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc2700664c0 0x7fc270068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f1c39ffb640 1 -- 172.21.15.28:0/2652068633 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c00ddf0 con 0x7f1c440ba680 2023-11-28T19:31:50.959 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f566effd640 1 -- 172.21.15.28:0/3963604293 <== osd.3 v2:172.21.15.28:6800/2167220471 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5664006b50 con 0x7f56640015f0 2023-11-28T19:31:50.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fc281ffb640 1 -- 172.21.15.28:0/638840124 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc27c054bb0 con 0x7fc28c14fe80 2023-11-28T19:31:50.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fc281ffb640 1 --2- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:6802/233786301,v1:172.21.15.131:6804/233786301] conn(0x7fc27006e6e0 0x7fc270070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fc281ffb640 1 -- 172.21.15.28:0/638840124 --> [v2:172.21.15.131:6802/233786301,v1:172.21.15.131:6804/233786301] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2700711b0 con 0x7fc27006e6e0 2023-11-28T19:31:50.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fc281ffb640 1 -- 172.21.15.28:0/638840124 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc27c012ef0 con 0x7fc28c14fe80 2023-11-28T19:31:50.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2590619240 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb81e83b0 con 0x7f2cb80b94e0 2023-11-28T19:31:50.960 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2590619240 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c98000fd0 con 0x7f2cb80b94e0 2023-11-28T19:31:50.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fc291a98640 1 --2- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:6802/233786301,v1:172.21.15.131:6804/233786301] conn(0x7fc27006e6e0 0x7fc270070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fa62493b640 1 -- 172.21.15.28:0/3717789117 wait complete. 2023-11-28T19:31:50.961 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7faa75e0d640 1 Processor -- start 2023-11-28T19:31:50.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3d0729640 1 -- start start 2023-11-28T19:31:50.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3d0729640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3c003d870 0x7fd3c00c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3d0729640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c003e710 0x7fd3c00d04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3d0729640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c00cae90 0x7fd3c00d0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3d0729640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00c4ed0 con 0x7fd3c00cae90 2023-11-28T19:31:50.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3d0729640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c00cea00 con 0x7fd3c003e710 2023-11-28T19:31:50.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3d0729640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c0171530 con 0x7fd3c003d870 2023-11-28T19:31:50.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3cdcc4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c003e710 0x7fd3c00d04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.962 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3ce4c5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3c003d870 0x7fd3c00c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/2652068633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4409f2e0 con 0x7f1c440ba680 2023-11-28T19:31:50.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/2652068633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4409eee0 con 0x7f1c440ba680 2023-11-28T19:31:50.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fc291297640 1 --2- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc2700664c0 0x7fc270068980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc284005c10 tx=0x7fc284009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.963 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fa62493b640 1 Processor -- start 2023-11-28T19:31:50.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3cdcc4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c003e710 0x7fd3c00d04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:47946/0 (socket says 172.21.15.28:47946) 2023-11-28T19:31:50.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3cdcc4640 1 -- 172.21.15.28:0/1677005229 learned_addr learned my addr 172.21.15.28:0/1677005229 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:50.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3cecc6640 1 --2- 172.21.15.28:0/1677005229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c00cae90 0x7fd3c00d0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.964 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fc291a98640 1 --2- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:6802/233786301,v1:172.21.15.131:6804/233786301] conn(0x7fc27006e6e0 0x7fc270070b00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fa62493b640 1 -- start start 2023-11-28T19:31:50.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7faa75e0d640 1 -- start start 2023-11-28T19:31:50.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7faa75e0d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa700724b0 0x7faa70070950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7faa75e0d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa700b1ab0 0x7faa700716d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7faa75e0d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa700b8a90 0x7faa7006f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.965 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7faa75e0d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa70070e90 con 0x7faa700b1ab0 2023-11-28T19:31:50.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7faa75e0d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7013bbb0 con 0x7faa700b8a90 2023-11-28T19:31:50.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7faa75e0d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7006ef50 con 0x7faa700724b0 2023-11-28T19:31:50.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3cecc6640 1 -- 172.21.15.28:0/1677005229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3c003d870 msgr2=0x7fd3c00c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.966 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3cecc6640 1 --2- 172.21.15.28:0/1677005229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd3c003d870 0x7fd3c00c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3cecc6640 1 -- 172.21.15.28:0/1677005229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c003e710 msgr2=0x7fd3c00d04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3cecc6640 1 --2- 172.21.15.28:0/1677005229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd3c003e710 0x7fd3c00d04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7fd3cecc6640 1 -- 172.21.15.28:0/1677005229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c8069530 con 0x7fd3c00cae90 2023-11-28T19:31:50.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.907+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/2652068633 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1c4406fee0 con 0x7f1c440ba680 2023-11-28T19:31:50.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa62493b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6180070e0 0x7fa6180d4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.967 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa62493b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa61803aca0 0x7fa6180c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa62493b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa618035eb0 0x7fa6180d7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa62493b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa618037130 con 0x7fa6180070e0 2023-11-28T19:31:50.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa62493b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180d5170 con 0x7fa618035eb0 2023-11-28T19:31:50.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa62493b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6180d47a0 con 0x7fa61803aca0 2023-11-28T19:31:50.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fd3cecc6640 1 --2- 172.21.15.28:0/1677005229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c00cae90 0x7fd3c00d0a30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400c7f0 tx=0x7fd3c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fd3beffd640 1 -- 172.21.15.28:0/1677005229 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4004220 con 0x7fd3c00cae90 2023-11-28T19:31:50.968 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fd3beffd640 1 -- 172.21.15.28:0/1677005229 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3c4004380 con 0x7fd3c00cae90 2023-11-28T19:31:50.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fd3beffd640 1 -- 172.21.15.28:0/1677005229 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3c4003860 con 0x7fd3c00cae90 2023-11-28T19:31:50.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7faa6ffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa700b8a90 0x7faa7006f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7faa6f7fe640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa700724b0 0x7faa70070950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7faa6f7fe640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa700724b0 0x7faa70070950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:57542/0 (socket says 172.21.15.28:57542) 2023-11-28T19:31:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7faa6f7fe640 1 -- 172.21.15.28:0/3343868518 learned_addr learned my addr 172.21.15.28:0/3343868518 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7faa6effd640 1 --2- 172.21.15.28:0/3343868518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa700b1ab0 0x7faa700716d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fd3d0729640 1 -- 172.21.15.28:0/1677005229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c0171810 con 0x7fd3c00cae90 2023-11-28T19:31:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fd3d0729640 1 -- 172.21.15.28:0/1677005229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c0171200 con 0x7fd3c00cae90 2023-11-28T19:31:50.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fd3d0729640 1 -- 172.21.15.28:0/1677005229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd3c0041c30 con 0x7fd3c00cae90 2023-11-28T19:31:50.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f2cb57fa640 1 -- 172.21.15.28:0/2590619240 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2ca40071d0 con 0x7f2cb80b94e0 2023-11-28T19:31:50.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f2cb57fa640 1 --2- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2c9c0664c0 0x7f2c9c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f2cb57fa640 1 -- 172.21.15.28:0/2590619240 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ca4084610 con 0x7f2cb80b94e0 2023-11-28T19:31:50.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f2cb57fa640 1 --2- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:6816/1372656990,v1:172.21.15.131:6817/1372656990] conn(0x7f2c9c06e6e0 0x7f2c9c070b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f2cb57fa640 1 -- 172.21.15.28:0/2590619240 --> [v2:172.21.15.131:6816/1372656990,v1:172.21.15.131:6817/1372656990] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2c9c0711b0 con 0x7f2c9c06e6e0 2023-11-28T19:31:50.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f2cb57fa640 1 -- 172.21.15.28:0/2590619240 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ca4084980 con 0x7f2cb80b94e0 2023-11-28T19:31:50.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fc281ffb640 1 -- 172.21.15.28:0/638840124 <== osd.5 v2:172.21.15.131:6802/233786301 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fc2700711b0 con 0x7fc27006e6e0 2023-11-28T19:31:50.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa61dd9b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa61803aca0 0x7fa6180c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa61dd9b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa61803aca0 0x7fa6180c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:57544/0 (socket says 172.21.15.28:57544) 2023-11-28T19:31:50.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa61dd9b640 1 -- 172.21.15.28:0/3251908574 learned_addr learned my addr 172.21.15.28:0/3251908574 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:50.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa61e59c640 1 --2- 172.21.15.28:0/3251908574 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6180070e0 0x7fa6180d4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa61ed9d640 1 --2- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa618035eb0 0x7fa6180d7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f2cb7fff640 1 --2- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2c9c0664c0 0x7f2c9c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f2cbd779640 1 --2- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:6816/1372656990,v1:172.21.15.131:6817/1372656990] conn(0x7f2c9c06e6e0 0x7f2c9c070b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f1c39ffb640 1 -- 172.21.15.28:0/2652068633 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1c3c026430 con 0x7f1c440ba680 2023-11-28T19:31:50.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f1c39ffb640 1 --2- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1c28066540 0x7f1c28068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f1c39ffb640 1 -- 172.21.15.28:0/2652068633 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c3c084860 con 0x7f1c440ba680 2023-11-28T19:31:50.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f1c39ffb640 1 --2- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:6824/2551002532,v1:172.21.15.131:6825/2551002532] conn(0x7f1c2806e5f0 0x7f1c28070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f1c39ffb640 1 -- 172.21.15.28:0/2652068633 --> [v2:172.21.15.131:6824/2551002532,v1:172.21.15.131:6825/2551002532] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1c280710c0 con 0x7f1c2806e5f0 2023-11-28T19:31:50.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f1c39ffb640 1 -- 172.21.15.28:0/2652068633 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c3c084c10 con 0x7f1c440ba680 2023-11-28T19:31:50.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f1c49c51640 1 --2- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:6824/2551002532,v1:172.21.15.131:6825/2551002532] conn(0x7f1c2806e5f0 0x7f1c28070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f1c49450640 1 --2- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1c28066540 0x7f1c28068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa61ed9d640 1 -- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa61803aca0 msgr2=0x7fa6180c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa61ed9d640 1 --2- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa61803aca0 0x7fa6180c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa61ed9d640 1 -- 172.21.15.28:0/3251908574 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6180070e0 msgr2=0x7fa6180d4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa61ed9d640 1 --2- 172.21.15.28:0/3251908574 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa6180070e0 0x7fa6180d4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa61ed9d640 1 -- 172.21.15.28:0/3251908574 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa614009420 con 0x7fa618035eb0 2023-11-28T19:31:50.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7faa6effd640 1 -- 172.21.15.28:0/3343868518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa700724b0 msgr2=0x7faa70070950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7faa6effd640 1 --2- 172.21.15.28:0/3343868518 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faa700724b0 0x7faa70070950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7faa6effd640 1 -- 172.21.15.28:0/3343868518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa700b8a90 msgr2=0x7faa7006f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7faa6effd640 1 --2- 172.21.15.28:0/3343868518 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa700b8a90 0x7faa7006f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7faa6effd640 1 -- 172.21.15.28:0/3343868518 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa60009420 con 0x7faa700b1ab0 2023-11-28T19:31:50.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f2cbd779640 1 --2- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:6816/1372656990,v1:172.21.15.131:6817/1372656990] conn(0x7f2c9c06e6e0 0x7f2c9c070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f1c49c51640 1 --2- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:6824/2551002532,v1:172.21.15.131:6825/2551002532] conn(0x7f1c2806e5f0 0x7f1c28070a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7faa6effd640 1 --2- 172.21.15.28:0/3343868518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa700b1ab0 0x7faa700716d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c3f0 tx=0x7faa6400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7f2cb7fff640 1 --2- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2c9c0664c0 0x7f2c9c068980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0ad000 tx=0x7f2cac008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.911+0000 7fa61ed9d640 1 --2- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa618035eb0 0x7fa6180d7dc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa620064230 tx=0x7fa62006b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.977 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fd3beffd640 1 -- 172.21.15.28:0/1677005229 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd3c40039c0 con 0x7fd3c00cae90 2023-11-28T19:31:50.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fa60effd640 1 -- 172.21.15.28:0/3251908574 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa620069750 con 0x7fa618035eb0 2023-11-28T19:31:50.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7faa57fff640 1 -- 172.21.15.28:0/3343868518 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa640052d0 con 0x7faa700b1ab0 2023-11-28T19:31:50.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7faa57fff640 1 -- 172.21.15.28:0/3343868518 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa64005430 con 0x7faa700b1ab0 2023-11-28T19:31:50.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7faa57fff640 1 -- 172.21.15.28:0/3343868518 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa64003840 con 0x7faa700b1ab0 2023-11-28T19:31:50.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7f1c49450640 1 --2- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1c28066540 0x7f1c28068a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1c40001390 tx=0x7f1c40009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fd3beffd640 1 --2- 172.21.15.28:0/1677005229 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd3ac066470 0x7fd3ac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fd3beffd640 1 -- 172.21.15.28:0/1677005229 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3c4084030 con 0x7fd3c00cae90 2023-11-28T19:31:50.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7faa75e0d640 1 -- 172.21.15.28:0/3343868518 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa70071c10 con 0x7faa700b1ab0 2023-11-28T19:31:50.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7faa75e0d640 1 -- 172.21.15.28:0/3343868518 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa70152e70 con 0x7faa700b1ab0 2023-11-28T19:31:50.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7faa75e0d640 1 -- 172.21.15.28:0/3343868518 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faa7014fed0 con 0x7faa700b1ab0 2023-11-28T19:31:50.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fd3beffd640 1 --2- 172.21.15.28:0/1677005229 >> [v2:172.21.15.28:6803/3480750679,v1:172.21.15.28:6805/3480750679] conn(0x7fd3ac06e690 0x7fd3ac070ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fd3beffd640 1 -- 172.21.15.28:0/1677005229 --> [v2:172.21.15.28:6803/3480750679,v1:172.21.15.28:6805/3480750679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd3ac071160 con 0x7fd3ac06e690 2023-11-28T19:31:50.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fd3beffd640 1 -- 172.21.15.28:0/1677005229 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd3c40843e0 con 0x7fd3c00cae90 2023-11-28T19:31:50.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fd3ce4c5640 1 --2- 172.21.15.28:0/1677005229 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd3ac066470 0x7fd3ac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fd3cdcc4640 1 --2- 172.21.15.28:0/1677005229 >> [v2:172.21.15.28:6803/3480750679,v1:172.21.15.28:6805/3480750679] conn(0x7fd3ac06e690 0x7fd3ac070ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fd3cdcc4640 1 --2- 172.21.15.28:0/1677005229 >> [v2:172.21.15.28:6803/3480750679,v1:172.21.15.28:6805/3480750679] conn(0x7fd3ac06e690 0x7fd3ac070ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fd3ce4c5640 1 --2- 172.21.15.28:0/1677005229 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd3ac066470 0x7fd3ac068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0040740 tx=0x7fd3c8121070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7f2cb57fa640 1 -- 172.21.15.28:0/2590619240 <== osd.6 v2:172.21.15.131:6816/1372656990 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f2c9c0711b0 con 0x7f2c9c06e6e0 2023-11-28T19:31:50.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fa62493b640 1 -- 172.21.15.28:0/3251908574 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6180d4190 con 0x7fa618035eb0 2023-11-28T19:31:50.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fa62493b640 1 -- 172.21.15.28:0/3251908574 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6180d4430 con 0x7fa618035eb0 2023-11-28T19:31:50.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fa62493b640 1 -- 172.21.15.28:0/3251908574 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa6180e04f0 con 0x7fa618035eb0 2023-11-28T19:31:50.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7fd3beffd640 1 -- 172.21.15.28:0/1677005229 <== osd.1 v2:172.21.15.28:6803/3480750679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fd3ac071160 con 0x7fd3ac06e690 2023-11-28T19:31:50.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.915+0000 7faa57fff640 1 -- 172.21.15.28:0/3343868518 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faa640039a0 con 0x7faa700b1ab0 2023-11-28T19:31:50.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.919+0000 7f1c39ffb640 1 -- 172.21.15.28:0/2652068633 <== osd.4 v2:172.21.15.131:6824/2551002532 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1c280710c0 con 0x7f1c2806e5f0 2023-11-28T19:31:50.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.919+0000 7faa57fff640 1 --2- 172.21.15.28:0/3343868518 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7faa5c066470 0x7faa5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.919+0000 7faa57fff640 1 -- 172.21.15.28:0/3343868518 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa64083360 con 0x7faa700b1ab0 2023-11-28T19:31:50.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.919+0000 7faa57fff640 1 --2- 172.21.15.28:0/3343868518 >> [v2:172.21.15.28:6818/1448487468,v1:172.21.15.28:6820/1448487468] conn(0x7faa5c06e610 0x7faa5c070a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.919+0000 7faa57fff640 1 -- 172.21.15.28:0/3343868518 --> [v2:172.21.15.28:6818/1448487468,v1:172.21.15.28:6820/1448487468] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa5c0710e0 con 0x7faa5c06e610 2023-11-28T19:31:50.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.919+0000 7faa6f7fe640 1 --2- 172.21.15.28:0/3343868518 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7faa5c066470 0x7faa5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.919+0000 7faa6ffff640 1 --2- 172.21.15.28:0/3343868518 >> [v2:172.21.15.28:6818/1448487468,v1:172.21.15.28:6820/1448487468] conn(0x7faa5c06e610 0x7faa5c070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.919+0000 7faa6ffff640 1 --2- 172.21.15.28:0/3343868518 >> [v2:172.21.15.28:6818/1448487468,v1:172.21.15.28:6820/1448487468] conn(0x7faa5c06e610 0x7faa5c070a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.919+0000 7faa57fff640 1 -- 172.21.15.28:0/3343868518 <== osd.0 v2:172.21.15.28:6818/1448487468 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7faa5c0710e0 con 0x7faa5c06e610 2023-11-28T19:31:50.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.919+0000 7faa57fff640 1 -- 172.21.15.28:0/3343868518 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa64007e60 con 0x7faa700b1ab0 2023-11-28T19:31:50.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.919+0000 7faa6f7fe640 1 --2- 172.21.15.28:0/3343868518 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7faa5c066470 0x7faa5c068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa680056f0 tx=0x7faa68005680 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.919+0000 7fa60effd640 1 -- 172.21.15.28:0/3251908574 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa620092400 con 0x7fa618035eb0 2023-11-28T19:31:50.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.919+0000 7fa60effd640 1 -- 172.21.15.28:0/3251908574 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6200927d0 con 0x7fa618035eb0 2023-11-28T19:31:50.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.919+0000 7fa60effd640 1 -- 172.21.15.28:0/3251908574 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa620092930 con 0x7fa618035eb0 2023-11-28T19:31:50.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.927+0000 7fa60effd640 1 --2- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa6000665c0 0x7fa600068a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.927+0000 7fa60effd640 1 -- 172.21.15.28:0/3251908574 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa6200fe2c0 con 0x7fa618035eb0 2023-11-28T19:31:50.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.927+0000 7fa60effd640 1 --2- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:6800/1919068763,v1:172.21.15.131:6801/1919068763] conn(0x7fa60006e7e0 0x7fa600070c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:50.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.927+0000 7fa61e59c640 1 --2- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa6000665c0 0x7fa600068a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.927+0000 7fa60effd640 1 -- 172.21.15.28:0/3251908574 --> [v2:172.21.15.131:6800/1919068763,v1:172.21.15.131:6801/1919068763] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa6000712b0 con 0x7fa60006e7e0 2023-11-28T19:31:50.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.927+0000 7fa60effd640 1 -- 172.21.15.28:0/3251908574 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=21) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6200fe5a0 con 0x7fa618035eb0 2023-11-28T19:31:50.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.927+0000 7fa61dd9b640 1 --2- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:6800/1919068763,v1:172.21.15.131:6801/1919068763] conn(0x7fa60006e7e0 0x7fa600070c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:50.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.927+0000 7fa61e59c640 1 --2- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa6000665c0 0x7fa600068a80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa610009b60 tx=0x7fa610009190 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.927+0000 7fa61dd9b640 1 --2- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:6800/1919068763,v1:172.21.15.131:6801/1919068763] conn(0x7fa60006e7e0 0x7fa600070c00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:50.986 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.931+0000 7fa60effd640 1 -- 172.21.15.28:0/3251908574 <== osd.7 v2:172.21.15.131:6800/1919068763 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa6000712b0 con 0x7fa60006e7e0 2023-11-28T19:31:50.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.931+0000 7f9742084640 1 -- 172.21.15.28:0/931795098 --> [v2:172.21.15.28:6816/1703441975,v1:172.21.15.28:6817/1703441975] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f971c002cc0 con 0x7f972806e640 2023-11-28T19:31:50.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.931+0000 7f9723fff640 1 -- 172.21.15.28:0/931795098 <== osd.2 v2:172.21.15.28:6816/1703441975 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f971c002cc0 con 0x7f972806e640 2023-11-28T19:31:50.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.931+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2590619240 --> [v2:172.21.15.131:6816/1372656990,v1:172.21.15.131:6817/1372656990] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c98002cc0 con 0x7f2c9c06e6e0 2023-11-28T19:31:50.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.931+0000 7f9721ffb640 1 -- 172.21.15.28:0/931795098 >> [v2:172.21.15.28:6816/1703441975,v1:172.21.15.28:6817/1703441975] conn(0x7f972806e640 msgr2=0x7f9728070a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.931+0000 7f9721ffb640 1 --2- 172.21.15.28:0/931795098 >> [v2:172.21.15.28:6816/1703441975,v1:172.21.15.28:6817/1703441975] conn(0x7f972806e640 0x7f9728070a60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.931+0000 7f9721ffb640 1 -- 172.21.15.28:0/931795098 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f97280664a0 msgr2=0x7f9728068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.931+0000 7f9721ffb640 1 --2- 172.21.15.28:0/931795098 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f97280664a0 0x7f9728068960 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f973000aac0 tx=0x7f9730009040 comp rx=0 tx=0).stop 2023-11-28T19:31:50.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.931+0000 7f9721ffb640 1 -- 172.21.15.28:0/931795098 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f973c0ba680 msgr2=0x7f973c143f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.931+0000 7f9721ffb640 1 --2- 172.21.15.28:0/931795098 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f973c0ba680 0x7f973c143f70 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f973400c870 tx=0x7f973400cd30 comp rx=0 tx=0).stop 2023-11-28T19:31:50.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.931+0000 7f973bfff640 1 -- 172.21.15.28:0/931795098 reap_dead start 2023-11-28T19:31:50.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.931+0000 7f9721ffb640 1 -- 172.21.15.28:0/931795098 shutdown_connections 2023-11-28T19:31:50.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.935+0000 7f9721ffb640 1 -- 172.21.15.28:0/931795098 >> 172.21.15.28:0/931795098 conn(0x7f973c0a25a0 msgr2=0x7f973c09aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.935+0000 7f9721ffb640 1 -- 172.21.15.28:0/931795098 shutdown_connections 2023-11-28T19:31:50.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.935+0000 7f9721ffb640 1 -- 172.21.15.28:0/931795098 wait complete. 2023-11-28T19:31:50.989 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.935+0000 7f2cb57fa640 1 -- 172.21.15.28:0/2590619240 <== osd.6 v2:172.21.15.131:6816/1372656990 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2c98002cc0 con 0x7f2c9c06e6e0 2023-11-28T19:31:50.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7fc2934fb640 1 -- 172.21.15.28:0/638840124 --> [v2:172.21.15.131:6802/233786301,v1:172.21.15.131:6804/233786301] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc28c0bb2c0 con 0x7fc27006e6e0 2023-11-28T19:31:50.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:6816/1372656990,v1:172.21.15.131:6817/1372656990] conn(0x7f2c9c06e6e0 msgr2=0x7f2c9c070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7f2cbf1dc640 1 --2- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:6816/1372656990,v1:172.21.15.131:6817/1372656990] conn(0x7f2c9c06e6e0 0x7f2c9c070b00 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2c9c0664c0 msgr2=0x7f2c9c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7f2cbf1dc640 1 --2- 172.21.15.28:0/2590619240 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2c9c0664c0 0x7f2c9c068980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2cac0ad000 tx=0x7f2cac008040 comp rx=0 tx=0).stop 2023-11-28T19:31:50.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2590619240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb80b94e0 msgr2=0x7f2cb81e88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7f2cbf1dc640 1 --2- 172.21.15.28:0/2590619240 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2cb80b94e0 0x7f2cb81e88d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2ca400c760 tx=0x7f2ca400cc20 comp rx=0 tx=0).stop 2023-11-28T19:31:50.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7f2cbd779640 1 -- 172.21.15.28:0/2590619240 reap_dead start 2023-11-28T19:31:50.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2590619240 shutdown_connections 2023-11-28T19:31:50.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2590619240 >> 172.21.15.28:0/2590619240 conn(0x7f2cb80bc880 msgr2=0x7f2cb8148f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2590619240 shutdown_connections 2023-11-28T19:31:50.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7f2cbf1dc640 1 -- 172.21.15.28:0/2590619240 wait complete. 2023-11-28T19:31:50.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7f567f59e640 1 -- 172.21.15.28:0/3963604293 --> [v2:172.21.15.28:6800/2167220471,v1:172.21.15.28:6801/2167220471] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5664005c30 con 0x7f56640015f0 2023-11-28T19:31:50.992 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7fc281ffb640 1 -- 172.21.15.28:0/638840124 <== osd.5 v2:172.21.15.131:6802/233786301 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fc2880bb450 con 0x7fc27006e6e0 2023-11-28T19:31:50.993 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7f566effd640 1 -- 172.21.15.28:0/3963604293 <== osd.3 v2:172.21.15.28:6800/2167220471 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5664005c30 con 0x7f56640015f0 2023-11-28T19:31:50.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7fc2934fb640 1 -- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:6802/233786301,v1:172.21.15.131:6804/233786301] conn(0x7fc27006e6e0 msgr2=0x7fc270070b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7fc2934fb640 1 --2- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:6802/233786301,v1:172.21.15.131:6804/233786301] conn(0x7fc27006e6e0 0x7fc270070b00 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7fc2934fb640 1 -- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc2700664c0 msgr2=0x7fc270068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.939+0000 7fc2934fb640 1 --2- 172.21.15.28:0/638840124 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc2700664c0 0x7fc270068980 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc284005c10 tx=0x7fc284009040 comp rx=0 tx=0).stop 2023-11-28T19:31:50.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7fc2934fb640 1 -- 172.21.15.28:0/638840124 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28c14fe80 msgr2=0x7fc28c09fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.994 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7fc2934fb640 1 --2- 172.21.15.28:0/638840124 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc28c14fe80 0x7fc28c09fa30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00d5f0 tx=0x7fc27c00dab0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7fc291a98640 1 -- 172.21.15.28:0/638840124 reap_dead start 2023-11-28T19:31:50.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7fc2934fb640 1 -- 172.21.15.28:0/638840124 shutdown_connections 2023-11-28T19:31:50.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7f567f59e640 1 -- 172.21.15.28:0/3963604293 >> [v2:172.21.15.28:6800/2167220471,v1:172.21.15.28:6801/2167220471] conn(0x7f56640015f0 msgr2=0x7f5664003ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7f567f59e640 1 --2- 172.21.15.28:0/3963604293 >> [v2:172.21.15.28:6800/2167220471,v1:172.21.15.28:6801/2167220471] conn(0x7f56640015f0 0x7f5664003ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:50.995 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7fc2934fb640 1 -- 172.21.15.28:0/638840124 >> 172.21.15.28:0/638840124 conn(0x7fc28c0a25a0 msgr2=0x7fc28c06c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7fc2934fb640 1 -- 172.21.15.28:0/638840124 shutdown_connections 2023-11-28T19:31:50.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7f567f59e640 1 -- 172.21.15.28:0/3963604293 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f56600664a0 msgr2=0x7f5660068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.996 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7fc2934fb640 1 -- 172.21.15.28:0/638840124 wait complete. 2023-11-28T19:31:50.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7f567f59e640 1 --2- 172.21.15.28:0/3963604293 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f56600664a0 0x7f5660068960 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f56700ad000 tx=0x7f56700a6000 comp rx=0 tx=0).stop 2023-11-28T19:31:50.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7f567f59e640 1 -- 172.21.15.28:0/3963604293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568014f0b0 msgr2=0x7f56801e7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7f567f59e640 1 --2- 172.21.15.28:0/3963604293 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f568014f0b0 0x7f56801e7c20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f567400c3c0 tx=0x7f567400c880 comp rx=0 tx=0).stop 2023-11-28T19:31:50.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7f567ed9d640 1 -- 172.21.15.28:0/3963604293 reap_dead start 2023-11-28T19:31:50.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7f567f59e640 1 -- 172.21.15.28:0/3963604293 shutdown_connections 2023-11-28T19:31:50.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7f567f59e640 1 -- 172.21.15.28:0/3963604293 >> 172.21.15.28:0/3963604293 conn(0x7f56800bc7f0 msgr2=0x7f568009cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:50.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7f567f59e640 1 -- 172.21.15.28:0/3963604293 shutdown_connections 2023-11-28T19:31:50.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.943+0000 7f567f59e640 1 -- 172.21.15.28:0/3963604293 wait complete. 2023-11-28T19:31:50.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.947+0000 7fd3d0729640 1 -- 172.21.15.28:0/1677005229 --> [v2:172.21.15.28:6803/3480750679,v1:172.21.15.28:6805/3480750679] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd3c003ebc0 con 0x7fd3ac06e690 2023-11-28T19:31:50.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.947+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/2652068633 --> [v2:172.21.15.131:6824/2551002532,v1:172.21.15.131:6825/2551002532] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1c4406fee0 con 0x7f1c2806e5f0 2023-11-28T19:31:50.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.947+0000 7f1c39ffb640 1 -- 172.21.15.28:0/2652068633 <== osd.4 v2:172.21.15.131:6824/2551002532 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1c4406fee0 con 0x7f1c2806e5f0 2023-11-28T19:31:50.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.947+0000 7fa62493b640 1 -- 172.21.15.28:0/3251908574 --> [v2:172.21.15.131:6800/1919068763,v1:172.21.15.131:6801/1919068763] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa6180d5d20 con 0x7fa60006e7e0 2023-11-28T19:31:50.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.947+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:6824/2551002532,v1:172.21.15.131:6825/2551002532] conn(0x7f1c2806e5f0 msgr2=0x7f1c28070a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:50.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.947+0000 7f1c4b6b4640 1 --2- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:6824/2551002532,v1:172.21.15.131:6825/2551002532] conn(0x7f1c2806e5f0 0x7f1c28070a10 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.947+0000 7fd3beffd640 1 -- 172.21.15.28:0/1677005229 <== osd.1 v2:172.21.15.28:6803/3480750679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd3b8007910 con 0x7fd3ac06e690 2023-11-28T19:31:51.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1c28066540 msgr2=0x7f1c28068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.000 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7f1c4b6b4640 1 --2- 172.21.15.28:0/2652068633 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1c28066540 0x7f1c28068a00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1c40001390 tx=0x7f1c40009040 comp rx=0 tx=0).stop 2023-11-28T19:31:51.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7fa60effd640 1 -- 172.21.15.28:0/3251908574 <== osd.7 v2:172.21.15.131:6800/1919068763 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa6180d5d20 con 0x7fa60006e7e0 2023-11-28T19:31:51.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/2652068633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c440ba680 msgr2=0x7f1c44070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7f1c4b6b4640 1 --2- 172.21.15.28:0/2652068633 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c440ba680 0x7f1c44070810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c007bd0 tx=0x7f1c3c00d4a0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.001 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7f1c49c51640 1 -- 172.21.15.28:0/2652068633 reap_dead start 2023-11-28T19:31:51.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/2652068633 shutdown_connections 2023-11-28T19:31:51.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/2652068633 >> 172.21.15.28:0/2652068633 conn(0x7f1c440bc880 msgr2=0x7f1c4409fcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/2652068633 shutdown_connections 2023-11-28T19:31:51.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7f1c4b6b4640 1 -- 172.21.15.28:0/2652068633 wait complete. 2023-11-28T19:31:51.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7faa75e0d640 1 -- 172.21.15.28:0/3343868518 --> [v2:172.21.15.28:6818/1448487468,v1:172.21.15.28:6820/1448487468] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faa700749b0 con 0x7faa5c06e610 2023-11-28T19:31:51.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7faa57fff640 1 -- 172.21.15.28:0/3343868518 <== osd.0 v2:172.21.15.28:6818/1448487468 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faa700749b0 con 0x7faa5c06e610 2023-11-28T19:31:51.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7faa75e0d640 1 -- 172.21.15.28:0/3343868518 >> [v2:172.21.15.28:6818/1448487468,v1:172.21.15.28:6820/1448487468] conn(0x7faa5c06e610 msgr2=0x7faa5c070a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7faa75e0d640 1 --2- 172.21.15.28:0/3343868518 >> [v2:172.21.15.28:6818/1448487468,v1:172.21.15.28:6820/1448487468] conn(0x7faa5c06e610 0x7faa5c070a30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7faa75e0d640 1 -- 172.21.15.28:0/3343868518 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7faa5c066470 msgr2=0x7faa5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7faa75e0d640 1 --2- 172.21.15.28:0/3343868518 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7faa5c066470 0x7faa5c068930 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa680056f0 tx=0x7faa68005680 comp rx=0 tx=0).stop 2023-11-28T19:31:51.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7faa75e0d640 1 -- 172.21.15.28:0/3343868518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa700b1ab0 msgr2=0x7faa700716d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7faa75e0d640 1 --2- 172.21.15.28:0/3343868518 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa700b1ab0 0x7faa700716d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c3f0 tx=0x7faa6400c8b0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7faa6ffff640 1 -- 172.21.15.28:0/3343868518 reap_dead start 2023-11-28T19:31:51.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7faa75e0d640 1 -- 172.21.15.28:0/3343868518 shutdown_connections 2023-11-28T19:31:51.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7faa75e0d640 1 -- 172.21.15.28:0/3343868518 >> 172.21.15.28:0/3343868518 conn(0x7faa700b9150 msgr2=0x7faa7006c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7faa75e0d640 1 -- 172.21.15.28:0/3343868518 shutdown_connections 2023-11-28T19:31:51.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.951+0000 7faa75e0d640 1 -- 172.21.15.28:0/3343868518 wait complete. 2023-11-28T19:31:51.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fd3d0729640 1 -- 172.21.15.28:0/1677005229 >> [v2:172.21.15.28:6803/3480750679,v1:172.21.15.28:6805/3480750679] conn(0x7fd3ac06e690 msgr2=0x7fd3ac070ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fd3d0729640 1 --2- 172.21.15.28:0/1677005229 >> [v2:172.21.15.28:6803/3480750679,v1:172.21.15.28:6805/3480750679] conn(0x7fd3ac06e690 0x7fd3ac070ab0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fa62493b640 1 -- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:6800/1919068763,v1:172.21.15.131:6801/1919068763] conn(0x7fa60006e7e0 msgr2=0x7fa600070c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fa62493b640 1 --2- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:6800/1919068763,v1:172.21.15.131:6801/1919068763] conn(0x7fa60006e7e0 0x7fa600070c00 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fd3d0729640 1 -- 172.21.15.28:0/1677005229 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd3ac066470 msgr2=0x7fd3ac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fd3d0729640 1 --2- 172.21.15.28:0/1677005229 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd3ac066470 0x7fd3ac068930 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0040740 tx=0x7fd3c8121070 comp rx=0 tx=0).stop 2023-11-28T19:31:51.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fd3d0729640 1 -- 172.21.15.28:0/1677005229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c00cae90 msgr2=0x7fd3c00d0a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fd3d0729640 1 --2- 172.21.15.28:0/1677005229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd3c00cae90 0x7fd3c00d0a30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd3c400c7f0 tx=0x7fd3c400ccb0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fd3cecc6640 1 -- 172.21.15.28:0/1677005229 reap_dead start 2023-11-28T19:31:51.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fd3d0729640 1 -- 172.21.15.28:0/1677005229 shutdown_connections 2023-11-28T19:31:51.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fa62493b640 1 -- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa6000665c0 msgr2=0x7fa600068a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fd3d0729640 1 -- 172.21.15.28:0/1677005229 >> 172.21.15.28:0/1677005229 conn(0x7fd3c003f710 msgr2=0x7fd3c0023ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fa62493b640 1 --2- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa6000665c0 0x7fa600068a80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa610009b60 tx=0x7fa610009190 comp rx=0 tx=0).stop 2023-11-28T19:31:51.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fa62493b640 1 -- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa618035eb0 msgr2=0x7fa6180d7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fa62493b640 1 --2- 172.21.15.28:0/3251908574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa618035eb0 0x7fa6180d7dc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fa620064230 tx=0x7fa62006b960 comp rx=0 tx=0).stop 2023-11-28T19:31:51.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fd3d0729640 1 -- 172.21.15.28:0/1677005229 shutdown_connections 2023-11-28T19:31:51.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fa61ed9d640 1 -- 172.21.15.28:0/3251908574 reap_dead start 2023-11-28T19:31:51.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fd3d0729640 1 -- 172.21.15.28:0/1677005229 wait complete. 2023-11-28T19:31:51.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fa62493b640 1 -- 172.21.15.28:0/3251908574 shutdown_connections 2023-11-28T19:31:51.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fa62493b640 1 -- 172.21.15.28:0/3251908574 >> 172.21.15.28:0/3251908574 conn(0x7fa61803ee00 msgr2=0x7fa61803d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fa62493b640 1 -- 172.21.15.28:0/3251908574 shutdown_connections 2023-11-28T19:31:51.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:50.959+0000 7fa62493b640 1 -- 172.21.15.28:0/3251908574 wait complete. 2023-11-28T19:31:51.010 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-11-28T19:31:51.010 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-11-28T19:31:51.011 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-11-28T19:31:51.011 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-11-28T19:31:51.012 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-11-28T19:31:51.012 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-11-28T19:31:51.013 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-11-28T19:31:51.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-11-28T19:31:51.014 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2023-11-28T19:31:51.015 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-11-28T19:31:51.015 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-11-28T19:31:51.016 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-11-28T19:31:51.016 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-11-28T19:31:51.017 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-11-28T19:31:51.017 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-11-28T19:31:51.018 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-11-28T19:31:51.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.211+0000 7f5a358ec640 1 Processor -- start 2023-11-28T19:31:51.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.211+0000 7f5a358ec640 1 -- start start 2023-11-28T19:31:51.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.215+0000 7f5a358ec640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a300bd1f0 0x7f5a30147be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.215+0000 7f5a358ec640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5a300b8980 0x7f5a30148120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.215+0000 7f5a358ec640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a300bb380 con 0x7f5a300ba680 2023-11-28T19:31:51.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.215+0000 7f5a358ec640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a300a1df0 con 0x7f5a300b8980 2023-11-28T19:31:51.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.215+0000 7f5a358ec640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300bb5d0 con 0x7f5a300bd1f0 2023-11-28T19:31:51.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.215+0000 7f5a2e7fc640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f5a300ba680 0x7f5a300b8270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49606/0 (socket says 172.21.15.28:49606) 2023-11-28T19:31:51.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.215+0000 7f5a2e7fc640 1 -- 172.21.15.28:0/2303313821 learned_addr learned my addr 172.21.15.28:0/2303313821 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:51.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.215+0000 7f5a2effd640 1 --2- 172.21.15.28:0/2303313821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a300bd1f0 0x7f5a30147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.215+0000 7f5a2f7fe640 1 --2- 172.21.15.28:0/2303313821 >> v2:172.21.15.28:3300/0 conn(0x7f5a300b8980 0x7f5a30148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.215+0000 7f5a2f7fe640 1 -- 172.21.15.28:0/2303313821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a300bd1f0 msgr2=0x7f5a30147be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:51.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.215+0000 7f5a2f7fe640 1 --2- 172.21.15.28:0/2303313821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a300bd1f0 0x7f5a30147be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.215+0000 7f5a2f7fe640 1 -- 172.21.15.28:0/2303313821 >> v1:172.21.15.28:6789/0 conn(0x7f5a300ba680 legacy=0x7f5a300b8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.215+0000 7f5a2f7fe640 1 -- 172.21.15.28:0/2303313821 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a300bb8b0 con 0x7f5a300b8980 2023-11-28T19:31:51.222 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.219+0000 7f5a2f7fe640 1 --2- 172.21.15.28:0/2303313821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a300b8980 0x7f5a30148120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5a240097c0 tx=0x7f5a2401d420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d8ba975a21cb47 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.219+0000 7f5a2dffb640 1 -- 172.21.15.28:0/2303313821 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a240ae640 con 0x7f5a300b8980 2023-11-28T19:31:51.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.219+0000 7f5a2dffb640 1 -- 172.21.15.28:0/2303313821 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a240ae7a0 con 0x7f5a300b8980 2023-11-28T19:31:51.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.219+0000 7f5a2dffb640 1 -- 172.21.15.28:0/2303313821 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a240aeb30 con 0x7f5a300b8980 2023-11-28T19:31:51.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.219+0000 7f5a358ec640 1 -- 172.21.15.28:0/2303313821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a300b8980 msgr2=0x7f5a30148120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.219+0000 7f5a358ec640 1 --2- 172.21.15.28:0/2303313821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a300b8980 0x7f5a30148120 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5a240097c0 tx=0x7f5a2401d420 comp rx=0 tx=0).stop 2023-11-28T19:31:51.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.219+0000 7f5a358ec640 1 -- 172.21.15.28:0/2303313821 shutdown_connections 2023-11-28T19:31:51.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.219+0000 7f5a358ec640 1 --2- 172.21.15.28:0/2303313821 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a300b8980 0x7f5a30148120 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.219+0000 7f5a358ec640 1 --2- 172.21.15.28:0/2303313821 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a300bd1f0 0x7f5a30147be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.219+0000 7f5a358ec640 1 -- 172.21.15.28:0/2303313821 >> 172.21.15.28:0/2303313821 conn(0x7f5a300a25a0 msgr2=0x7f5a300bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.219+0000 7f5a358ec640 1 -- 172.21.15.28:0/2303313821 shutdown_connections 2023-11-28T19:31:51.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.219+0000 7f5a358ec640 1 -- 172.21.15.28:0/2303313821 wait complete. 2023-11-28T19:31:51.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a358ec640 1 Processor -- start 2023-11-28T19:31:51.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a358ec640 1 -- start start 2023-11-28T19:31:51.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a358ec640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a300b8980 0x7f5a30146e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a358ec640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a300ba680 0x7f5a301e8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a358ec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a300bd1f0 0x7f5a301424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a358ec640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a301473c0 con 0x7f5a300bd1f0 2023-11-28T19:31:51.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a358ec640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a301e88c0 con 0x7f5a300ba680 2023-11-28T19:31:51.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a358ec640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a300b3320 con 0x7f5a300b8980 2023-11-28T19:31:51.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a2f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a300bd1f0 0x7f5a301424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a2f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a300bd1f0 0x7f5a301424d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51110/0 (socket says 172.21.15.28:51110) 2023-11-28T19:31:51.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a2f7fe640 1 -- 172.21.15.28:0/3363307551 learned_addr learned my addr 172.21.15.28:0/3363307551 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:51.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a2e7fc640 1 --2- 172.21.15.28:0/3363307551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a300ba680 0x7f5a301e8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a2effd640 1 --2- 172.21.15.28:0/3363307551 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a300b8980 0x7f5a30146e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a2f7fe640 1 -- 172.21.15.28:0/3363307551 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a300b8980 msgr2=0x7f5a30146e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a2f7fe640 1 --2- 172.21.15.28:0/3363307551 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a300b8980 0x7f5a30146e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.233 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a2f7fe640 1 -- 172.21.15.28:0/3363307551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a300ba680 msgr2=0x7f5a301e8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a2f7fe640 1 --2- 172.21.15.28:0/3363307551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a300ba680 0x7f5a301e8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a2f7fe640 1 -- 172.21.15.28:0/3363307551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a24009420 con 0x7f5a300bd1f0 2023-11-28T19:31:51.234 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a2f7fe640 1 --2- 172.21.15.28:0/3363307551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a300bd1f0 0x7f5a301424d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5a2401bad0 tx=0x7f5a2401a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7fe1bc91c640 1 Processor -- start 2023-11-28T19:31:51.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a17fff640 1 -- 172.21.15.28:0/3363307551 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a240b6880 con 0x7f5a300bd1f0 2023-11-28T19:31:51.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a17fff640 1 -- 172.21.15.28:0/3363307551 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a240a7050 con 0x7f5a300bd1f0 2023-11-28T19:31:51.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a17fff640 1 -- 172.21.15.28:0/3363307551 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a240b6c00 con 0x7f5a300bd1f0 2023-11-28T19:31:51.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a358ec640 1 -- 172.21.15.28:0/3363307551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a300b1e50 con 0x7f5a300bd1f0 2023-11-28T19:31:51.239 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7f5a358ec640 1 -- 172.21.15.28:0/3363307551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a301e8550 con 0x7f5a300bd1f0 2023-11-28T19:31:51.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.223+0000 7fe1bc91c640 1 -- start start 2023-11-28T19:31:51.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7fe1bc91c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1b0039ed0 0x7fe1b00cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7fe1bc91c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b003aec0 con 0x7fe1b0039a90 2023-11-28T19:31:51.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7fe1bc91c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1b0035fe0 con 0x7fe1b0006990 2023-11-28T19:31:51.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f5a358ec640 1 -- 172.21.15.28:0/3363307551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a301e8a30 con 0x7f5a300bd1f0 2023-11-28T19:31:51.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7fe1bc91c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b003b9b0 con 0x7fe1b0039ed0 2023-11-28T19:31:51.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7fe1b659c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe1b0039a90 0x7fe1b00c6f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49618/0 (socket says 172.21.15.28:49618) 2023-11-28T19:31:51.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7fe1b659c640 1 -- 172.21.15.28:0/3409390613 learned_addr learned my addr 172.21.15.28:0/3409390613 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:51.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7fe1b759e640 1 --2- 172.21.15.28:0/3409390613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1b0039ed0 0x7fe1b00cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f30f359e640 1 Processor -- start 2023-11-28T19:31:51.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f30f359e640 1 -- start start 2023-11-28T19:31:51.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7fe1b5d9b640 1 -- 172.21.15.28:0/3409390613 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2327925462 0 0) 0x7fe1b0035fe0 con 0x7fe1b0006990 2023-11-28T19:31:51.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7fe1b5d9b640 1 -- 172.21.15.28:0/3409390613 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1a0003530 con 0x7fe1b0006990 2023-11-28T19:31:51.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7fe1b5d9b640 1 -- 172.21.15.28:0/3409390613 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3663451578 0 0) 0x7fe1b003aec0 con 0x7fe1b0039a90 2023-11-28T19:31:51.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7fe1b5d9b640 1 -- 172.21.15.28:0/3409390613 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1b0035fe0 con 0x7fe1b0039a90 2023-11-28T19:31:51.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f523bfff640 1 Processor -- start 2023-11-28T19:31:51.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f523bfff640 1 -- start start 2023-11-28T19:31:51.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f5a17fff640 1 -- 172.21.15.28:0/3363307551 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5a240c2460 con 0x7f5a300bd1f0 2023-11-28T19:31:51.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f255ed13640 1 Processor -- start 2023-11-28T19:31:51.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f30f359e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30f406bf40 0x7f30f40b7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7fe1b759e640 1 -- 172.21.15.28:0/3409390613 >> v1:172.21.15.131:6789/0 conn(0x7fe1b0006990 legacy=0x7fe1b0006fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7fe1b759e640 1 -- 172.21.15.28:0/3409390613 >> v1:172.21.15.28:6789/0 conn(0x7fe1b0039a90 legacy=0x7fe1b00c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7fe1b759e640 1 -- 172.21.15.28:0/3409390613 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b00c7670 con 0x7fe1b0039ed0 2023-11-28T19:31:51.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f5a17fff640 1 --2- 172.21.15.28:0/3363307551 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5a1c0664c0 0x7f5a1c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f255ed13640 1 -- start start 2023-11-28T19:31:51.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f78b6501640 1 Processor -- start 2023-11-28T19:31:51.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f30f359e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f30f406c320 0x7f30f40b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f78b6501640 1 -- start start 2023-11-28T19:31:51.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f78b6501640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f78b009bfe0 0x7f78b00bcf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f78b6501640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b00bad00 con 0x7f78b0153440 2023-11-28T19:31:51.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f78b6501640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b00bafe0 con 0x7f78b014fe80 2023-11-28T19:31:51.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f78b6501640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b00bc020 con 0x7f78b009bfe0 2023-11-28T19:31:51.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f5a2effd640 1 --2- 172.21.15.28:0/3363307551 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5a1c0664c0 0x7f5a1c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f523bfff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c154d60 0x7f523c157150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f78b4a9e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f78b0153440 0x7f78b015a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49620/0 (socket says 172.21.15.28:49620) 2023-11-28T19:31:51.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f78b4a9e640 1 -- 172.21.15.28:0/2417264695 learned_addr learned my addr 172.21.15.28:0/2417264695 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:51.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f78affff640 1 --2- 172.21.15.28:0/2417264695 >> v2:172.21.15.28:3300/0 conn(0x7f78b009bfe0 0x7f78b00bcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f523bfff640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523c06e9a0 con 0x7f523c0b8a00 2023-11-28T19:31:51.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f30f1d9b640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f30f40b7490 0x7f30f40ba5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:42614/0 (socket says 172.21.15.28:42614) 2023-11-28T19:31:51.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f30f259c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30f406bf40 0x7f30f40b7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f30f259c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30f406bf40 0x7f30f40b7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:57584/0 (socket says 172.21.15.28:57584) 2023-11-28T19:31:51.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f523affd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f523c0bc9e0 0x7f523c14f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:42620/0 (socket says 172.21.15.28:42620) 2023-11-28T19:31:51.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f523affd640 1 -- 172.21.15.28:0/1503117265 learned_addr learned my addr 172.21.15.28:0/1503117265 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:51.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f78affff640 1 -- 172.21.15.28:0/2417264695 >> v1:172.21.15.131:6789/0 conn(0x7f78b014fe80 legacy=0x7f78b0152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f523b7fe640 1 --2- 172.21.15.28:0/1503117265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c154d60 0x7f523c157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f30f1d9b640 1 -- 172.21.15.28:0/2433260179 learned_addr learned my addr 172.21.15.28:0/2433260179 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:51.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f523bfff640 1 -- 172.21.15.28:0/1503117265 --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523c06dfd0 con 0x7f523c0bc9e0 2023-11-28T19:31:51.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f255ed13640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25580b70b0 0x7f255815b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f255ed13640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25580b3900 con 0x7f2558153800 2023-11-28T19:31:51.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f255ed13640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25580b43c0 con 0x7f25580b3520 2023-11-28T19:31:51.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f255ed13640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2558149f20 con 0x7f25580b70b0 2023-11-28T19:31:51.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f523bfff640 1 -- 172.21.15.28:0/1503117265 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c0bd650 con 0x7f523c154d60 2023-11-28T19:31:51.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f30f359e640 1 -- 172.21.15.28:0/2433260179 --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30f40b26e0 con 0x7f30f40b7490 2023-11-28T19:31:51.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f30f359e640 1 -- 172.21.15.28:0/2433260179 --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30f40b1860 con 0x7f30f406c320 2023-11-28T19:31:51.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f78affff640 1 -- 172.21.15.28:0/2417264695 >> v1:172.21.15.28:6789/0 conn(0x7f78b0153440 legacy=0x7f78b015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f78affff640 1 -- 172.21.15.28:0/2417264695 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b00bb2c0 con 0x7f78b009bfe0 2023-11-28T19:31:51.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f255d510640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f2558153800 0x7f25580b5030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49634/0 (socket says 172.21.15.28:49634) 2023-11-28T19:31:51.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f255d510640 1 -- 172.21.15.28:0/2528295011 learned_addr learned my addr 172.21.15.28:0/2528295011 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:51.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.227+0000 7f30f359e640 1 -- 172.21.15.28:0/2433260179 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f40b3870 con 0x7f30f406bf40 2023-11-28T19:31:51.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f5239ffb640 1 -- 172.21.15.28:0/1503117265 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2332593046 0 0) 0x7f523c06dfd0 con 0x7f523c0bc9e0 2023-11-28T19:31:51.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f5239ffb640 1 -- 172.21.15.28:0/1503117265 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5224003530 con 0x7f523c0bc9e0 2023-11-28T19:31:51.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f30f2d9d640 1 --2- 172.21.15.28:0/2433260179 >> v2:172.21.15.131:3300/0 conn(0x7f30f406c320 0x7f30f40b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f5a2effd640 1 --2- 172.21.15.28:0/3363307551 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5a1c0664c0 0x7f5a1c068980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5a200093b0 tx=0x7f5a20009a20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f255e512640 1 --2- 172.21.15.28:0/2528295011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25580b70b0 0x7f255815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f5a17fff640 1 -- 172.21.15.28:0/3363307551 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a240ef190 con 0x7f5a300bd1f0 2023-11-28T19:31:51.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f523b7fe640 1 -- 172.21.15.28:0/1503117265 >> v1:172.21.15.131:6789/0 conn(0x7f523c0bc9e0 legacy=0x7f523c14f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f523b7fe640 1 -- 172.21.15.28:0/1503117265 >> v1:172.21.15.28:6789/0 conn(0x7f523c0b8a00 legacy=0x7f523c0b8e40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-11-28T19:31:51.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f255cd0f640 1 -- 172.21.15.28:0/2528295011 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269165849 0 0) 0x7f2548001120 con 0x7f2558153800 2023-11-28T19:31:51.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f255cd0f640 1 -- 172.21.15.28:0/2528295011 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2544003530 con 0x7f2558153800 2023-11-28T19:31:51.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f255cd0f640 1 -- 172.21.15.28:0/2528295011 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2700932874 0 0) 0x7f25580b43c0 con 0x7f25580b3520 2023-11-28T19:31:51.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f255cd0f640 1 -- 172.21.15.28:0/2528295011 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2548001120 con 0x7f25580b3520 2023-11-28T19:31:51.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f255e512640 1 -- 172.21.15.28:0/2528295011 >> v1:172.21.15.131:6789/0 conn(0x7f25580b3520 legacy=0x7f25580b3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f255e512640 1 -- 172.21.15.28:0/2528295011 >> v1:172.21.15.28:6789/0 conn(0x7f2558153800 legacy=0x7f25580b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f255e512640 1 -- 172.21.15.28:0/2528295011 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25580b7500 con 0x7f25580b70b0 2023-11-28T19:31:51.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f894759e640 1 Processor -- start 2023-11-28T19:31:51.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f894759e640 1 -- start start 2023-11-28T19:31:51.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f78affff640 1 --2- 172.21.15.28:0/2417264695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78b009bfe0 0x7f78b00bcf90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009d90 tx=0x7f78a801f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ae4e636e7f90e23 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f523b7fe640 1 -- 172.21.15.28:0/1503117265 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c06d980 con 0x7f523c154d60 2023-11-28T19:31:51.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f894759e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89480b8a00 0x7f89480b8e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7fe1b759e640 1 --2- 172.21.15.28:0/3409390613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1b0039ed0 0x7fe1b00cd3a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe1b802cef0 tx=0x7fe1b8096b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a926fe3d59616f54 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f894759e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894806e9a0 con 0x7f89480bc9e0 2023-11-28T19:31:51.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f894659c640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f89480bc9e0 0x7f894814f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49652/0 (socket says 172.21.15.28:49652) 2023-11-28T19:31:51.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f894659c640 1 -- 172.21.15.28:0/1906781701 learned_addr learned my addr 172.21.15.28:0/1906781701 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:51.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f894759e640 1 -- 172.21.15.28:0/1906781701 --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894806dfd0 con 0x7f8948153d50 2023-11-28T19:31:51.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f8945d9b640 1 --2- 172.21.15.28:0/1906781701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89480b8a00 0x7f89480b8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7fe1b5d9b640 1 -- 172.21.15.28:0/3409390613 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b81207b0 con 0x7fe1b0039ed0 2023-11-28T19:31:51.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f894759e640 1 -- 172.21.15.28:0/1906781701 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89480bd650 con 0x7f89480b8a00 2023-11-28T19:31:51.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f894559a640 1 -- 172.21.15.28:0/1906781701 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3766938838 0 0) 0x7f894806dfd0 con 0x7f8948153d50 2023-11-28T19:31:51.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f894559a640 1 -- 172.21.15.28:0/1906781701 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8930003530 con 0x7f8948153d50 2023-11-28T19:31:51.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f255e512640 1 --2- 172.21.15.28:0/2528295011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25580b70b0 0x7f255815b000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f25540097f0 tx=0x7f255401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58d3a91a7cb8d2df server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f255cd0f640 1 -- 172.21.15.28:0/2528295011 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25540ac640 con 0x7f25580b70b0 2023-11-28T19:31:51.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f255cd0f640 1 -- 172.21.15.28:0/2528295011 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25540ac7a0 con 0x7f25580b70b0 2023-11-28T19:31:51.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7fe1b5d9b640 1 -- 172.21.15.28:0/3409390613 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b8120910 con 0x7fe1b0039ed0 2023-11-28T19:31:51.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7fe1b5d9b640 1 -- 172.21.15.28:0/3409390613 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b8120d40 con 0x7fe1b0039ed0 2023-11-28T19:31:51.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3409390613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1b0039ed0 msgr2=0x7fe1b00cd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 --2- 172.21.15.28:0/3409390613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1b0039ed0 0x7fe1b00cd3a0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe1b802cef0 tx=0x7fe1b8096b60 comp rx=0 tx=0).stop 2023-11-28T19:31:51.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f255cd0f640 1 -- 172.21.15.28:0/2528295011 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25540acb10 con 0x7f25580b70b0 2023-11-28T19:31:51.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f30f159a640 1 -- 172.21.15.28:0/2433260179 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210600292 0 0) 0x7f30f40b26e0 con 0x7f30f40b7490 2023-11-28T19:31:51.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f30f259c640 1 -- 172.21.15.28:0/2433260179 >> v2:172.21.15.131:3300/0 conn(0x7f30f406c320 msgr2=0x7f30f40b7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:51.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f30f259c640 1 --2- 172.21.15.28:0/2433260179 >> v2:172.21.15.131:3300/0 conn(0x7f30f406c320 0x7f30f40b7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f30f259c640 1 -- 172.21.15.28:0/2433260179 >> v1:172.21.15.131:6789/0 conn(0x7f30f40b7490 legacy=0x7f30f40ba5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.231+0000 7f30f259c640 1 -- 172.21.15.28:0/2433260179 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f40b2090 con 0x7f30f406bf40 2023-11-28T19:31:51.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3409390613 shutdown_connections 2023-11-28T19:31:51.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 --2- 172.21.15.28:0/3409390613 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1b0039ed0 0x7fe1b00cd3a0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3409390613 >> 172.21.15.28:0/3409390613 conn(0x7fe1b0005e70 msgr2=0x7fe1b0006280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3409390613 shutdown_connections 2023-11-28T19:31:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f255ed13640 1 -- 172.21.15.28:0/2528295011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25580b70b0 msgr2=0x7f255815b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f255ed13640 1 --2- 172.21.15.28:0/2528295011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25580b70b0 0x7f255815b000 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f25540097f0 tx=0x7f255401c400 comp rx=0 tx=0).stop 2023-11-28T19:31:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f255ed13640 1 -- 172.21.15.28:0/2528295011 shutdown_connections 2023-11-28T19:31:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f255ed13640 1 --2- 172.21.15.28:0/2528295011 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25580b70b0 0x7f255815b000 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f255ed13640 1 -- 172.21.15.28:0/2528295011 >> 172.21.15.28:0/2528295011 conn(0x7f25580bc7b0 msgr2=0x7f25580bcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f255ed13640 1 -- 172.21.15.28:0/2528295011 shutdown_connections 2023-11-28T19:31:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f255ed13640 1 -- 172.21.15.28:0/2528295011 wait complete. 2023-11-28T19:31:51.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f523b7fe640 1 --2- 172.21.15.28:0/1503117265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c154d60 0x7f523c157150 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f523c06c720 tx=0x7f523001ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b252111f8a7ed5b5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3409390613 wait complete. 2023-11-28T19:31:51.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f5239ffb640 1 -- 172.21.15.28:0/1503117265 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52300a8950 con 0x7f523c154d60 2023-11-28T19:31:51.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f5239ffb640 1 -- 172.21.15.28:0/1503117265 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52300a8ab0 con 0x7f523c154d60 2023-11-28T19:31:51.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f5239ffb640 1 -- 172.21.15.28:0/1503117265 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52300a8e40 con 0x7f523c154d60 2023-11-28T19:31:51.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f8945d9b640 1 -- 172.21.15.28:0/1906781701 >> v1:172.21.15.131:6789/0 conn(0x7f8948153d50 legacy=0x7f8948156140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f8945d9b640 1 -- 172.21.15.28:0/1906781701 >> v1:172.21.15.28:6789/0 conn(0x7f89480bc9e0 legacy=0x7f894814f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f8945d9b640 1 -- 172.21.15.28:0/1906781701 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894806d980 con 0x7f89480b8a00 2023-11-28T19:31:51.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f30f259c640 1 --2- 172.21.15.28:0/2433260179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30f406bf40 0x7f30f40b7aa0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f30e400a940 tx=0x7f30e401d840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=621e2b87cd00988e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 Processor -- start 2023-11-28T19:31:51.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 -- start start 2023-11-28T19:31:51.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f8945d9b640 1 --2- 172.21.15.28:0/1906781701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89480b8a00 0x7f89480b8e40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f893c0097f0 tx=0x7f893c01ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f89f32f055199c2e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f30f159a640 1 -- 172.21.15.28:0/2433260179 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e40a6870 con 0x7f30f406bf40 2023-11-28T19:31:51.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f894559a640 1 -- 172.21.15.28:0/1906781701 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c0a89b0 con 0x7f89480b8a00 2023-11-28T19:31:51.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f255ed13640 1 Processor -- start 2023-11-28T19:31:51.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f894559a640 1 -- 172.21.15.28:0/1906781701 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c0a8b10 con 0x7f89480b8a00 2023-11-28T19:31:51.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f894559a640 1 -- 172.21.15.28:0/1906781701 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c0a8e80 con 0x7f89480b8a00 2023-11-28T19:31:51.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f523bfff640 1 -- 172.21.15.28:0/1503117265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c154d60 msgr2=0x7f523c157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f523bfff640 1 --2- 172.21.15.28:0/1503117265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c154d60 0x7f523c157150 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f523c06c720 tx=0x7f523001ec50 comp rx=0 tx=0).stop 2023-11-28T19:31:51.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f523bfff640 1 -- 172.21.15.28:0/1503117265 shutdown_connections 2023-11-28T19:31:51.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f523bfff640 1 --2- 172.21.15.28:0/1503117265 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c154d60 0x7f523c157150 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f523bfff640 1 -- 172.21.15.28:0/1503117265 >> 172.21.15.28:0/1503117265 conn(0x7f523c0ba2f0 msgr2=0x7f523c0ba700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f255ed13640 1 -- start start 2023-11-28T19:31:51.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1b0006990 0x7fe1b0036b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1b0039a90 0x7fe1b00c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1b0039ed0 0x7fe1b0162780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0037070 con 0x7fe1b0039ed0 2023-11-28T19:31:51.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b00ca4a0 con 0x7fe1b0006990 2023-11-28T19:31:51.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7fe1bc91c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b0028150 con 0x7fe1b0039a90 2023-11-28T19:31:51.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f523bfff640 1 -- 172.21.15.28:0/1503117265 shutdown_connections 2023-11-28T19:31:51.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1b759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1b0039ed0 0x7fe1b0162780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f30f159a640 1 -- 172.21.15.28:0/2433260179 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30e40a69d0 con 0x7f30f406bf40 2023-11-28T19:31:51.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f30f159a640 1 -- 172.21.15.28:0/2433260179 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30e40a6d60 con 0x7f30f406bf40 2023-11-28T19:31:51.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f30f359e640 1 -- 172.21.15.28:0/2433260179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30f406bf40 msgr2=0x7f30f40b7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.235+0000 7f30f359e640 1 --2- 172.21.15.28:0/2433260179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30f406bf40 0x7f30f40b7aa0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f30e400a940 tx=0x7f30e401d840 comp rx=0 tx=0).stop 2023-11-28T19:31:51.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1b6d9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1b0006990 0x7fe1b0036b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f894759e640 1 -- 172.21.15.28:0/1906781701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89480b8a00 msgr2=0x7f89480b8e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f894759e640 1 --2- 172.21.15.28:0/1906781701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89480b8a00 0x7f89480b8e40 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f893c0097f0 tx=0x7f893c01ecb0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f359e640 1 -- 172.21.15.28:0/2433260179 shutdown_connections 2023-11-28T19:31:51.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f359e640 1 --2- 172.21.15.28:0/2433260179 >> v2:172.21.15.131:3300/0 conn(0x7f30f406c320 0x7f30f40b7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f359e640 1 --2- 172.21.15.28:0/2433260179 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30f406bf40 0x7f30f40b7aa0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f359e640 1 -- 172.21.15.28:0/2433260179 >> 172.21.15.28:0/2433260179 conn(0x7f30f40bc7f0 msgr2=0x7f30f40bcc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1b6d9d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1b0006990 0x7fe1b0036b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:47992/0 (socket says 172.21.15.28:47992) 2023-11-28T19:31:51.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1b6d9d640 1 -- 172.21.15.28:0/3906959488 learned_addr learned my addr 172.21.15.28:0/3906959488 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:51.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f523bfff640 1 -- 172.21.15.28:0/1503117265 wait complete. 2023-11-28T19:31:51.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1b659c640 1 --2- 172.21.15.28:0/3906959488 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1b0039a90 0x7fe1b00c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255ed13640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25580b3520 0x7f255814fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255ed13640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25580b70b0 0x7f255814a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255ed13640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2558153800 0x7f255814a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255ed13640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25581502a0 con 0x7f25580b70b0 2023-11-28T19:31:51.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255ed13640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f255814ce40 con 0x7f2558153800 2023-11-28T19:31:51.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255ed13640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255814ef10 con 0x7f25580b3520 2023-11-28T19:31:51.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f359e640 1 -- 172.21.15.28:0/2433260179 shutdown_connections 2023-11-28T19:31:51.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f894759e640 1 -- 172.21.15.28:0/1906781701 shutdown_connections 2023-11-28T19:31:51.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f894759e640 1 --2- 172.21.15.28:0/1906781701 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89480b8a00 0x7f89480b8e40 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f894759e640 1 -- 172.21.15.28:0/1906781701 >> 172.21.15.28:0/1906781701 conn(0x7f89480ba2f0 msgr2=0x7f89480ba700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f5a17fff640 1 -- 172.21.15.28:0/3363307551 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5a24123060 con 0x7f5a300bd1f0 2023-11-28T19:31:51.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255d510640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25580b70b0 0x7f255814a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255d510640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25580b70b0 0x7f255814a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51142/0 (socket says 172.21.15.28:51142) 2023-11-28T19:31:51.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255d510640 1 -- 172.21.15.28:0/3988130857 learned_addr learned my addr 172.21.15.28:0/3988130857 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:51.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255e512640 1 --2- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2558153800 0x7f255814a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255dd11640 1 --2- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25580b3520 0x7f255814fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f359e640 1 -- 172.21.15.28:0/2433260179 wait complete. 2023-11-28T19:31:51.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f78aeffd640 1 -- 172.21.15.28:0/2417264695 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a80af600 con 0x7f78b009bfe0 2023-11-28T19:31:51.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f78aeffd640 1 -- 172.21.15.28:0/2417264695 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a80ab050 con 0x7f78b009bfe0 2023-11-28T19:31:51.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f78aeffd640 1 -- 172.21.15.28:0/2417264695 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a80af980 con 0x7f78b009bfe0 2023-11-28T19:31:51.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1b759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1b0039ed0 0x7fe1b0162780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51128/0 (socket says 172.21.15.28:51128) 2023-11-28T19:31:51.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1b6d9d640 1 -- 172.21.15.28:0/3906959488 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1b0039a90 msgr2=0x7fe1b00c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1b6d9d640 1 --2- 172.21.15.28:0/3906959488 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1b0039a90 0x7fe1b00c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1b6d9d640 1 -- 172.21.15.28:0/3906959488 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1b0039ed0 msgr2=0x7fe1b0162780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1b6d9d640 1 --2- 172.21.15.28:0/3906959488 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1b0039ed0 0x7fe1b0162780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1b6d9d640 1 -- 172.21.15.28:0/3906959488 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8069530 con 0x7fe1b0006990 2023-11-28T19:31:51.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f894759e640 1 -- 172.21.15.28:0/1906781701 shutdown_connections 2023-11-28T19:31:51.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f894759e640 1 -- 172.21.15.28:0/1906781701 wait complete. 2023-11-28T19:31:51.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1b6d9d640 1 --2- 172.21.15.28:0/3906959488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1b0006990 0x7fe1b0036b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00c3a0 tx=0x7fe1ac00c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255dd11640 1 -- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2558153800 msgr2=0x7f255814a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255dd11640 1 --2- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2558153800 0x7f255814a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255dd11640 1 -- 172.21.15.28:0/3988130857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25580b70b0 msgr2=0x7f255814a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255dd11640 1 --2- 172.21.15.28:0/3988130857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25580b70b0 0x7f255814a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255dd11640 1 -- 172.21.15.28:0/3988130857 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554009420 con 0x7f25580b3520 2023-11-28T19:31:51.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f78b6501640 1 -- 172.21.15.28:0/2417264695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78b009bfe0 msgr2=0x7f78b00bcf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f78b6501640 1 --2- 172.21.15.28:0/2417264695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78b009bfe0 0x7f78b00bcf90 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f78a8009d90 tx=0x7f78a801f130 comp rx=0 tx=0).stop 2023-11-28T19:31:51.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f78b6501640 1 -- 172.21.15.28:0/2417264695 shutdown_connections 2023-11-28T19:31:51.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f78b6501640 1 --2- 172.21.15.28:0/2417264695 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78b009bfe0 0x7f78b00bcf90 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f78b6501640 1 -- 172.21.15.28:0/2417264695 >> 172.21.15.28:0/2417264695 conn(0x7f78b00a25a0 msgr2=0x7f78b00bc880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f78b6501640 1 -- 172.21.15.28:0/2417264695 shutdown_connections 2023-11-28T19:31:51.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f78b6501640 1 -- 172.21.15.28:0/2417264695 wait complete. 2023-11-28T19:31:51.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe19f7fe640 1 -- 172.21.15.28:0/3906959488 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac0052d0 con 0x7fe1b0006990 2023-11-28T19:31:51.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f523bfff640 1 Processor -- start 2023-11-28T19:31:51.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe19f7fe640 1 -- 172.21.15.28:0/3906959488 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1ac005430 con 0x7fe1b0006990 2023-11-28T19:31:51.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe19f7fe640 1 -- 172.21.15.28:0/3906959488 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1ac003820 con 0x7fe1b0006990 2023-11-28T19:31:51.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3906959488 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1b0165080 con 0x7fe1b0006990 2023-11-28T19:31:51.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3906959488 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b0028640 con 0x7fe1b0006990 2023-11-28T19:31:51.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f359e640 1 Processor -- start 2023-11-28T19:31:51.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255dd11640 1 --2- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25580b3520 0x7f255814fd60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f255000c650 tx=0x7f255000cb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f254e7fc640 1 -- 172.21.15.28:0/3988130857 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550003b80 con 0x7f25580b3520 2023-11-28T19:31:51.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f894759e640 1 Processor -- start 2023-11-28T19:31:51.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f894759e640 1 -- start start 2023-11-28T19:31:51.287 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f523bfff640 1 -- start start 2023-11-28T19:31:51.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3906959488 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1b0005370 con 0x7fe1b0006990 2023-11-28T19:31:51.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f523bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f523c0b8a00 0x7f523c147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f523bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0bc9e0 0x7f523c0b3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.288 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f894759e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89480b8a00 0x7f8948146f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255ed13640 1 -- 172.21.15.28:0/3988130857 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255814d070 con 0x7f25580b3520 2023-11-28T19:31:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f255ed13640 1 -- 172.21.15.28:0/3988130857 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25581e87b0 con 0x7f25580b3520 2023-11-28T19:31:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f78b6501640 1 Processor -- start 2023-11-28T19:31:51.289 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f359e640 1 -- start start 2023-11-28T19:31:51.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f359e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30f406bf40 0x7f30f40a0090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f359e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30f406c320 0x7f30f414a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f359e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30f40b7490 0x7f30f40a1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f359e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f414a7e0 con 0x7f30f40b7490 2023-11-28T19:31:51.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f359e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f41453d0 con 0x7f30f406bf40 2023-11-28T19:31:51.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f523bfff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c154d60 0x7f523c0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.290 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f523bfff640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c147940 con 0x7f523c0b8a00 2023-11-28T19:31:51.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f359e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30f409b410 con 0x7f30f406c320 2023-11-28T19:31:51.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f259c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30f406bf40 0x7f30f40a0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f1d9b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30f406c320 0x7f30f414a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f1d9b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30f406c320 0x7f30f414a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:57630/0 (socket says 172.21.15.28:57630) 2023-11-28T19:31:51.291 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f30f1d9b640 1 -- 172.21.15.28:0/3176905312 learned_addr learned my addr 172.21.15.28:0/3176905312 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:51.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f523bfff640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c071ba0 con 0x7f523c0bc9e0 2023-11-28T19:31:51.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f523bfff640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c070a20 con 0x7f523c154d60 2023-11-28T19:31:51.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f523a7fc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0bc9e0 0x7f523c0b3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f523a7fc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0bc9e0 0x7f523c0b3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:48016/0 (socket says 172.21.15.28:48016) 2023-11-28T19:31:51.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.239+0000 7f523a7fc640 1 -- 172.21.15.28:0/2207623688 learned_addr learned my addr 172.21.15.28:0/2207623688 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:51.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f254e7fc640 1 -- 172.21.15.28:0/3988130857 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2550003ce0 con 0x7f25580b3520 2023-11-28T19:31:51.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89480b8a00 0x7f8948146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894659c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89480b8a00 0x7f8948146f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51182/0 (socket says 172.21.15.28:51182) 2023-11-28T19:31:51.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894659c640 1 -- 172.21.15.28:0/1635677950 learned_addr learned my addr 172.21.15.28:0/1635677950 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:51.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f30f2d9d640 1 --2- 172.21.15.28:0/3176905312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30f40b7490 0x7f30f40a1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.293 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f255ed13640 1 -- 172.21.15.28:0/3988130857 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2558074a20 con 0x7f25580b3520 2023-11-28T19:31:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f523b7fe640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c154d60 0x7f523c0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f523affd640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f523c0b8a00 0x7f523c147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f30f1d9b640 1 -- 172.21.15.28:0/3176905312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30f406bf40 msgr2=0x7f30f40a0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f30f1d9b640 1 --2- 172.21.15.28:0/3176905312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30f406bf40 0x7f30f40a0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f30f1d9b640 1 -- 172.21.15.28:0/3176905312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30f40b7490 msgr2=0x7f30f40a1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f30f1d9b640 1 --2- 172.21.15.28:0/3176905312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30f40b7490 0x7f30f40a1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78b6501640 1 -- start start 2023-11-28T19:31:51.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f30f1d9b640 1 -- 172.21.15.28:0/3176905312 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30e400a550 con 0x7f30f406c320 2023-11-28T19:31:51.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894759e640 1 --2- 172.21.15.28:0/1635677950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89480bc9e0 0x7f8948071030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894759e640 1 --2- 172.21.15.28:0/1635677950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8948153d50 0x7f89480b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894759e640 1 -- 172.21.15.28:0/1635677950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8948071f20 con 0x7f89480b8a00 2023-11-28T19:31:51.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894759e640 1 -- 172.21.15.28:0/1635677950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89481474a0 con 0x7f89480bc9e0 2023-11-28T19:31:51.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894759e640 1 -- 172.21.15.28:0/1635677950 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89480707e0 con 0x7f8948153d50 2023-11-28T19:31:51.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f523a7fc640 1 -- 172.21.15.28:0/2207623688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c154d60 msgr2=0x7f523c0b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f523a7fc640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c154d60 0x7f523c0b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.296 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f523a7fc640 1 -- 172.21.15.28:0/2207623688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f523c0b8a00 msgr2=0x7f523c147400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f523a7fc640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f523c0b8a00 0x7f523c147400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f523a7fc640 1 -- 172.21.15.28:0/2207623688 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5230009420 con 0x7f523c0bc9e0 2023-11-28T19:31:51.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f30f2d9d640 1 --2- 172.21.15.28:0/3176905312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30f40b7490 0x7f30f40a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:31:51.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f254e7fc640 1 -- 172.21.15.28:0/3988130857 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2550005310 con 0x7f25580b3520 2023-11-28T19:31:51.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f30f1d9b640 1 --2- 172.21.15.28:0/3176905312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30f406c320 0x7f30f414a2a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00c8c0 tx=0x7f30ec00cd80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894659c640 1 -- 172.21.15.28:0/1635677950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8948153d50 msgr2=0x7f89480b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894659c640 1 --2- 172.21.15.28:0/1635677950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8948153d50 0x7f89480b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894659c640 1 -- 172.21.15.28:0/1635677950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89480bc9e0 msgr2=0x7f8948071030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894659c640 1 --2- 172.21.15.28:0/1635677950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89480bc9e0 0x7f8948071030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894659c640 1 -- 172.21.15.28:0/1635677950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c009420 con 0x7f89480b8a00 2023-11-28T19:31:51.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78b6501640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78b009bfe0 0x7f78b0139df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78b6501640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78b014fe80 0x7f78b009c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78b6501640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b0153440 0x7f78b009e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78b6501640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b014f0e0 con 0x7f78b009bfe0 2023-11-28T19:31:51.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78b6501640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b014ec60 con 0x7f78b0153440 2023-11-28T19:31:51.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78b6501640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b013d640 con 0x7f78b014fe80 2023-11-28T19:31:51.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f523affd640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f523c0b8a00 0x7f523c147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:31:51.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f523a7fc640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0bc9e0 0x7f523c0b3500 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f523400c7d0 tx=0x7f523400cc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894659c640 1 --2- 172.21.15.28:0/1635677950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89480b8a00 0x7f8948146f60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f893800c500 tx=0x7f893800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78affff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78b009bfe0 0x7f78b0139df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78affff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78b009bfe0 0x7f78b0139df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51190/0 (socket says 172.21.15.28:51190) 2023-11-28T19:31:51.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78affff640 1 -- 172.21.15.28:0/2496496539 learned_addr learned my addr 172.21.15.28:0/2496496539 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:51.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7fe19f7fe640 1 -- 172.21.15.28:0/3906959488 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe1ac003980 con 0x7fe1b0006990 2023-11-28T19:31:51.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78b4a9e640 1 --2- 172.21.15.28:0/2496496539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b0153440 0x7f78b009e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78af7fe640 1 --2- 172.21.15.28:0/2496496539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78b014fe80 0x7f78b009c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7fe19f7fe640 1 --2- 172.21.15.28:0/3906959488 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe1a40664a0 0x7fe1a4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7fe19f7fe640 1 -- 172.21.15.28:0/3906959488 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe1ac083770 con 0x7fe1b0006990 2023-11-28T19:31:51.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f8936ffd640 1 -- 172.21.15.28:0/1635677950 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8938005cf0 con 0x7f89480b8a00 2023-11-28T19:31:51.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f8936ffd640 1 -- 172.21.15.28:0/1635677950 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8938005e50 con 0x7f89480b8a00 2023-11-28T19:31:51.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894759e640 1 -- 172.21.15.28:0/1635677950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8948071570 con 0x7f89480b8a00 2023-11-28T19:31:51.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f8936ffd640 1 -- 172.21.15.28:0/1635677950 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89380072f0 con 0x7f89480b8a00 2023-11-28T19:31:51.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78affff640 1 -- 172.21.15.28:0/2496496539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78b014fe80 msgr2=0x7f78b009c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78affff640 1 --2- 172.21.15.28:0/2496496539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78b014fe80 0x7f78b009c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78affff640 1 -- 172.21.15.28:0/2496496539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b0153440 msgr2=0x7f78b009e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78affff640 1 --2- 172.21.15.28:0/2496496539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b0153440 0x7f78b009e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f78affff640 1 -- 172.21.15.28:0/2496496539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a8009a70 con 0x7f78b009bfe0 2023-11-28T19:31:51.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7fe1b659c640 1 --2- 172.21.15.28:0/3906959488 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe1a40664a0 0x7fe1a4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894759e640 1 -- 172.21.15.28:0/1635677950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8948070400 con 0x7f89480b8a00 2023-11-28T19:31:51.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7fe1b659c640 1 --2- 172.21.15.28:0/3906959488 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe1a40664a0 0x7fe1a4068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00422e0 tx=0x7fe1a8007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.304 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f894759e640 1 -- 172.21.15.28:0/1635677950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89480b3cd0 con 0x7f89480b8a00 2023-11-28T19:31:51.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.243+0000 7f254e7fc640 1 -- 172.21.15.28:0/3988130857 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2550005470 con 0x7f25580b3520 2023-11-28T19:31:51.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.247+0000 7f254e7fc640 1 --2- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f253c066470 0x7f253c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.247+0000 7f254e7fc640 1 -- 172.21.15.28:0/3988130857 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2550084620 con 0x7f25580b3520 2023-11-28T19:31:51.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.247+0000 7f255d510640 1 --2- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f253c066470 0x7f253c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.247+0000 7f8936ffd640 1 -- 172.21.15.28:0/1635677950 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8938007450 con 0x7f89480b8a00 2023-11-28T19:31:51.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.247+0000 7f8936ffd640 1 --2- 172.21.15.28:0/1635677950 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f89280664f0 0x7f89280689b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.247+0000 7f8936ffd640 1 -- 172.21.15.28:0/1635677950 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8938083560 con 0x7f89480b8a00 2023-11-28T19:31:51.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.247+0000 7f255d510640 1 --2- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f253c066470 0x7f253c068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f25581505f0 tx=0x7f2548009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.247+0000 7f78affff640 1 --2- 172.21.15.28:0/2496496539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78b009bfe0 0x7f78b0139df0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f78a801cd60 tx=0x7f78a801bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.251+0000 7f78acff9640 1 -- 172.21.15.28:0/2496496539 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a80ba420 con 0x7f78b009bfe0 2023-11-28T19:31:51.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.251+0000 7f8945d9b640 1 --2- 172.21.15.28:0/1635677950 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f89280664f0 0x7f89280689b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.251+0000 7f78acff9640 1 -- 172.21.15.28:0/2496496539 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78a80ba5a0 con 0x7f78b009bfe0 2023-11-28T19:31:51.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.251+0000 7f78acff9640 1 -- 172.21.15.28:0/2496496539 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78a80ba950 con 0x7f78b009bfe0 2023-11-28T19:31:51.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.251+0000 7f8936ffd640 1 -- 172.21.15.28:0/1635677950 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8938054690 con 0x7f89480b8a00 2023-11-28T19:31:51.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.251+0000 7f78b6501640 1 -- 172.21.15.28:0/2496496539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b013a330 con 0x7f78b009bfe0 2023-11-28T19:31:51.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.251+0000 7f78b6501640 1 -- 172.21.15.28:0/2496496539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b00b6b60 con 0x7f78b009bfe0 2023-11-28T19:31:51.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.251+0000 7f8945d9b640 1 --2- 172.21.15.28:0/1635677950 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f89280664f0 0x7f89280689b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f893c0b2000 tx=0x7f893c004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.251+0000 7f78b6501640 1 -- 172.21.15.28:0/2496496539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7890005260 con 0x7f78b009bfe0 2023-11-28T19:31:51.308 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.251+0000 7f78acff9640 1 -- 172.21.15.28:0/2496496539 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f78a80baab0 con 0x7f78b009bfe0 2023-11-28T19:31:51.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.251+0000 7f78acff9640 1 --2- 172.21.15.28:0/2496496539 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f789c0664c0 0x7f789c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.251+0000 7f78acff9640 1 -- 172.21.15.28:0/2496496539 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78a8122570 con 0x7f78b009bfe0 2023-11-28T19:31:51.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.251+0000 7fdba20ef640 1 Processor -- start 2023-11-28T19:31:51.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba20ef640 1 -- start start 2023-11-28T19:31:51.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7f78af7fe640 1 --2- 172.21.15.28:0/2496496539 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f789c0664c0 0x7f789c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba20ef640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdb9403a010 0x7fdb940cf120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba20ef640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdb940cf660 0x7fdb940d9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba20ef640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb940c9460 con 0x7fdb940394c0 2023-11-28T19:31:51.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba08ec640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdb9403a010 0x7fdb940cf120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba20ef640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb9403b3b0 con 0x7fdb9403a010 2023-11-28T19:31:51.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba08ec640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdb9403a010 0x7fdb940cf120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51202/0 (socket says 172.21.15.28:51202) 2023-11-28T19:31:51.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba08ec640 1 -- 172.21.15.28:0/591447200 learned_addr learned my addr 172.21.15.28:0/591447200 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:51.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba10ed640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdb940394c0 0x7fdb940c8d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49666/0 (socket says 172.21.15.28:49666) 2023-11-28T19:31:51.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba20ef640 1 -- 172.21.15.28:0/591447200 --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb940075d0 con 0x7fdb940cf660 2023-11-28T19:31:51.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba18ee640 1 --2- 172.21.15.28:0/591447200 >> v2:172.21.15.131:3300/0 conn(0x7fdb940cf660 0x7fdb940d9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba08ec640 1 -- 172.21.15.28:0/591447200 >> v2:172.21.15.131:3300/0 conn(0x7fdb940cf660 msgr2=0x7fdb940d9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:51.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba08ec640 1 --2- 172.21.15.28:0/591447200 >> v2:172.21.15.131:3300/0 conn(0x7fdb940cf660 0x7fdb940d9630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba08ec640 1 -- 172.21.15.28:0/591447200 >> v1:172.21.15.28:6789/0 conn(0x7fdb940394c0 legacy=0x7fdb940c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7f78af7fe640 1 --2- 172.21.15.28:0/2496496539 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f789c0664c0 0x7f789c068980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f78b014d7a0 tx=0x7f78a4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7fdba08ec640 1 -- 172.21.15.28:0/591447200 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb940078b0 con 0x7fdb9403a010 2023-11-28T19:31:51.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7f5223fff640 1 -- 172.21.15.28:0/2207623688 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234003d90 con 0x7f523c0bc9e0 2023-11-28T19:31:51.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7f30e2ffd640 1 -- 172.21.15.28:0/3176905312 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec00a640 con 0x7f30f406c320 2023-11-28T19:31:51.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7f30e2ffd640 1 -- 172.21.15.28:0/3176905312 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30ec00a7a0 con 0x7f30f406c320 2023-11-28T19:31:51.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7f523bfff640 1 -- 172.21.15.28:0/2207623688 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c09ee90 con 0x7f523c0bc9e0 2023-11-28T19:31:51.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7f523bfff640 1 -- 172.21.15.28:0/2207623688 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c0b2be0 con 0x7f523c0bc9e0 2023-11-28T19:31:51.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7f5223fff640 1 -- 172.21.15.28:0/2207623688 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5234005070 con 0x7f523c0bc9e0 2023-11-28T19:31:51.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7f5223fff640 1 -- 172.21.15.28:0/2207623688 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234005420 con 0x7f523c0bc9e0 2023-11-28T19:31:51.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7f254e7fc640 1 -- 172.21.15.28:0/3988130857 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2550051b10 con 0x7f25580b3520 2023-11-28T19:31:51.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7f30f359e640 1 -- 172.21.15.28:0/3176905312 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f4145620 con 0x7f30f406c320 2023-11-28T19:31:51.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.255+0000 7f30f359e640 1 -- 172.21.15.28:0/3176905312 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f40a1520 con 0x7f30f406c320 2023-11-28T19:31:51.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.259+0000 7f30e2ffd640 1 -- 172.21.15.28:0/3176905312 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30ec00ab90 con 0x7f30f406c320 2023-11-28T19:31:51.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.259+0000 7fdba08ec640 1 --2- 172.21.15.28:0/591447200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb9403a010 0x7fdb940cf120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400a6a0 tx=0x7fdb8c01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fc943f58df59de7 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.259+0000 7fe19f7fe640 1 -- 172.21.15.28:0/3906959488 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe1ac050d30 con 0x7fe1b0006990 2023-11-28T19:31:51.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.259+0000 7f5223fff640 1 -- 172.21.15.28:0/2207623688 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5234005580 con 0x7f523c0bc9e0 2023-11-28T19:31:51.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.259+0000 7f30f359e640 1 -- 172.21.15.28:0/3176905312 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f40680a0 con 0x7f30f406c320 2023-11-28T19:31:51.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.259+0000 7f30e2ffd640 1 -- 172.21.15.28:0/3176905312 <== mon.2 v2:172.21.15.131:3301/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f30ec00acf0 con 0x7f30f406c320 2023-11-28T19:31:51.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.259+0000 7f30e2ffd640 1 --2- 172.21.15.28:0/3176905312 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f30d40664c0 0x7f30d4068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.259+0000 7f30e2ffd640 1 -- 172.21.15.28:0/3176905312 <== mon.2 v2:172.21.15.131:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f30ec083920 con 0x7f30f406c320 2023-11-28T19:31:51.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.259+0000 7f30f259c640 1 --2- 172.21.15.28:0/3176905312 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f30d40664c0 0x7f30d4068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.259+0000 7f5223fff640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5228066540 0x7f5228068a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.259+0000 7f5223fff640 1 -- 172.21.15.28:0/2207623688 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5234083760 con 0x7f523c0bc9e0 2023-11-28T19:31:51.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.263+0000 7f30f259c640 1 --2- 172.21.15.28:0/3176905312 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f30d40664c0 0x7f30d4068980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f30e40b0000 tx=0x7f30e40a8070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.263+0000 7f523affd640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5228066540 0x7f5228068a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.263+0000 7f523bfff640 1 -- 172.21.15.28:0/2207623688 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f521c005260 con 0x7f523c0bc9e0 2023-11-28T19:31:51.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.263+0000 7f523affd640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5228066540 0x7f5228068a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f522c0011f0 tx=0x7f522c007d40 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.271+0000 7fdb93fff640 1 -- 172.21.15.28:0/591447200 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c0aa430 con 0x7fdb9403a010 2023-11-28T19:31:51.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.271+0000 7fdb93fff640 1 -- 172.21.15.28:0/591447200 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb8c0aa590 con 0x7fdb9403a010 2023-11-28T19:31:51.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.271+0000 7fdb93fff640 1 -- 172.21.15.28:0/591447200 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb8c0aa920 con 0x7fdb9403a010 2023-11-28T19:31:51.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.271+0000 7f78acff9640 1 -- 172.21.15.28:0/2496496539 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f78a80efcb0 con 0x7f78b009bfe0 2023-11-28T19:31:51.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.271+0000 7fdba20ef640 1 -- 172.21.15.28:0/591447200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb9403a010 msgr2=0x7fdb940cf120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.271+0000 7fdba20ef640 1 --2- 172.21.15.28:0/591447200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb9403a010 0x7fdb940cf120 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fdb9400a6a0 tx=0x7fdb8c01c4d0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.271+0000 7fdba20ef640 1 -- 172.21.15.28:0/591447200 shutdown_connections 2023-11-28T19:31:51.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.271+0000 7fdba20ef640 1 --2- 172.21.15.28:0/591447200 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb9403a010 0x7fdb940cf120 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.271+0000 7fdba20ef640 1 --2- 172.21.15.28:0/591447200 >> v2:172.21.15.131:3300/0 conn(0x7fdb940cf660 0x7fdb940d9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.271+0000 7fdba20ef640 1 -- 172.21.15.28:0/591447200 >> 172.21.15.28:0/591447200 conn(0x7fdb94006ab0 msgr2=0x7fdb94006ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.271+0000 7fdba20ef640 1 -- 172.21.15.28:0/591447200 shutdown_connections 2023-11-28T19:31:51.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.271+0000 7fdba20ef640 1 -- 172.21.15.28:0/591447200 wait complete. 2023-11-28T19:31:51.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.271+0000 7f30e2ffd640 1 -- 172.21.15.28:0/3176905312 <== mon.2 v2:172.21.15.131:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f30ec050fc0 con 0x7f30f406c320 2023-11-28T19:31:51.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.275+0000 7fdba20ef640 1 Processor -- start 2023-11-28T19:31:51.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.275+0000 7fdba20ef640 1 -- start start 2023-11-28T19:31:51.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.275+0000 7f5223fff640 1 -- 172.21.15.28:0/2207623688 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5234017080 con 0x7f523c0bc9e0 2023-11-28T19:31:51.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.287+0000 7fdba20ef640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb940394c0 0x7fdb94029ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.287+0000 7fdba20ef640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb9403a010 0x7fdb94168db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.287+0000 7fdba20ef640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb940cf660 0x7fdb941692f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.287+0000 7fdba10ed640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb940394c0 0x7fdb94029ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.287+0000 7fdba10ed640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb940394c0 0x7fdb94029ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:57660/0 (socket says 172.21.15.28:57660) 2023-11-28T19:31:51.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.287+0000 7fdba08ec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb9403a010 0x7fdb94168db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.287+0000 7fdba08ec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb9403a010 0x7fdb94168db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51218/0 (socket says 172.21.15.28:51218) 2023-11-28T19:31:51.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.287+0000 7fdba10ed640 1 -- 172.21.15.28:0/4065591664 learned_addr learned my addr 172.21.15.28:0/4065591664 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:51.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.287+0000 7fdba20ef640 1 -- 172.21.15.28:0/4065591664 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9402a430 con 0x7fdb9403a010 2023-11-28T19:31:51.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.291+0000 7fdba20ef640 1 -- 172.21.15.28:0/4065591664 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9403e960 con 0x7fdb940cf660 2023-11-28T19:31:51.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.291+0000 7fdba18ee640 1 --2- 172.21.15.28:0/4065591664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb940cf660 0x7fdb941692f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.291+0000 7fdba20ef640 1 -- 172.21.15.28:0/4065591664 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9403ec40 con 0x7fdb940394c0 2023-11-28T19:31:51.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.291+0000 7fdba18ee640 1 -- 172.21.15.28:0/4065591664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb940394c0 msgr2=0x7fdb94029ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.291+0000 7fdba18ee640 1 --2- 172.21.15.28:0/4065591664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb940394c0 0x7fdb94029ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.291+0000 7fdba18ee640 1 -- 172.21.15.28:0/4065591664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb9403a010 msgr2=0x7fdb94168db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.291+0000 7fdba18ee640 1 --2- 172.21.15.28:0/4065591664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb9403a010 0x7fdb94168db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.291+0000 7fdba18ee640 1 -- 172.21.15.28:0/4065591664 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb8c0094d0 con 0x7fdb940cf660 2023-11-28T19:31:51.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.291+0000 7fdba08ec640 1 --2- 172.21.15.28:0/4065591664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb9403a010 0x7fdb94168db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:31:51.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.291+0000 7fdba18ee640 1 --2- 172.21.15.28:0/4065591664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb940cf660 0x7fdb941692f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c000b70 tx=0x7fdb9c0680a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.291+0000 7fdb91ffb640 1 -- 172.21.15.28:0/4065591664 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0721c0 con 0x7fdb940cf660 2023-11-28T19:31:51.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.291+0000 7fdb91ffb640 1 -- 172.21.15.28:0/4065591664 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c072320 con 0x7fdb940cf660 2023-11-28T19:31:51.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.291+0000 7fdba20ef640 1 -- 172.21.15.28:0/4065591664 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9403ef20 con 0x7fdb940cf660 2023-11-28T19:31:51.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.291+0000 7fdba20ef640 1 -- 172.21.15.28:0/4065591664 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb940c9c60 con 0x7fdb940cf660 2023-11-28T19:31:51.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.295+0000 7fdb91ffb640 1 -- 172.21.15.28:0/4065591664 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0726b0 con 0x7fdb940cf660 2023-11-28T19:31:51.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.295+0000 7fdb91ffb640 1 -- 172.21.15.28:0/4065591664 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdb9c072890 con 0x7fdb940cf660 2023-11-28T19:31:51.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.295+0000 7fdb91ffb640 1 --2- 172.21.15.28:0/4065591664 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdb80066470 0x7fdb80068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.295+0000 7fdb91ffb640 1 -- 172.21.15.28:0/4065591664 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdb9c0fdc90 con 0x7fdb940cf660 2023-11-28T19:31:51.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.295+0000 7fdba10ed640 1 --2- 172.21.15.28:0/4065591664 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdb80066470 0x7fdb80068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.299+0000 7fdba20ef640 1 -- 172.21.15.28:0/4065591664 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb7c005260 con 0x7fdb940cf660 2023-11-28T19:31:51.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.299+0000 7fdba10ed640 1 --2- 172.21.15.28:0/4065591664 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdb80066470 0x7fdb80068930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb98000f70 tx=0x7fdb98007f10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.315+0000 7fdb91ffb640 1 -- 172.21.15.28:0/4065591664 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdb9c0cb1b0 con 0x7fdb940cf660 2023-11-28T19:31:51.559 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.555+0000 7f894759e640 1 -- 172.21.15.28:0/1635677950 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f89480b3cd0 con 0x7f89480b8a00 2023-11-28T19:31:51.560 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.555+0000 7f8936ffd640 1 -- 172.21.15.28:0/1635677950 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89480b3cd0 con 0x7f89480b8a00 2023-11-28T19:31:51.562 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-11-28T19:31:51.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.559+0000 7f5a358ec640 1 -- 172.21.15.28:0/3363307551 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f5a30143000 con 0x7f5a300bd1f0 2023-11-28T19:31:51.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.559+0000 7f5a17fff640 1 -- 172.21.15.28:0/3363307551 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5a240b3090 con 0x7f5a300bd1f0 2023-11-28T19:31:51.562 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-11-28T19:31:51.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f5a15ffb640 1 -- 172.21.15.28:0/3363307551 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5a1c0664c0 msgr2=0x7f5a1c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f5a15ffb640 1 --2- 172.21.15.28:0/3363307551 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5a1c0664c0 0x7f5a1c068980 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f5a200093b0 tx=0x7f5a20009a20 comp rx=0 tx=0).stop 2023-11-28T19:31:51.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f5a15ffb640 1 -- 172.21.15.28:0/3363307551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a300bd1f0 msgr2=0x7f5a301424d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f5a15ffb640 1 --2- 172.21.15.28:0/3363307551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a300bd1f0 0x7f5a301424d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5a2401bad0 tx=0x7f5a2401a1c0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f894759e640 1 -- 172.21.15.28:0/1635677950 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f89280664f0 msgr2=0x7f89280689b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.566 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f894759e640 1 --2- 172.21.15.28:0/1635677950 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f89280664f0 0x7f89280689b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f893c0b2000 tx=0x7f893c004740 comp rx=0 tx=0).stop 2023-11-28T19:31:51.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f894759e640 1 -- 172.21.15.28:0/1635677950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89480b8a00 msgr2=0x7f8948146f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f894759e640 1 --2- 172.21.15.28:0/1635677950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89480b8a00 0x7f8948146f60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f893800c500 tx=0x7f893800c9c0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f894759e640 1 -- 172.21.15.28:0/1635677950 shutdown_connections 2023-11-28T19:31:51.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f894759e640 1 --2- 172.21.15.28:0/1635677950 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f89280664f0 0x7f89280689b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f894759e640 1 --2- 172.21.15.28:0/1635677950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8948153d50 0x7f89480b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f894759e640 1 --2- 172.21.15.28:0/1635677950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89480bc9e0 0x7f8948071030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f894759e640 1 --2- 172.21.15.28:0/1635677950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89480b8a00 0x7f8948146f60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.567 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f894759e640 1 -- 172.21.15.28:0/1635677950 >> 172.21.15.28:0/1635677950 conn(0x7f89480ba2f0 msgr2=0x7f894814c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f5a15ffb640 1 -- 172.21.15.28:0/3363307551 shutdown_connections 2023-11-28T19:31:51.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f5a15ffb640 1 --2- 172.21.15.28:0/3363307551 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5a1c0664c0 0x7f5a1c068980 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f5a15ffb640 1 --2- 172.21.15.28:0/3363307551 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5a300bd1f0 0x7f5a301424d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f5a15ffb640 1 --2- 172.21.15.28:0/3363307551 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a300ba680 0x7f5a301e8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f5a15ffb640 1 --2- 172.21.15.28:0/3363307551 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5a300b8980 0x7f5a30146e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f5a15ffb640 1 -- 172.21.15.28:0/3363307551 >> 172.21.15.28:0/3363307551 conn(0x7f5a300a25a0 msgr2=0x7f5a3009edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.568 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f894759e640 1 -- 172.21.15.28:0/1635677950 shutdown_connections 2023-11-28T19:31:51.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f894759e640 1 -- 172.21.15.28:0/1635677950 wait complete. 2023-11-28T19:31:51.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f5a15ffb640 1 -- 172.21.15.28:0/3363307551 shutdown_connections 2023-11-28T19:31:51.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.563+0000 7f5a15ffb640 1 -- 172.21.15.28:0/3363307551 wait complete. 2023-11-28T19:31:51.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.567+0000 7f255ed13640 1 -- 172.21.15.28:0/3988130857 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f2558149be0 con 0x7f25580b3520 2023-11-28T19:31:51.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.567+0000 7f254e7fc640 1 -- 172.21.15.28:0/3988130857 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2550055130 con 0x7f25580b3520 2023-11-28T19:31:51.571 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-11-28T19:31:51.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.567+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3906959488 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fe1b00357f0 con 0x7fe1b0006990 2023-11-28T19:31:51.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.571+0000 7fe19f7fe640 1 -- 172.21.15.28:0/3906959488 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1ac017090 con 0x7fe1b0006990 2023-11-28T19:31:51.574 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-11-28T19:31:51.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.571+0000 7f255ed13640 1 -- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f253c066470 msgr2=0x7f253c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.571+0000 7f255ed13640 1 --2- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f253c066470 0x7f253c068930 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f25581505f0 tx=0x7f2548009040 comp rx=0 tx=0).stop 2023-11-28T19:31:51.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.571+0000 7f255ed13640 1 -- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25580b3520 msgr2=0x7f255814fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.571+0000 7f255ed13640 1 --2- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25580b3520 0x7f255814fd60 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f255000c650 tx=0x7f255000cb10 comp rx=0 tx=0).stop 2023-11-28T19:31:51.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.571+0000 7f255ed13640 1 -- 172.21.15.28:0/3988130857 shutdown_connections 2023-11-28T19:31:51.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.571+0000 7f255ed13640 1 --2- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f253c066470 0x7f253c068930 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.571+0000 7f255ed13640 1 --2- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2558153800 0x7f255814a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.571+0000 7f255ed13640 1 --2- 172.21.15.28:0/3988130857 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f25580b70b0 0x7f255814a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.571+0000 7f255ed13640 1 --2- 172.21.15.28:0/3988130857 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f25580b3520 0x7f255814fd60 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.571+0000 7f255ed13640 1 -- 172.21.15.28:0/3988130857 >> 172.21.15.28:0/3988130857 conn(0x7f25580bc7b0 msgr2=0x7f2558141840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.571+0000 7f255ed13640 1 -- 172.21.15.28:0/3988130857 shutdown_connections 2023-11-28T19:31:51.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.571+0000 7f255ed13640 1 -- 172.21.15.28:0/3988130857 wait complete. 2023-11-28T19:31:51.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.575+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3906959488 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe1a40664a0 msgr2=0x7fe1a4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.575+0000 7fe1bc91c640 1 --2- 172.21.15.28:0/3906959488 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe1a40664a0 0x7fe1a4068960 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00422e0 tx=0x7fe1a8007d40 comp rx=0 tx=0).stop 2023-11-28T19:31:51.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.575+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3906959488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1b0006990 msgr2=0x7fe1b0036b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.575+0000 7fe1bc91c640 1 --2- 172.21.15.28:0/3906959488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1b0006990 0x7fe1b0036b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe1ac00c3a0 tx=0x7fe1ac00c860 comp rx=0 tx=0).stop 2023-11-28T19:31:51.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.575+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3906959488 shutdown_connections 2023-11-28T19:31:51.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.575+0000 7fe1bc91c640 1 --2- 172.21.15.28:0/3906959488 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe1a40664a0 0x7fe1a4068960 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.575+0000 7fe1bc91c640 1 --2- 172.21.15.28:0/3906959488 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe1b0039ed0 0x7fe1b0162780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.575+0000 7fe1bc91c640 1 --2- 172.21.15.28:0/3906959488 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe1b0039a90 0x7fe1b00c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.575+0000 7fe1bc91c640 1 --2- 172.21.15.28:0/3906959488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe1b0006990 0x7fe1b0036b30 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.575+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3906959488 >> 172.21.15.28:0/3906959488 conn(0x7fe1b0005e70 msgr2=0x7fe1b0036420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.575+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3906959488 shutdown_connections 2023-11-28T19:31:51.580 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.575+0000 7fe1bc91c640 1 -- 172.21.15.28:0/3906959488 wait complete. 2023-11-28T19:31:51.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.586+0000 7f30f359e640 1 -- 172.21.15.28:0/3176905312 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f30f40749b0 con 0x7f30f406c320 2023-11-28T19:31:51.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.590+0000 7f30e2ffd640 1 -- 172.21.15.28:0/3176905312 <== mon.2 v2:172.21.15.131:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f30ec018090 con 0x7f30f406c320 2023-11-28T19:31:51.594 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-11-28T19:31:51.594 DEBUG:teuthology.parallel:result is None 2023-11-28T19:31:51.597 INFO:teuthology.orchestra.run.smithi028.stdout:55834574855 2023-11-28T19:31:51.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.594+0000 7f30e0ff9640 1 -- 172.21.15.28:0/3176905312 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f30d40664c0 msgr2=0x7f30d4068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.594+0000 7f30e0ff9640 1 --2- 172.21.15.28:0/3176905312 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f30d40664c0 0x7f30d4068980 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f30e40b0000 tx=0x7f30e40a8070 comp rx=0 tx=0).stop 2023-11-28T19:31:51.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.594+0000 7f30e0ff9640 1 -- 172.21.15.28:0/3176905312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30f406c320 msgr2=0x7f30f414a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.594+0000 7f30e0ff9640 1 --2- 172.21.15.28:0/3176905312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30f406c320 0x7f30f414a2a0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f30ec00c8c0 tx=0x7f30ec00cd80 comp rx=0 tx=0).stop 2023-11-28T19:31:51.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.594+0000 7f30e0ff9640 1 -- 172.21.15.28:0/3176905312 shutdown_connections 2023-11-28T19:31:51.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.594+0000 7f30e0ff9640 1 --2- 172.21.15.28:0/3176905312 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f30d40664c0 0x7f30d4068980 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.594+0000 7f30e0ff9640 1 --2- 172.21.15.28:0/3176905312 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f30f40b7490 0x7f30f40a1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.594+0000 7f30e0ff9640 1 --2- 172.21.15.28:0/3176905312 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f30f406c320 0x7f30f414a2a0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.594+0000 7f30e0ff9640 1 --2- 172.21.15.28:0/3176905312 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30f406bf40 0x7f30f40a0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.594+0000 7f30e0ff9640 1 -- 172.21.15.28:0/3176905312 >> 172.21.15.28:0/3176905312 conn(0x7f30f40bc7f0 msgr2=0x7f30f409cef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.594+0000 7f30e0ff9640 1 -- 172.21.15.28:0/3176905312 shutdown_connections 2023-11-28T19:31:51.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.594+0000 7f30e0ff9640 1 -- 172.21.15.28:0/3176905312 wait complete. 2023-11-28T19:31:51.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.594+0000 7f523bfff640 1 -- 172.21.15.28:0/2207623688 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f521c005510 con 0x7f523c0bc9e0 2023-11-28T19:31:51.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f78b6501640 1 -- 172.21.15.28:0/2496496539 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f78900057e0 con 0x7f78b009bfe0 2023-11-28T19:31:51.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f5223fff640 1 -- 172.21.15.28:0/2207623688 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5234050c70 con 0x7f523c0bc9e0 2023-11-28T19:31:51.602 INFO:teuthology.orchestra.run.smithi028.stdout:55834574853 2023-11-28T19:31:51.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f78acff9640 1 -- 172.21.15.28:0/2496496539 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78a80be020 con 0x7f78b009bfe0 2023-11-28T19:31:51.603 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-11-28T19:31:51.603 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2023-11-28T19:31:51.604 DEBUG:teuthology.parallel:result is None 2023-11-28T19:31:51.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f523bfff640 1 -- 172.21.15.28:0/2207623688 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5228066540 msgr2=0x7f5228068a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f523bfff640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5228066540 0x7f5228068a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f522c0011f0 tx=0x7f522c007d40 comp rx=0 tx=0).stop 2023-11-28T19:31:51.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f523bfff640 1 -- 172.21.15.28:0/2207623688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0bc9e0 msgr2=0x7f523c0b3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f523bfff640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0bc9e0 0x7f523c0b3500 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f523400c7d0 tx=0x7f523400cc90 comp rx=0 tx=0).stop 2023-11-28T19:31:51.604 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f523bfff640 1 -- 172.21.15.28:0/2207623688 shutdown_connections 2023-11-28T19:31:51.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f523bfff640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5228066540 0x7f5228068a00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f523bfff640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f523c154d60 0x7f523c0b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f523bfff640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f523c0bc9e0 0x7f523c0b3500 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f523bfff640 1 --2- 172.21.15.28:0/2207623688 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f523c0b8a00 0x7f523c147400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f523bfff640 1 -- 172.21.15.28:0/2207623688 >> 172.21.15.28:0/2207623688 conn(0x7f523c0ba2f0 msgr2=0x7f523c06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f523bfff640 1 -- 172.21.15.28:0/2207623688 shutdown_connections 2023-11-28T19:31:51.605 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.598+0000 7f523bfff640 1 -- 172.21.15.28:0/2207623688 wait complete. 2023-11-28T19:31:51.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.602+0000 7f78b6501640 1 -- 172.21.15.28:0/2496496539 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f789c0664c0 msgr2=0x7f789c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.602+0000 7f78b6501640 1 --2- 172.21.15.28:0/2496496539 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f789c0664c0 0x7f789c068980 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f78b014d7a0 tx=0x7f78a4009040 comp rx=0 tx=0).stop 2023-11-28T19:31:51.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.602+0000 7f78b6501640 1 -- 172.21.15.28:0/2496496539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78b009bfe0 msgr2=0x7f78b0139df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.602+0000 7f78b6501640 1 --2- 172.21.15.28:0/2496496539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78b009bfe0 0x7f78b0139df0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f78a801cd60 tx=0x7f78a801bed0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.602+0000 7f78b6501640 1 -- 172.21.15.28:0/2496496539 shutdown_connections 2023-11-28T19:31:51.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.602+0000 7f78b6501640 1 --2- 172.21.15.28:0/2496496539 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f789c0664c0 0x7f789c068980 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.602+0000 7f78b6501640 1 --2- 172.21.15.28:0/2496496539 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78b0153440 0x7f78b009e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.602+0000 7f78b6501640 1 --2- 172.21.15.28:0/2496496539 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f78b014fe80 0x7f78b009c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.602+0000 7f78b6501640 1 --2- 172.21.15.28:0/2496496539 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f78b009bfe0 0x7f78b0139df0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.602+0000 7f78b6501640 1 -- 172.21.15.28:0/2496496539 >> 172.21.15.28:0/2496496539 conn(0x7f78b00a25a0 msgr2=0x7f78b0099ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.602+0000 7f78b6501640 1 -- 172.21.15.28:0/2496496539 shutdown_connections 2023-11-28T19:31:51.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.602+0000 7f78b6501640 1 -- 172.21.15.28:0/2496496539 wait complete. 2023-11-28T19:31:51.608 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2023-11-28T19:31:51.608 DEBUG:teuthology.parallel:result is None 2023-11-28T19:31:51.609 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-11-28T19:31:51.609 DEBUG:teuthology.parallel:result is None 2023-11-28T19:31:51.621 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2023-11-28T19:31:51.622 DEBUG:teuthology.parallel:result is None 2023-11-28T19:31:51.624 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-11-28T19:31:51.624 DEBUG:teuthology.parallel:result is None 2023-11-28T19:31:51.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.622+0000 7fdba20ef640 1 -- 172.21.15.28:0/4065591664 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdb7c005510 con 0x7fdb940cf660 2023-11-28T19:31:51.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.622+0000 7fdb91ffb640 1 -- 172.21.15.28:0/4065591664 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdb9c067a40 con 0x7fdb940cf660 2023-11-28T19:31:51.629 INFO:teuthology.orchestra.run.smithi028.stdout:55834574854 2023-11-28T19:31:51.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.626+0000 7fdba20ef640 1 -- 172.21.15.28:0/4065591664 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdb80066470 msgr2=0x7fdb80068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.626+0000 7fdba20ef640 1 --2- 172.21.15.28:0/4065591664 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdb80066470 0x7fdb80068930 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdb98000f70 tx=0x7fdb98007f10 comp rx=0 tx=0).stop 2023-11-28T19:31:51.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.626+0000 7fdba20ef640 1 -- 172.21.15.28:0/4065591664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb940cf660 msgr2=0x7fdb941692f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.626+0000 7fdba20ef640 1 --2- 172.21.15.28:0/4065591664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb940cf660 0x7fdb941692f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c000b70 tx=0x7fdb9c0680a0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.626+0000 7fdba20ef640 1 -- 172.21.15.28:0/4065591664 shutdown_connections 2023-11-28T19:31:51.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.626+0000 7fdba20ef640 1 --2- 172.21.15.28:0/4065591664 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdb80066470 0x7fdb80068930 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.626+0000 7fdba20ef640 1 --2- 172.21.15.28:0/4065591664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb940cf660 0x7fdb941692f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.626+0000 7fdba20ef640 1 --2- 172.21.15.28:0/4065591664 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdb9403a010 0x7fdb94168db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.626+0000 7fdba20ef640 1 --2- 172.21.15.28:0/4065591664 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdb940394c0 0x7fdb94029ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.626+0000 7fdba20ef640 1 -- 172.21.15.28:0/4065591664 >> 172.21.15.28:0/4065591664 conn(0x7fdb94006ab0 msgr2=0x7fdb940cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.626+0000 7fdba20ef640 1 -- 172.21.15.28:0/4065591664 shutdown_connections 2023-11-28T19:31:51.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.626+0000 7fdba20ef640 1 -- 172.21.15.28:0/4065591664 wait complete. 2023-11-28T19:31:51.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-11-28T19:31:51.633 DEBUG:teuthology.parallel:result is None 2023-11-28T19:31:51.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-11-28T19:31:51.646 DEBUG:teuthology.parallel:result is None 2023-11-28T19:31:51.646 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-11-28T19:31:51.646 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T19:31:51.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9ca97e640 1 Processor -- start 2023-11-28T19:31:51.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9ca97e640 1 -- start start 2023-11-28T19:31:51.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9ca97e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff9c414c860 0x7ff9c40b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9ca97e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9c414ccc0 0x7ff9c40b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9ca97e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c406f780 con 0x7ff9c40b8f30 2023-11-28T19:31:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9ca97e640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9c40b6cd0 con 0x7ff9c414c860 2023-11-28T19:31:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9ca97e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c4143aa0 con 0x7ff9c414ccc0 2023-11-28T19:31:51.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c3fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ff9c40b8f30 0x7ff9c4071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49678/0 (socket says 172.21.15.28:49678) 2023-11-28T19:31:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c3fff640 1 -- 172.21.15.28:0/4019277409 learned_addr learned my addr 172.21.15.28:0/4019277409 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c8f1b640 1 --2- 172.21.15.28:0/4019277409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9c414ccc0 0x7ff9c40b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 -- 172.21.15.28:0/4019277409 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287523631 0 0) 0x7ff9b4001120 con 0x7ff9c40b8f30 2023-11-28T19:31:51.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c37fe640 1 --2- 172.21.15.28:0/4019277409 >> v2:172.21.15.131:3300/0 conn(0x7ff9c414c860 0x7ff9c40b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 -- 172.21.15.28:0/4019277409 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9ac003530 con 0x7ff9c40b8f30 2023-11-28T19:31:51.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 -- 172.21.15.28:0/4019277409 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2851962013 0 0) 0x7ff9ac003530 con 0x7ff9c40b8f30 2023-11-28T19:31:51.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 -- 172.21.15.28:0/4019277409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9c414ccc0 msgr2=0x7ff9c40b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 --2- 172.21.15.28:0/4019277409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9c414ccc0 0x7ff9c40b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 -- 172.21.15.28:0/4019277409 >> v2:172.21.15.131:3300/0 conn(0x7ff9c414c860 msgr2=0x7ff9c40b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 --2- 172.21.15.28:0/4019277409 >> v2:172.21.15.131:3300/0 conn(0x7ff9c414c860 0x7ff9c40b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 -- 172.21.15.28:0/4019277409 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4072320 con 0x7ff9c40b8f30 2023-11-28T19:31:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 -- 172.21.15.28:0/4019277409 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7ff9b4001810 con 0x7ff9c40b8f30 2023-11-28T19:31:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 -- 172.21.15.28:0/4019277409 >> v1:172.21.15.28:6789/0 conn(0x7ff9c40b8f30 legacy=0x7ff9c4071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 --2- 172.21.15.28:0/4019277409 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9ac003980 0x7ff9ac003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 --2- 172.21.15.28:0/4019277409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9c414ccc0 0x7ff9ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 --2- 172.21.15.28:0/4019277409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9ac004d10 0x7ff9ac005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 -- 172.21.15.28:0/4019277409 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c4143aa0 con 0x7ff9ac003980 2023-11-28T19:31:51.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 -- 172.21.15.28:0/4019277409 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac00b990 con 0x7ff9ac004d10 2023-11-28T19:31:51.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c2ffd640 1 -- 172.21.15.28:0/4019277409 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac00bad0 con 0x7ff9c414ccc0 2023-11-28T19:31:51.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c3fff640 1 --2- 172.21.15.28:0/4019277409 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9ac003980 0x7ff9ac003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c37fe640 1 --2- 172.21.15.28:0/4019277409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9c414ccc0 0x7ff9ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c3fff640 1 -- 172.21.15.28:0/4019277409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9c414ccc0 msgr2=0x7ff9ac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:51.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c3fff640 1 --2- 172.21.15.28:0/4019277409 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9c414ccc0 0x7ff9ac0047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c3fff640 1 -- 172.21.15.28:0/4019277409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9ac004d10 msgr2=0x7ff9ac005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:51.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c3fff640 1 --2- 172.21.15.28:0/4019277409 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9ac004d10 0x7ff9ac005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.790+0000 7ff9c3fff640 1 -- 172.21.15.28:0/4019277409 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac003530 con 0x7ff9ac003980 2023-11-28T19:31:51.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9c3fff640 1 --2- 172.21.15.28:0/4019277409 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9ac003980 0x7ff9ac003da0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c210 tx=0x7ff9b401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc260190f5cd08cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9c2ffd640 1 -- 172.21.15.28:0/4019277409 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b40058e0 con 0x7ff9ac003980 2023-11-28T19:31:51.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9c2ffd640 1 -- 172.21.15.28:0/4019277409 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b4005a40 con 0x7ff9ac003980 2023-11-28T19:31:51.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9c2ffd640 1 -- 172.21.15.28:0/4019277409 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4005df0 con 0x7ff9ac003980 2023-11-28T19:31:51.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9ca97e640 1 -- 172.21.15.28:0/4019277409 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9ac003980 msgr2=0x7ff9ac003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9ca97e640 1 --2- 172.21.15.28:0/4019277409 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9ac003980 0x7ff9ac003da0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff9b400c210 tx=0x7ff9b401cc40 comp rx=0 tx=0).stop 2023-11-28T19:31:51.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9c8f1b640 1 -- 172.21.15.28:0/4019277409 reap_dead start 2023-11-28T19:31:51.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9ca97e640 1 -- 172.21.15.28:0/4019277409 shutdown_connections 2023-11-28T19:31:51.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9ca97e640 1 -- 172.21.15.28:0/4019277409 >> 172.21.15.28:0/4019277409 conn(0x7ff9c40bcb40 msgr2=0x7ff9c40bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9ca97e640 1 -- 172.21.15.28:0/4019277409 shutdown_connections 2023-11-28T19:31:51.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9ca97e640 1 -- 172.21.15.28:0/4019277409 wait complete. 2023-11-28T19:31:51.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9ca97e640 1 Processor -- start 2023-11-28T19:31:51.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9ca97e640 1 -- start start 2023-11-28T19:31:51.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9ca97e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9ac003980 0x7ff9c4149530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9ca97e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9c414d210 0x7ff9c41e2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9ca97e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9c41e2bc0 0x7ff9c413ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9ca97e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c4149a70 con 0x7ff9ac003980 2023-11-28T19:31:51.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9ca97e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c414a010 con 0x7ff9c414d210 2023-11-28T19:31:51.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9ca97e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c414d760 con 0x7ff9c41e2bc0 2023-11-28T19:31:51.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9c3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9ac003980 0x7ff9c4149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9c3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9ac003980 0x7ff9c4149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51236/0 (socket says 172.21.15.28:51236) 2023-11-28T19:31:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.794+0000 7ff9c3fff640 1 -- 172.21.15.28:0/611138434 learned_addr learned my addr 172.21.15.28:0/611138434 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c3fff640 1 -- 172.21.15.28:0/611138434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9c41e2bc0 msgr2=0x7ff9c413ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c3fff640 1 --2- 172.21.15.28:0/611138434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9c41e2bc0 0x7ff9c413ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c3fff640 1 -- 172.21.15.28:0/611138434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9c414d210 msgr2=0x7ff9c41e2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c37fe640 1 --2- 172.21.15.28:0/611138434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9c414d210 0x7ff9c41e2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c3fff640 1 --2- 172.21.15.28:0/611138434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9c414d210 0x7ff9c41e2680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c3fff640 1 -- 172.21.15.28:0/611138434 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c414da40 con 0x7ff9ac003980 2023-11-28T19:31:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c3fff640 1 --2- 172.21.15.28:0/611138434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9ac003980 0x7ff9c4149530 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40ab040 tx=0x7ff9ac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c0ff9640 1 -- 172.21.15.28:0/611138434 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4004e90 con 0x7ff9ac003980 2023-11-28T19:31:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c0ff9640 1 -- 172.21.15.28:0/611138434 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b4005dd0 con 0x7ff9ac003980 2023-11-28T19:31:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9ca97e640 1 -- 172.21.15.28:0/611138434 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c41e2160 con 0x7ff9ac003980 2023-11-28T19:31:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c0ff9640 1 -- 172.21.15.28:0/611138434 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b40015d0 con 0x7ff9ac003980 2023-11-28T19:31:51.807 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9ca97e640 1 -- 172.21.15.28:0/611138434 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c414ea30 con 0x7ff9ac003980 2023-11-28T19:31:51.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9ca97e640 1 -- 172.21.15.28:0/611138434 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c414d8a0 con 0x7ff9ac003980 2023-11-28T19:31:51.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c0ff9640 1 -- 172.21.15.28:0/611138434 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff9b40a5720 con 0x7ff9ac003980 2023-11-28T19:31:51.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c0ff9640 1 --2- 172.21.15.28:0/611138434 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff9b00664a0 0x7ff9b0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:51.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c0ff9640 1 -- 172.21.15.28:0/611138434 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9b411cd30 con 0x7ff9ac003980 2023-11-28T19:31:51.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c37fe640 1 --2- 172.21.15.28:0/611138434 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff9b00664a0 0x7ff9b0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:51.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.798+0000 7ff9c37fe640 1 --2- 172.21.15.28:0/611138434 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff9b00664a0 0x7ff9b0068960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9c414a2e0 tx=0x7ff9b8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:51.808 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.802+0000 7ff9c0ff9640 1 -- 172.21.15.28:0/611138434 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff9c414d8a0 con 0x7ff9ac003980 2023-11-28T19:31:51.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.950+0000 7ff9ca97e640 1 -- 172.21.15.28:0/611138434 --> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff9c41e1fe0 con 0x7ff9b00664a0 2023-11-28T19:31:51.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.970+0000 7ff9c0ff9640 1 -- 172.21.15.28:0/611138434 <== mgr.4100 v2:172.21.15.131:6832/3367043860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264593 (secure 0 0 0) 0x7ff9b8009de0 con 0x7ff9b00664a0 2023-11-28T19:31:51.976 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:51.978 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-28T19:31:51.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.970+0000 7ff9ca97e640 1 -- 172.21.15.28:0/611138434 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff9b00664a0 msgr2=0x7ff9b0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.970+0000 7ff9ca97e640 1 --2- 172.21.15.28:0/611138434 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff9b00664a0 0x7ff9b0068960 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff9c414a2e0 tx=0x7ff9b8008040 comp rx=0 tx=0).stop 2023-11-28T19:31:51.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.970+0000 7ff9ca97e640 1 -- 172.21.15.28:0/611138434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9ac003980 msgr2=0x7ff9c4149530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:51.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.970+0000 7ff9ca97e640 1 --2- 172.21.15.28:0/611138434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9ac003980 0x7ff9c4149530 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40ab040 tx=0x7ff9ac005800 comp rx=0 tx=0).stop 2023-11-28T19:31:51.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.970+0000 7ff9ca97e640 1 -- 172.21.15.28:0/611138434 shutdown_connections 2023-11-28T19:31:51.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.970+0000 7ff9ca97e640 1 --2- 172.21.15.28:0/611138434 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff9b00664a0 0x7ff9b0068960 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.970+0000 7ff9ca97e640 1 --2- 172.21.15.28:0/611138434 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff9c41e2bc0 0x7ff9c413ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.970+0000 7ff9ca97e640 1 --2- 172.21.15.28:0/611138434 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9c414d210 0x7ff9c41e2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.970+0000 7ff9ca97e640 1 --2- 172.21.15.28:0/611138434 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff9ac003980 0x7ff9c4149530 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:51.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.970+0000 7ff9ca97e640 1 -- 172.21.15.28:0/611138434 >> 172.21.15.28:0/611138434 conn(0x7ff9c40bcb40 msgr2=0x7ff9c41420e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:51.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.970+0000 7ff9ca97e640 1 -- 172.21.15.28:0/611138434 shutdown_connections 2023-11-28T19:31:51.980 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:51.970+0000 7ff9ca97e640 1 -- 172.21.15.28:0/611138434 wait complete. 2023-11-28T19:31:51.992 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-28T19:31:51.136612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235720,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739000,"statfs":{"total":773094113280,"available":772852736000,"internally_reserved":0,"allocated":2990080,"data_stored":1790204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.920032"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536482+0000","last_change":"2023-11-28T19:31:45.117939+0000","last_active":"2023-11-28T19:31:47.536482+0000","last_peered":"2023-11-28T19:31:47.536482+0000","last_clean":"2023-11-28T19:31:47.536482+0000","last_became_active":"2023-11-28T19:31:45.116596+0000","last_became_peered":"2023-11-28T19:31:45.116596+0000","last_unstale":"2023-11-28T19:31:47.536482+0000","last_undegraded":"2023-11-28T19:31:47.536482+0000","last_fullsized":"2023-11-28T19:31:47.536482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:19.825586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535628+0000","last_change":"2023-11-28T19:31:45.108670+0000","last_active":"2023-11-28T19:31:47.535628+0000","last_peered":"2023-11-28T19:31:47.535628+0000","last_clean":"2023-11-28T19:31:47.535628+0000","last_became_active":"2023-11-28T19:31:45.107887+0000","last_became_peered":"2023-11-28T19:31:45.107887+0000","last_unstale":"2023-11-28T19:31:47.535628+0000","last_undegraded":"2023-11-28T19:31:47.535628+0000","last_fullsized":"2023-11-28T19:31:47.535628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535253+0000","last_change":"2023-11-28T19:31:45.114729+0000","last_active":"2023-11-28T19:31:47.535253+0000","last_peered":"2023-11-28T19:31:47.535253+0000","last_clean":"2023-11-28T19:31:47.535253+0000","last_became_active":"2023-11-28T19:31:45.113974+0000","last_became_peered":"2023-11-28T19:31:45.113974+0000","last_unstale":"2023-11-28T19:31:47.535253+0000","last_undegraded":"2023-11-28T19:31:47.535253+0000","last_fullsized":"2023-11-28T19:31:47.535253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081481+0000","last_change":"2023-11-28T19:31:45.127387+0000","last_active":"2023-11-28T19:31:46.081481+0000","last_peered":"2023-11-28T19:31:46.081481+0000","last_clean":"2023-11-28T19:31:46.081481+0000","last_became_active":"2023-11-28T19:31:45.126614+0000","last_became_peered":"2023-11-28T19:31:45.126614+0000","last_unstale":"2023-11-28T19:31:46.081481+0000","last_undegraded":"2023-11-28T19:31:46.081481+0000","last_fullsized":"2023-11-28T19:31:46.081481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:03.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535591+0000","last_change":"2023-11-28T19:31:45.100132+0000","last_active":"2023-11-28T19:31:47.535591+0000","last_peered":"2023-11-28T19:31:47.535591+0000","last_clean":"2023-11-28T19:31:47.535591+0000","last_became_active":"2023-11-28T19:31:45.099229+0000","last_became_peered":"2023-11-28T19:31:45.099229+0000","last_unstale":"2023-11-28T19:31:47.535591+0000","last_undegraded":"2023-11-28T19:31:47.535591+0000","last_fullsized":"2023-11-28T19:31:47.535591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:29.133063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081218+0000","last_change":"2023-11-28T19:31:45.125593+0000","last_active":"2023-11-28T19:31:46.081218+0000","last_peered":"2023-11-28T19:31:46.081218+0000","last_clean":"2023-11-28T19:31:46.081218+0000","last_became_active":"2023-11-28T19:31:45.124811+0000","last_became_peered":"2023-11-28T19:31:45.124811+0000","last_unstale":"2023-11-28T19:31:46.081218+0000","last_undegraded":"2023-11-28T19:31:46.081218+0000","last_fullsized":"2023-11-28T19:31:46.081218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:59:45.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.534522+0000","last_change":"2023-11-28T19:31:45.104970+0000","last_active":"2023-11-28T19:31:47.534522+0000","last_peered":"2023-11-28T19:31:47.534522+0000","last_clean":"2023-11-28T19:31:47.534522+0000","last_became_active":"2023-11-28T19:31:45.104131+0000","last_became_peered":"2023-11-28T19:31:45.104131+0000","last_unstale":"2023-11-28T19:31:47.534522+0000","last_undegraded":"2023-11-28T19:31:47.534522+0000","last_fullsized":"2023-11-28T19:31:47.534522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:03.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402100+0000","last_change":"2023-11-28T19:31:45.130940+0000","last_active":"2023-11-28T19:31:46.402100+0000","last_peered":"2023-11-28T19:31:46.402100+0000","last_clean":"2023-11-28T19:31:46.402100+0000","last_became_active":"2023-11-28T19:31:45.130171+0000","last_became_peered":"2023-11-28T19:31:45.130171+0000","last_unstale":"2023-11-28T19:31:46.402100+0000","last_undegraded":"2023-11-28T19:31:46.402100+0000","last_fullsized":"2023-11-28T19:31:46.402100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:31.344915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536485+0000","last_change":"2023-11-28T19:31:45.130835+0000","last_active":"2023-11-28T19:31:47.536485+0000","last_peered":"2023-11-28T19:31:47.536485+0000","last_clean":"2023-11-28T19:31:47.536485+0000","last_became_active":"2023-11-28T19:31:45.130194+0000","last_became_peered":"2023-11-28T19:31:45.130194+0000","last_unstale":"2023-11-28T19:31:47.536485+0000","last_undegraded":"2023-11-28T19:31:47.536485+0000","last_fullsized":"2023-11-28T19:31:47.536485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:21.761617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999097+0000","last_change":"2023-11-28T19:31:45.127252+0000","last_active":"2023-11-28T19:31:46.999097+0000","last_peered":"2023-11-28T19:31:46.999097+0000","last_clean":"2023-11-28T19:31:46.999097+0000","last_became_active":"2023-11-28T19:31:45.125570+0000","last_became_peered":"2023-11-28T19:31:45.125570+0000","last_unstale":"2023-11-28T19:31:46.999097+0000","last_undegraded":"2023-11-28T19:31:46.999097+0000","last_fullsized":"2023-11-28T19:31:46.999097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998852+0000","last_change":"2023-11-28T19:31:45.127138+0000","last_active":"2023-11-28T19:31:46.998852+0000","last_peered":"2023-11-28T19:31:46.998852+0000","last_clean":"2023-11-28T19:31:46.998852+0000","last_became_active":"2023-11-28T19:31:45.126392+0000","last_became_peered":"2023-11-28T19:31:45.126392+0000","last_unstale":"2023-11-28T19:31:46.998852+0000","last_undegraded":"2023-11-28T19:31:46.998852+0000","last_fullsized":"2023-11-28T19:31:46.998852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536513+0000","last_change":"2023-11-28T19:31:45.116329+0000","last_active":"2023-11-28T19:31:47.536513+0000","last_peered":"2023-11-28T19:31:47.536513+0000","last_clean":"2023-11-28T19:31:47.536513+0000","last_became_active":"2023-11-28T19:31:45.115691+0000","last_became_peered":"2023-11-28T19:31:45.115691+0000","last_unstale":"2023-11-28T19:31:47.536513+0000","last_undegraded":"2023-11-28T19:31:47.536513+0000","last_fullsized":"2023-11-28T19:31:47.536513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:19.783090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402092+0000","last_change":"2023-11-28T19:31:45.118954+0000","last_active":"2023-11-28T19:31:46.402092+0000","last_peered":"2023-11-28T19:31:46.402092+0000","last_clean":"2023-11-28T19:31:46.402092+0000","last_became_active":"2023-11-28T19:31:45.116311+0000","last_became_peered":"2023-11-28T19:31:45.116311+0000","last_unstale":"2023-11-28T19:31:46.402092+0000","last_undegraded":"2023-11-28T19:31:46.402092+0000","last_fullsized":"2023-11-28T19:31:46.402092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:02.633458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533067+0000","last_change":"2023-11-28T19:31:45.104928+0000","last_active":"2023-11-28T19:31:47.533067+0000","last_peered":"2023-11-28T19:31:47.533067+0000","last_clean":"2023-11-28T19:31:47.533067+0000","last_became_active":"2023-11-28T19:31:45.104131+0000","last_became_peered":"2023-11-28T19:31:45.104131+0000","last_unstale":"2023-11-28T19:31:47.533067+0000","last_undegraded":"2023-11-28T19:31:47.533067+0000","last_fullsized":"2023-11-28T19:31:47.533067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:10.179262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533739+0000","last_change":"2023-11-28T19:31:45.104838+0000","last_active":"2023-11-28T19:31:47.533739+0000","last_peered":"2023-11-28T19:31:47.533739+0000","last_clean":"2023-11-28T19:31:47.533739+0000","last_became_active":"2023-11-28T19:31:45.104087+0000","last_became_peered":"2023-11-28T19:31:45.104087+0000","last_unstale":"2023-11-28T19:31:47.533739+0000","last_undegraded":"2023-11-28T19:31:47.533739+0000","last_fullsized":"2023-11-28T19:31:47.533739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:31.344915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.080886+0000","last_change":"2023-11-28T19:31:45.124848+0000","last_active":"2023-11-28T19:31:46.080886+0000","last_peered":"2023-11-28T19:31:46.080886+0000","last_clean":"2023-11-28T19:31:46.080886+0000","last_became_active":"2023-11-28T19:31:45.124031+0000","last_became_peered":"2023-11-28T19:31:45.124031+0000","last_unstale":"2023-11-28T19:31:46.080886+0000","last_undegraded":"2023-11-28T19:31:46.080886+0000","last_fullsized":"2023-11-28T19:31:46.080886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082592+0000","last_change":"2023-11-28T19:31:45.134085+0000","last_active":"2023-11-28T19:31:46.082592+0000","last_peered":"2023-11-28T19:31:46.082592+0000","last_clean":"2023-11-28T19:31:46.082592+0000","last_became_active":"2023-11-28T19:31:45.132979+0000","last_became_peered":"2023-11-28T19:31:45.132979+0000","last_unstale":"2023-11-28T19:31:46.082592+0000","last_undegraded":"2023-11-28T19:31:46.082592+0000","last_fullsized":"2023-11-28T19:31:46.082592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:11.287539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077713+0000","last_change":"2023-11-28T19:31:45.117122+0000","last_active":"2023-11-28T19:31:46.077713+0000","last_peered":"2023-11-28T19:31:46.077713+0000","last_clean":"2023-11-28T19:31:46.077713+0000","last_became_active":"2023-11-28T19:31:45.116462+0000","last_became_peered":"2023-11-28T19:31:45.116462+0000","last_unstale":"2023-11-28T19:31:46.077713+0000","last_undegraded":"2023-11-28T19:31:46.077713+0000","last_fullsized":"2023-11-28T19:31:46.077713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:55.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.537088+0000","last_change":"2023-11-28T19:31:45.114295+0000","last_active":"2023-11-28T19:31:47.537088+0000","last_peered":"2023-11-28T19:31:47.537088+0000","last_clean":"2023-11-28T19:31:47.537088+0000","last_became_active":"2023-11-28T19:31:45.113478+0000","last_became_peered":"2023-11-28T19:31:45.113478+0000","last_unstale":"2023-11-28T19:31:47.537088+0000","last_undegraded":"2023-11-28T19:31:47.537088+0000","last_fullsized":"2023-11-28T19:31:47.537088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:39:06.856700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998559+0000","last_change":"2023-11-28T19:31:45.121559+0000","last_active":"2023-11-28T19:31:46.998559+0000","last_peered":"2023-11-28T19:31:46.998559+0000","last_clean":"2023-11-28T19:31:46.998559+0000","last_became_active":"2023-11-28T19:31:45.120810+0000","last_became_peered":"2023-11-28T19:31:45.120810+0000","last_unstale":"2023-11-28T19:31:46.998559+0000","last_undegraded":"2023-11-28T19:31:46.998559+0000","last_fullsized":"2023-11-28T19:31:46.998559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:31.344915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533823+0000","last_change":"2023-11-28T19:31:45.110520+0000","last_active":"2023-11-28T19:31:47.533823+0000","last_peered":"2023-11-28T19:31:47.533823+0000","last_clean":"2023-11-28T19:31:47.533823+0000","last_became_active":"2023-11-28T19:31:45.109508+0000","last_became_peered":"2023-11-28T19:31:45.109508+0000","last_unstale":"2023-11-28T19:31:47.533823+0000","last_undegraded":"2023-11-28T19:31:47.533823+0000","last_fullsized":"2023-11-28T19:31:47.533823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:54.812488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081502+0000","last_change":"2023-11-28T19:31:45.135559+0000","last_active":"2023-11-28T19:31:46.081502+0000","last_peered":"2023-11-28T19:31:46.081502+0000","last_clean":"2023-11-28T19:31:46.081502+0000","last_became_active":"2023-11-28T19:31:45.134957+0000","last_became_peered":"2023-11-28T19:31:45.134957+0000","last_unstale":"2023-11-28T19:31:46.081502+0000","last_undegraded":"2023-11-28T19:31:46.081502+0000","last_fullsized":"2023-11-28T19:31:46.081502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:17.751045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402000+0000","last_change":"2023-11-28T19:31:45.106729+0000","last_active":"2023-11-28T19:31:46.402000+0000","last_peered":"2023-11-28T19:31:46.402000+0000","last_clean":"2023-11-28T19:31:46.402000+0000","last_became_active":"2023-11-28T19:31:45.104514+0000","last_became_peered":"2023-11-28T19:31:45.104514+0000","last_unstale":"2023-11-28T19:31:46.402000+0000","last_undegraded":"2023-11-28T19:31:46.402000+0000","last_fullsized":"2023-11-28T19:31:46.402000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:25.412721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081110+0000","last_change":"2023-11-28T19:31:45.128458+0000","last_active":"2023-11-28T19:31:46.081110+0000","last_peered":"2023-11-28T19:31:46.081110+0000","last_clean":"2023-11-28T19:31:46.081110+0000","last_became_active":"2023-11-28T19:31:45.127309+0000","last_became_peered":"2023-11-28T19:31:45.127309+0000","last_unstale":"2023-11-28T19:31:46.081110+0000","last_undegraded":"2023-11-28T19:31:46.081110+0000","last_fullsized":"2023-11-28T19:31:46.081110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402857+0000","last_change":"2023-11-28T19:31:45.106194+0000","last_active":"2023-11-28T19:31:46.402857+0000","last_peered":"2023-11-28T19:31:46.402857+0000","last_clean":"2023-11-28T19:31:46.402857+0000","last_became_active":"2023-11-28T19:31:45.105417+0000","last_became_peered":"2023-11-28T19:31:45.105417+0000","last_unstale":"2023-11-28T19:31:46.402857+0000","last_undegraded":"2023-11-28T19:31:46.402857+0000","last_fullsized":"2023-11-28T19:31:46.402857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:17.751045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999358+0000","last_change":"2023-11-28T19:31:45.113263+0000","last_active":"2023-11-28T19:31:46.999358+0000","last_peered":"2023-11-28T19:31:46.999358+0000","last_clean":"2023-11-28T19:31:46.999358+0000","last_became_active":"2023-11-28T19:31:45.112503+0000","last_became_peered":"2023-11-28T19:31:45.112503+0000","last_unstale":"2023-11-28T19:31:46.999358+0000","last_undegraded":"2023-11-28T19:31:46.999358+0000","last_fullsized":"2023-11-28T19:31:46.999358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:59:45.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535452+0000","last_change":"2023-11-28T19:31:45.102175+0000","last_active":"2023-11-28T19:31:47.535452+0000","last_peered":"2023-11-28T19:31:47.535452+0000","last_clean":"2023-11-28T19:31:47.535452+0000","last_became_active":"2023-11-28T19:31:45.101399+0000","last_became_peered":"2023-11-28T19:31:45.101399+0000","last_unstale":"2023-11-28T19:31:47.535452+0000","last_undegraded":"2023-11-28T19:31:47.535452+0000","last_fullsized":"2023-11-28T19:31:47.535452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402766+0000","last_change":"2023-11-28T19:31:45.105446+0000","last_active":"2023-11-28T19:31:46.402766+0000","last_peered":"2023-11-28T19:31:46.402766+0000","last_clean":"2023-11-28T19:31:46.402766+0000","last_became_active":"2023-11-28T19:31:45.103114+0000","last_became_peered":"2023-11-28T19:31:45.103114+0000","last_unstale":"2023-11-28T19:31:46.402766+0000","last_undegraded":"2023-11-28T19:31:46.402766+0000","last_fullsized":"2023-11-28T19:31:46.402766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:03.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.534159+0000","last_change":"2023-11-28T19:31:45.102194+0000","last_active":"2023-11-28T19:31:47.534159+0000","last_peered":"2023-11-28T19:31:47.534159+0000","last_clean":"2023-11-28T19:31:47.534159+0000","last_became_active":"2023-11-28T19:31:45.101351+0000","last_became_peered":"2023-11-28T19:31:45.101351+0000","last_unstale":"2023-11-28T19:31:47.534159+0000","last_undegraded":"2023-11-28T19:31:47.534159+0000","last_fullsized":"2023-11-28T19:31:47.534159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:25.412721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081971+0000","last_change":"2023-11-28T19:31:45.126943+0000","last_active":"2023-11-28T19:31:46.081971+0000","last_peered":"2023-11-28T19:31:46.081971+0000","last_clean":"2023-11-28T19:31:46.081971+0000","last_became_active":"2023-11-28T19:31:45.126265+0000","last_became_peered":"2023-11-28T19:31:45.126265+0000","last_unstale":"2023-11-28T19:31:46.081971+0000","last_undegraded":"2023-11-28T19:31:46.081971+0000","last_fullsized":"2023-11-28T19:31:46.081971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:29.133063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077767+0000","last_change":"2023-11-28T19:31:45.126324+0000","last_active":"2023-11-28T19:31:46.077767+0000","last_peered":"2023-11-28T19:31:46.077767+0000","last_clean":"2023-11-28T19:31:46.077767+0000","last_became_active":"2023-11-28T19:31:45.125509+0000","last_became_peered":"2023-11-28T19:31:45.125509+0000","last_unstale":"2023-11-28T19:31:46.077767+0000","last_undegraded":"2023-11-28T19:31:46.077767+0000","last_fullsized":"2023-11-28T19:31:46.077767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:39.981654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998359+0000","last_change":"2023-11-28T19:31:45.114020+0000","last_active":"2023-11-28T19:31:46.998359+0000","last_peered":"2023-11-28T19:31:46.998359+0000","last_clean":"2023-11-28T19:31:46.998359+0000","last_became_active":"2023-11-28T19:31:45.113322+0000","last_became_peered":"2023-11-28T19:31:45.113322+0000","last_unstale":"2023-11-28T19:31:46.998359+0000","last_undegraded":"2023-11-28T19:31:46.998359+0000","last_fullsized":"2023-11-28T19:31:46.998359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:25.412721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535289+0000","last_change":"2023-11-28T19:31:45.099021+0000","last_active":"2023-11-28T19:31:47.535289+0000","last_peered":"2023-11-28T19:31:47.535289+0000","last_clean":"2023-11-28T19:31:47.535289+0000","last_became_active":"2023-11-28T19:31:45.098188+0000","last_became_peered":"2023-11-28T19:31:45.098188+0000","last_unstale":"2023-11-28T19:31:47.535289+0000","last_undegraded":"2023-11-28T19:31:47.535289+0000","last_fullsized":"2023-11-28T19:31:47.535289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:27.231075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402337+0000","last_change":"2023-11-28T19:31:44.264140+0000","last_active":"2023-11-28T19:31:46.402337+0000","last_peered":"2023-11-28T19:31:46.402337+0000","last_clean":"2023-11-28T19:31:46.402337+0000","last_became_active":"2023-11-28T19:31:44.263733+0000","last_became_peered":"2023-11-28T19:31:44.263733+0000","last_unstale":"2023-11-28T19:31:46.402337+0000","last_undegraded":"2023-11-28T19:31:46.402337+0000","last_fullsized":"2023-11-28T19:31:46.402337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:18.770787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.534476+0000","last_change":"2023-11-28T19:31:45.120512+0000","last_active":"2023-11-28T19:31:47.534476+0000","last_peered":"2023-11-28T19:31:47.534476+0000","last_clean":"2023-11-28T19:31:47.534476+0000","last_became_active":"2023-11-28T19:31:45.119585+0000","last_became_peered":"2023-11-28T19:31:45.119585+0000","last_unstale":"2023-11-28T19:31:47.534476+0000","last_undegraded":"2023-11-28T19:31:47.534476+0000","last_fullsized":"2023-11-28T19:31:47.534476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:41.003464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998328+0000","last_change":"2023-11-28T19:31:44.262529+0000","last_active":"2023-11-28T19:31:46.998328+0000","last_peered":"2023-11-28T19:31:46.998328+0000","last_clean":"2023-11-28T19:31:46.998328+0000","last_became_active":"2023-11-28T19:31:44.261833+0000","last_became_peered":"2023-11-28T19:31:44.261833+0000","last_unstale":"2023-11-28T19:31:46.998328+0000","last_undegraded":"2023-11-28T19:31:46.998328+0000","last_fullsized":"2023-11-28T19:31:46.998328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.401940+0000","last_change":"2023-11-28T19:31:44.247016+0000","last_active":"2023-11-28T19:31:46.401940+0000","last_peered":"2023-11-28T19:31:46.401940+0000","last_clean":"2023-11-28T19:31:46.401940+0000","last_became_active":"2023-11-28T19:31:44.246381+0000","last_became_peered":"2023-11-28T19:31:44.246381+0000","last_unstale":"2023-11-28T19:31:46.401940+0000","last_undegraded":"2023-11-28T19:31:46.401940+0000","last_fullsized":"2023-11-28T19:31:46.401940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:09.166959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402003+0000","last_change":"2023-11-28T19:31:45.118713+0000","last_active":"2023-11-28T19:31:46.402003+0000","last_peered":"2023-11-28T19:31:46.402003+0000","last_clean":"2023-11-28T19:31:46.402003+0000","last_became_active":"2023-11-28T19:31:45.114163+0000","last_became_peered":"2023-11-28T19:31:45.114163+0000","last_unstale":"2023-11-28T19:31:46.402003+0000","last_undegraded":"2023-11-28T19:31:46.402003+0000","last_fullsized":"2023-11-28T19:31:46.402003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:41.003464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081114+0000","last_change":"2023-11-28T19:31:44.262743+0000","last_active":"2023-11-28T19:31:46.081114+0000","last_peered":"2023-11-28T19:31:46.081114+0000","last_clean":"2023-11-28T19:31:46.081114+0000","last_became_active":"2023-11-28T19:31:44.261828+0000","last_became_peered":"2023-11-28T19:31:44.261828+0000","last_unstale":"2023-11-28T19:31:46.081114+0000","last_undegraded":"2023-11-28T19:31:46.081114+0000","last_fullsized":"2023-11-28T19:31:46.081114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:13.596047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533384+0000","last_change":"2023-11-28T19:31:45.102566+0000","last_active":"2023-11-28T19:31:47.533384+0000","last_peered":"2023-11-28T19:31:47.533384+0000","last_clean":"2023-11-28T19:31:47.533384+0000","last_became_active":"2023-11-28T19:31:45.101723+0000","last_became_peered":"2023-11-28T19:31:45.101723+0000","last_unstale":"2023-11-28T19:31:47.533384+0000","last_undegraded":"2023-11-28T19:31:47.533384+0000","last_fullsized":"2023-11-28T19:31:47.533384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:41.003464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999059+0000","last_change":"2023-11-28T19:31:44.265457+0000","last_active":"2023-11-28T19:31:46.999059+0000","last_peered":"2023-11-28T19:31:46.999059+0000","last_clean":"2023-11-28T19:31:46.999059+0000","last_became_active":"2023-11-28T19:31:44.264577+0000","last_became_peered":"2023-11-28T19:31:44.264577+0000","last_unstale":"2023-11-28T19:31:46.999059+0000","last_undegraded":"2023-11-28T19:31:46.999059+0000","last_fullsized":"2023-11-28T19:31:46.999059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:22:57.628821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082306+0000","last_change":"2023-11-28T19:31:45.133755+0000","last_active":"2023-11-28T19:31:46.082306+0000","last_peered":"2023-11-28T19:31:46.082306+0000","last_clean":"2023-11-28T19:31:46.082306+0000","last_became_active":"2023-11-28T19:31:45.132947+0000","last_became_peered":"2023-11-28T19:31:45.132947+0000","last_unstale":"2023-11-28T19:31:46.082306+0000","last_undegraded":"2023-11-28T19:31:46.082306+0000","last_fullsized":"2023-11-28T19:31:46.082306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:28:56.420413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082283+0000","last_change":"2023-11-28T19:31:44.271305+0000","last_active":"2023-11-28T19:31:46.082283+0000","last_peered":"2023-11-28T19:31:46.082283+0000","last_clean":"2023-11-28T19:31:46.082283+0000","last_became_active":"2023-11-28T19:31:44.270176+0000","last_became_peered":"2023-11-28T19:31:44.270176+0000","last_unstale":"2023-11-28T19:31:46.082283+0000","last_undegraded":"2023-11-28T19:31:46.082283+0000","last_fullsized":"2023-11-28T19:31:46.082283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:26.218772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535105+0000","last_change":"2023-11-28T19:31:45.127548+0000","last_active":"2023-11-28T19:31:47.535105+0000","last_peered":"2023-11-28T19:31:47.535105+0000","last_clean":"2023-11-28T19:31:47.535105+0000","last_became_active":"2023-11-28T19:31:45.126841+0000","last_became_peered":"2023-11-28T19:31:45.126841+0000","last_unstale":"2023-11-28T19:31:47.535105+0000","last_undegraded":"2023-11-28T19:31:47.535105+0000","last_fullsized":"2023-11-28T19:31:47.535105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.169947+0000","last_change":"2023-11-28T19:31:44.260935+0000","last_active":"2023-11-28T19:31:47.169947+0000","last_peered":"2023-11-28T19:31:47.169947+0000","last_clean":"2023-11-28T19:31:47.169947+0000","last_became_active":"2023-11-28T19:31:44.260504+0000","last_became_peered":"2023-11-28T19:31:44.260504+0000","last_unstale":"2023-11-28T19:31:47.169947+0000","last_undegraded":"2023-11-28T19:31:47.169947+0000","last_fullsized":"2023-11-28T19:31:47.169947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:54.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536677+0000","last_change":"2023-11-28T19:31:45.109031+0000","last_active":"2023-11-28T19:31:47.536677+0000","last_peered":"2023-11-28T19:31:47.536677+0000","last_clean":"2023-11-28T19:31:47.536677+0000","last_became_active":"2023-11-28T19:31:45.104913+0000","last_became_peered":"2023-11-28T19:31:45.104913+0000","last_unstale":"2023-11-28T19:31:47.536677+0000","last_undegraded":"2023-11-28T19:31:47.536677+0000","last_fullsized":"2023-11-28T19:31:47.536677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:55.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998735+0000","last_change":"2023-11-28T19:31:44.250020+0000","last_active":"2023-11-28T19:31:46.998735+0000","last_peered":"2023-11-28T19:31:46.998735+0000","last_clean":"2023-11-28T19:31:46.998735+0000","last_became_active":"2023-11-28T19:31:44.247440+0000","last_became_peered":"2023-11-28T19:31:44.247440+0000","last_unstale":"2023-11-28T19:31:46.998735+0000","last_undegraded":"2023-11-28T19:31:46.998735+0000","last_fullsized":"2023-11-28T19:31:46.998735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:38.969351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536753+0000","last_change":"2023-11-28T19:31:45.108120+0000","last_active":"2023-11-28T19:31:47.536753+0000","last_peered":"2023-11-28T19:31:47.536753+0000","last_clean":"2023-11-28T19:31:47.536753+0000","last_became_active":"2023-11-28T19:31:45.107361+0000","last_became_peered":"2023-11-28T19:31:45.107361+0000","last_unstale":"2023-11-28T19:31:47.536753+0000","last_undegraded":"2023-11-28T19:31:47.536753+0000","last_fullsized":"2023-11-28T19:31:47.536753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:28:56.420413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.169168+0000","last_change":"2023-11-28T19:31:44.232624+0000","last_active":"2023-11-28T19:31:47.169168+0000","last_peered":"2023-11-28T19:31:47.169168+0000","last_clean":"2023-11-28T19:31:47.169168+0000","last_became_active":"2023-11-28T19:31:44.231887+0000","last_became_peered":"2023-11-28T19:31:44.231887+0000","last_unstale":"2023-11-28T19:31:47.169168+0000","last_undegraded":"2023-11-28T19:31:47.169168+0000","last_fullsized":"2023-11-28T19:31:47.169168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533213+0000","last_change":"2023-11-28T19:31:45.103017+0000","last_active":"2023-11-28T19:31:47.533213+0000","last_peered":"2023-11-28T19:31:47.533213+0000","last_clean":"2023-11-28T19:31:47.533213+0000","last_became_active":"2023-11-28T19:31:45.102246+0000","last_became_peered":"2023-11-28T19:31:45.102246+0000","last_unstale":"2023-11-28T19:31:47.533213+0000","last_undegraded":"2023-11-28T19:31:47.533213+0000","last_fullsized":"2023-11-28T19:31:47.533213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:22:58.641123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081739+0000","last_change":"2023-11-28T19:31:44.260611+0000","last_active":"2023-11-28T19:31:46.081739+0000","last_peered":"2023-11-28T19:31:46.081739+0000","last_clean":"2023-11-28T19:31:46.081739+0000","last_became_active":"2023-11-28T19:31:44.259673+0000","last_became_peered":"2023-11-28T19:31:44.259673+0000","last_unstale":"2023-11-28T19:31:46.081739+0000","last_undegraded":"2023-11-28T19:31:46.081739+0000","last_fullsized":"2023-11-28T19:31:46.081739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:24.400418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535916+0000","last_change":"2023-11-28T19:31:45.119213+0000","last_active":"2023-11-28T19:31:47.535916+0000","last_peered":"2023-11-28T19:31:47.535916+0000","last_clean":"2023-11-28T19:31:47.535916+0000","last_became_active":"2023-11-28T19:31:45.118566+0000","last_became_peered":"2023-11-28T19:31:45.118566+0000","last_unstale":"2023-11-28T19:31:47.535916+0000","last_undegraded":"2023-11-28T19:31:47.535916+0000","last_fullsized":"2023-11-28T19:31:47.535916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:33:50.981202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998481+0000","last_change":"2023-11-28T19:31:44.264660+0000","last_active":"2023-11-28T19:31:46.998481+0000","last_peered":"2023-11-28T19:31:46.998481+0000","last_clean":"2023-11-28T19:31:46.998481+0000","last_became_active":"2023-11-28T19:31:44.263913+0000","last_became_peered":"2023-11-28T19:31:44.263913+0000","last_unstale":"2023-11-28T19:31:46.998481+0000","last_undegraded":"2023-11-28T19:31:46.998481+0000","last_fullsized":"2023-11-28T19:31:46.998481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:09.166959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998511+0000","last_change":"2023-11-28T19:31:45.114551+0000","last_active":"2023-11-28T19:31:46.998511+0000","last_peered":"2023-11-28T19:31:46.998511+0000","last_clean":"2023-11-28T19:31:46.998511+0000","last_became_active":"2023-11-28T19:31:45.112479+0000","last_became_peered":"2023-11-28T19:31:45.112479+0000","last_unstale":"2023-11-28T19:31:46.998511+0000","last_undegraded":"2023-11-28T19:31:46.998511+0000","last_fullsized":"2023-11-28T19:31:46.998511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:02.633458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077642+0000","last_change":"2023-11-28T19:31:44.252177+0000","last_active":"2023-11-28T19:31:46.077642+0000","last_peered":"2023-11-28T19:31:46.077642+0000","last_clean":"2023-11-28T19:31:46.077642+0000","last_became_active":"2023-11-28T19:31:44.251637+0000","last_became_peered":"2023-11-28T19:31:44.251637+0000","last_unstale":"2023-11-28T19:31:46.077642+0000","last_undegraded":"2023-11-28T19:31:46.077642+0000","last_fullsized":"2023-11-28T19:31:46.077642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:35.357511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.534729+0000","last_change":"2023-11-28T19:31:45.123799+0000","last_active":"2023-11-28T19:31:47.534729+0000","last_peered":"2023-11-28T19:31:47.534729+0000","last_clean":"2023-11-28T19:31:47.534729+0000","last_became_active":"2023-11-28T19:31:45.123023+0000","last_became_peered":"2023-11-28T19:31:45.123023+0000","last_unstale":"2023-11-28T19:31:47.534729+0000","last_undegraded":"2023-11-28T19:31:47.534729+0000","last_fullsized":"2023-11-28T19:31:47.534729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:17.751045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.163771+0000","last_change":"2023-11-28T19:31:44.247638+0000","last_active":"2023-11-28T19:31:47.163771+0000","last_peered":"2023-11-28T19:31:47.163771+0000","last_clean":"2023-11-28T19:31:47.163771+0000","last_became_active":"2023-11-28T19:31:44.244818+0000","last_became_peered":"2023-11-28T19:31:44.244818+0000","last_unstale":"2023-11-28T19:31:47.163771+0000","last_undegraded":"2023-11-28T19:31:47.163771+0000","last_fullsized":"2023-11-28T19:31:47.163771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:35.357511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535833+0000","last_change":"2023-11-28T19:31:45.119195+0000","last_active":"2023-11-28T19:31:47.535833+0000","last_peered":"2023-11-28T19:31:47.535833+0000","last_clean":"2023-11-28T19:31:47.535833+0000","last_became_active":"2023-11-28T19:31:45.118457+0000","last_became_peered":"2023-11-28T19:31:45.118457+0000","last_unstale":"2023-11-28T19:31:47.535833+0000","last_undegraded":"2023-11-28T19:31:47.535833+0000","last_fullsized":"2023-11-28T19:31:47.535833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:28:05.070597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077969+0000","last_change":"2023-11-28T19:31:44.237773+0000","last_active":"2023-11-28T19:31:46.077969+0000","last_peered":"2023-11-28T19:31:46.077969+0000","last_clean":"2023-11-28T19:31:46.077969+0000","last_became_active":"2023-11-28T19:31:44.237376+0000","last_became_peered":"2023-11-28T19:31:44.237376+0000","last_unstale":"2023-11-28T19:31:46.077969+0000","last_undegraded":"2023-11-28T19:31:46.077969+0000","last_fullsized":"2023-11-28T19:31:46.077969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:18.770787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536865+0000","last_change":"2023-11-28T19:31:45.133333+0000","last_active":"2023-11-28T19:31:47.536865+0000","last_peered":"2023-11-28T19:31:47.536865+0000","last_clean":"2023-11-28T19:31:47.536865+0000","last_became_active":"2023-11-28T19:31:45.132771+0000","last_became_peered":"2023-11-28T19:31:45.132771+0000","last_unstale":"2023-11-28T19:31:47.536865+0000","last_undegraded":"2023-11-28T19:31:47.536865+0000","last_fullsized":"2023-11-28T19:31:47.536865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:11.287539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.169975+0000","last_change":"2023-11-28T19:31:44.262514+0000","last_active":"2023-11-28T19:31:47.169975+0000","last_peered":"2023-11-28T19:31:47.169975+0000","last_clean":"2023-11-28T19:31:47.169975+0000","last_became_active":"2023-11-28T19:31:44.262050+0000","last_became_peered":"2023-11-28T19:31:44.262050+0000","last_unstale":"2023-11-28T19:31:47.169975+0000","last_undegraded":"2023-11-28T19:31:47.169975+0000","last_fullsized":"2023-11-28T19:31:47.169975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082192+0000","last_change":"2023-11-28T19:31:45.128723+0000","last_active":"2023-11-28T19:31:46.082192+0000","last_peered":"2023-11-28T19:31:46.082192+0000","last_clean":"2023-11-28T19:31:46.082192+0000","last_became_active":"2023-11-28T19:31:45.128010+0000","last_became_peered":"2023-11-28T19:31:45.128010+0000","last_unstale":"2023-11-28T19:31:46.082192+0000","last_undegraded":"2023-11-28T19:31:46.082192+0000","last_fullsized":"2023-11-28T19:31:46.082192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:21.761617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077647+0000","last_change":"2023-11-28T19:31:44.260788+0000","last_active":"2023-11-28T19:31:46.077647+0000","last_peered":"2023-11-28T19:31:46.077647+0000","last_clean":"2023-11-28T19:31:46.077647+0000","last_became_active":"2023-11-28T19:31:44.260313+0000","last_became_peered":"2023-11-28T19:31:44.260313+0000","last_unstale":"2023-11-28T19:31:46.077647+0000","last_undegraded":"2023-11-28T19:31:46.077647+0000","last_fullsized":"2023-11-28T19:31:46.077647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:22.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536881+0000","last_change":"2023-11-28T19:31:45.131013+0000","last_active":"2023-11-28T19:31:47.536881+0000","last_peered":"2023-11-28T19:31:47.536881+0000","last_clean":"2023-11-28T19:31:47.536881+0000","last_became_active":"2023-11-28T19:31:45.130317+0000","last_became_peered":"2023-11-28T19:31:45.130317+0000","last_unstale":"2023-11-28T19:31:47.536881+0000","last_undegraded":"2023-11-28T19:31:47.536881+0000","last_fullsized":"2023-11-28T19:31:47.536881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:49:24.093530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.084091+0000","last_change":"2023-11-28T19:31:35.378105+0000","last_active":"2023-11-28T19:31:45.084091+0000","last_peered":"2023-11-28T19:31:45.084091+0000","last_clean":"2023-11-28T19:31:45.084091+0000","last_became_active":"2023-11-28T19:31:35.375035+0000","last_became_peered":"2023-11-28T19:31:35.375035+0000","last_unstale":"2023-11-28T19:31:45.084091+0000","last_undegraded":"2023-11-28T19:31:45.084091+0000","last_fullsized":"2023-11-28T19:31:45.084091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_clean_scrub_stamp":"2023-11-28T19:31:33.813158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:07.043315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081118+0000","last_change":"2023-11-28T19:31:44.261114+0000","last_active":"2023-11-28T19:31:46.081118+0000","last_peered":"2023-11-28T19:31:46.081118+0000","last_clean":"2023-11-28T19:31:46.081118+0000","last_became_active":"2023-11-28T19:31:44.260407+0000","last_became_peered":"2023-11-28T19:31:44.260407+0000","last_unstale":"2023-11-28T19:31:46.081118+0000","last_undegraded":"2023-11-28T19:31:46.081118+0000","last_fullsized":"2023-11-28T19:31:46.081118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:53.627798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402195+0000","last_change":"2023-11-28T19:31:45.128856+0000","last_active":"2023-11-28T19:31:46.402195+0000","last_peered":"2023-11-28T19:31:46.402195+0000","last_clean":"2023-11-28T19:31:46.402195+0000","last_became_active":"2023-11-28T19:31:45.128241+0000","last_became_peered":"2023-11-28T19:31:45.128241+0000","last_unstale":"2023-11-28T19:31:46.402195+0000","last_undegraded":"2023-11-28T19:31:46.402195+0000","last_fullsized":"2023-11-28T19:31:46.402195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.170083+0000","last_change":"2023-11-28T19:31:44.265109+0000","last_active":"2023-11-28T19:31:47.170083+0000","last_peered":"2023-11-28T19:31:47.170083+0000","last_clean":"2023-11-28T19:31:47.170083+0000","last_became_active":"2023-11-28T19:31:44.264507+0000","last_became_peered":"2023-11-28T19:31:44.264507+0000","last_unstale":"2023-11-28T19:31:47.170083+0000","last_undegraded":"2023-11-28T19:31:47.170083+0000","last_fullsized":"2023-11-28T19:31:47.170083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:54.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533067+0000","last_change":"2023-11-28T19:31:45.123742+0000","last_active":"2023-11-28T19:31:47.533067+0000","last_peered":"2023-11-28T19:31:47.533067+0000","last_clean":"2023-11-28T19:31:47.533067+0000","last_became_active":"2023-11-28T19:31:45.123195+0000","last_became_peered":"2023-11-28T19:31:45.123195+0000","last_unstale":"2023-11-28T19:31:47.533067+0000","last_undegraded":"2023-11-28T19:31:47.533067+0000","last_fullsized":"2023-11-28T19:31:47.533067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:44:01.822717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077843+0000","last_change":"2023-11-28T19:31:44.237115+0000","last_active":"2023-11-28T19:31:46.077843+0000","last_peered":"2023-11-28T19:31:46.077843+0000","last_clean":"2023-11-28T19:31:46.077843+0000","last_became_active":"2023-11-28T19:31:44.236631+0000","last_became_peered":"2023-11-28T19:31:44.236631+0000","last_unstale":"2023-11-28T19:31:46.077843+0000","last_undegraded":"2023-11-28T19:31:46.077843+0000","last_fullsized":"2023-11-28T19:31:46.077843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:08.730993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533719+0000","last_change":"2023-11-28T19:31:45.081631+0000","last_active":"2023-11-28T19:31:47.533719+0000","last_peered":"2023-11-28T19:31:47.533719+0000","last_clean":"2023-11-28T19:31:47.533719+0000","last_became_active":"2023-11-28T19:31:45.080848+0000","last_became_peered":"2023-11-28T19:31:45.080848+0000","last_unstale":"2023-11-28T19:31:47.533719+0000","last_undegraded":"2023-11-28T19:31:47.533719+0000","last_fullsized":"2023-11-28T19:31:47.533719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:02.633458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081959+0000","last_change":"2023-11-28T19:31:44.262145+0000","last_active":"2023-11-28T19:31:46.081959+0000","last_peered":"2023-11-28T19:31:46.081959+0000","last_clean":"2023-11-28T19:31:46.081959+0000","last_became_active":"2023-11-28T19:31:44.261242+0000","last_became_peered":"2023-11-28T19:31:44.261242+0000","last_unstale":"2023-11-28T19:31:46.081959+0000","last_undegraded":"2023-11-28T19:31:46.081959+0000","last_fullsized":"2023-11-28T19:31:46.081959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:01.621155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536151+0000","last_change":"2023-11-28T19:31:45.112331+0000","last_active":"2023-11-28T19:31:47.536151+0000","last_peered":"2023-11-28T19:31:47.536151+0000","last_clean":"2023-11-28T19:31:47.536151+0000","last_became_active":"2023-11-28T19:31:45.111524+0000","last_became_peered":"2023-11-28T19:31:45.111524+0000","last_unstale":"2023-11-28T19:31:47.536151+0000","last_undegraded":"2023-11-28T19:31:47.536151+0000","last_fullsized":"2023-11-28T19:31:47.536151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:14.608349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.169902+0000","last_change":"2023-11-28T19:31:44.248811+0000","last_active":"2023-11-28T19:31:47.169902+0000","last_peered":"2023-11-28T19:31:47.169902+0000","last_clean":"2023-11-28T19:31:47.169902+0000","last_became_active":"2023-11-28T19:31:44.248328+0000","last_became_peered":"2023-11-28T19:31:44.248328+0000","last_unstale":"2023-11-28T19:31:47.169902+0000","last_undegraded":"2023-11-28T19:31:47.169902+0000","last_fullsized":"2023-11-28T19:31:47.169902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:44:00.810414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081853+0000","last_change":"2023-11-28T19:31:45.127384+0000","last_active":"2023-11-28T19:31:46.081853+0000","last_peered":"2023-11-28T19:31:46.081853+0000","last_clean":"2023-11-28T19:31:46.081853+0000","last_became_active":"2023-11-28T19:31:45.126812+0000","last_became_peered":"2023-11-28T19:31:45.126812+0000","last_unstale":"2023-11-28T19:31:46.081853+0000","last_undegraded":"2023-11-28T19:31:46.081853+0000","last_fullsized":"2023-11-28T19:31:46.081853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:19.825586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.170615+0000","last_change":"2023-11-28T19:31:44.266569+0000","last_active":"2023-11-28T19:31:47.170615+0000","last_peered":"2023-11-28T19:31:47.170615+0000","last_clean":"2023-11-28T19:31:47.170615+0000","last_became_active":"2023-11-28T19:31:44.265844+0000","last_became_peered":"2023-11-28T19:31:44.265844+0000","last_unstale":"2023-11-28T19:31:47.170615+0000","last_undegraded":"2023-11-28T19:31:47.170615+0000","last_fullsized":"2023-11-28T19:31:47.170615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:08.528057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533229+0000","last_change":"2023-11-28T19:31:45.093284+0000","last_active":"2023-11-28T19:31:47.533229+0000","last_peered":"2023-11-28T19:31:47.533229+0000","last_clean":"2023-11-28T19:31:47.533229+0000","last_became_active":"2023-11-28T19:31:45.092507+0000","last_became_peered":"2023-11-28T19:31:45.092507+0000","last_unstale":"2023-11-28T19:31:47.533229+0000","last_undegraded":"2023-11-28T19:31:47.533229+0000","last_fullsized":"2023-11-28T19:31:47.533229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:25.412721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535758+0000","last_change":"2023-11-28T19:31:44.259605+0000","last_active":"2023-11-28T19:31:47.535758+0000","last_peered":"2023-11-28T19:31:47.535758+0000","last_clean":"2023-11-28T19:31:47.535758+0000","last_became_active":"2023-11-28T19:31:44.259061+0000","last_became_peered":"2023-11-28T19:31:44.259061+0000","last_unstale":"2023-11-28T19:31:47.535758+0000","last_undegraded":"2023-11-28T19:31:47.535758+0000","last_fullsized":"2023-11-28T19:31:47.535758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:38.969351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402960+0000","last_change":"2023-11-28T19:31:45.115755+0000","last_active":"2023-11-28T19:31:46.402960+0000","last_peered":"2023-11-28T19:31:46.402960+0000","last_clean":"2023-11-28T19:31:46.402960+0000","last_became_active":"2023-11-28T19:31:45.114511+0000","last_became_peered":"2023-11-28T19:31:45.114511+0000","last_unstale":"2023-11-28T19:31:46.402960+0000","last_undegraded":"2023-11-28T19:31:46.402960+0000","last_fullsized":"2023-11-28T19:31:46.402960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:28:05.070597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999199+0000","last_change":"2023-11-28T19:31:44.270120+0000","last_active":"2023-11-28T19:31:46.999199+0000","last_peered":"2023-11-28T19:31:46.999199+0000","last_clean":"2023-11-28T19:31:46.999199+0000","last_became_active":"2023-11-28T19:31:44.269323+0000","last_became_peered":"2023-11-28T19:31:44.269323+0000","last_unstale":"2023-11-28T19:31:46.999199+0000","last_undegraded":"2023-11-28T19:31:46.999199+0000","last_fullsized":"2023-11-28T19:31:46.999199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:44:00.810414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.534717+0000","last_change":"2023-11-28T19:31:45.097994+0000","last_active":"2023-11-28T19:31:47.534717+0000","last_peered":"2023-11-28T19:31:47.534717+0000","last_clean":"2023-11-28T19:31:47.534717+0000","last_became_active":"2023-11-28T19:31:45.096610+0000","last_became_peered":"2023-11-28T19:31:45.096610+0000","last_unstale":"2023-11-28T19:31:47.534717+0000","last_undegraded":"2023-11-28T19:31:47.534717+0000","last_fullsized":"2023-11-28T19:31:47.534717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:02.633458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.170028+0000","last_change":"2023-11-28T19:31:44.263898+0000","last_active":"2023-11-28T19:31:47.170028+0000","last_peered":"2023-11-28T19:31:47.170028+0000","last_clean":"2023-11-28T19:31:47.170028+0000","last_became_active":"2023-11-28T19:31:44.263298+0000","last_became_peered":"2023-11-28T19:31:44.263298+0000","last_unstale":"2023-11-28T19:31:47.170028+0000","last_undegraded":"2023-11-28T19:31:47.170028+0000","last_fullsized":"2023-11-28T19:31:47.170028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:18.770787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535144+0000","last_change":"2023-11-28T19:31:45.091928+0000","last_active":"2023-11-28T19:31:47.535144+0000","last_peered":"2023-11-28T19:31:47.535144+0000","last_clean":"2023-11-28T19:31:47.535144+0000","last_became_active":"2023-11-28T19:31:45.091151+0000","last_became_peered":"2023-11-28T19:31:45.091151+0000","last_unstale":"2023-11-28T19:31:47.535144+0000","last_undegraded":"2023-11-28T19:31:47.535144+0000","last_fullsized":"2023-11-28T19:31:47.535144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:23.494544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.169815+0000","last_change":"2023-11-28T19:31:44.264492+0000","last_active":"2023-11-28T19:31:47.169815+0000","last_peered":"2023-11-28T19:31:47.169815+0000","last_clean":"2023-11-28T19:31:47.169815+0000","last_became_active":"2023-11-28T19:31:44.263854+0000","last_became_peered":"2023-11-28T19:31:44.263854+0000","last_unstale":"2023-11-28T19:31:47.169815+0000","last_undegraded":"2023-11-28T19:31:47.169815+0000","last_fullsized":"2023-11-28T19:31:47.169815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:09.166959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402342+0000","last_change":"2023-11-28T19:31:45.102246+0000","last_active":"2023-11-28T19:31:46.402342+0000","last_peered":"2023-11-28T19:31:46.402342+0000","last_clean":"2023-11-28T19:31:46.402342+0000","last_became_active":"2023-11-28T19:31:45.099999+0000","last_became_peered":"2023-11-28T19:31:45.099999+0000","last_unstale":"2023-11-28T19:31:46.402342+0000","last_undegraded":"2023-11-28T19:31:46.402342+0000","last_fullsized":"2023-11-28T19:31:46.402342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:59:45.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.169838+0000","last_change":"2023-11-28T19:31:44.245502+0000","last_active":"2023-11-28T19:31:47.169838+0000","last_peered":"2023-11-28T19:31:47.169838+0000","last_clean":"2023-11-28T19:31:47.169838+0000","last_became_active":"2023-11-28T19:31:44.240313+0000","last_became_peered":"2023-11-28T19:31:44.240313+0000","last_unstale":"2023-11-28T19:31:47.169838+0000","last_undegraded":"2023-11-28T19:31:47.169838+0000","last_fullsized":"2023-11-28T19:31:47.169838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:22.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402134+0000","last_change":"2023-11-28T19:31:45.107221+0000","last_active":"2023-11-28T19:31:46.402134+0000","last_peered":"2023-11-28T19:31:46.402134+0000","last_clean":"2023-11-28T19:31:46.402134+0000","last_became_active":"2023-11-28T19:31:45.106355+0000","last_became_peered":"2023-11-28T19:31:45.106355+0000","last_unstale":"2023-11-28T19:31:46.402134+0000","last_undegraded":"2023-11-28T19:31:46.402134+0000","last_fullsized":"2023-11-28T19:31:46.402134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.170359+0000","last_change":"2023-11-28T19:31:44.268098+0000","last_active":"2023-11-28T19:31:47.170359+0000","last_peered":"2023-11-28T19:31:47.170359+0000","last_clean":"2023-11-28T19:31:47.170359+0000","last_became_active":"2023-11-28T19:31:44.266655+0000","last_became_peered":"2023-11-28T19:31:44.266655+0000","last_unstale":"2023-11-28T19:31:47.170359+0000","last_undegraded":"2023-11-28T19:31:47.170359+0000","last_fullsized":"2023-11-28T19:31:47.170359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998444+0000","last_change":"2023-11-28T19:31:45.119730+0000","last_active":"2023-11-28T19:31:46.998444+0000","last_peered":"2023-11-28T19:31:46.998444+0000","last_clean":"2023-11-28T19:31:46.998444+0000","last_became_active":"2023-11-28T19:31:45.118799+0000","last_became_peered":"2023-11-28T19:31:45.118799+0000","last_unstale":"2023-11-28T19:31:46.998444+0000","last_undegraded":"2023-11-28T19:31:46.998444+0000","last_fullsized":"2023-11-28T19:31:46.998444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:41.003464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081836+0000","last_change":"2023-11-28T19:31:45.134703+0000","last_active":"2023-11-28T19:31:46.081836+0000","last_peered":"2023-11-28T19:31:46.081836+0000","last_clean":"2023-11-28T19:31:46.081836+0000","last_became_active":"2023-11-28T19:31:45.134050+0000","last_became_peered":"2023-11-28T19:31:45.134050+0000","last_unstale":"2023-11-28T19:31:46.081836+0000","last_undegraded":"2023-11-28T19:31:46.081836+0000","last_fullsized":"2023-11-28T19:31:46.081836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:28:05.070597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.170416+0000","last_change":"2023-11-28T19:31:44.268054+0000","last_active":"2023-11-28T19:31:47.170416+0000","last_peered":"2023-11-28T19:31:47.170416+0000","last_clean":"2023-11-28T19:31:47.170416+0000","last_became_active":"2023-11-28T19:31:44.267025+0000","last_became_peered":"2023-11-28T19:31:44.267025+0000","last_unstale":"2023-11-28T19:31:47.170416+0000","last_undegraded":"2023-11-28T19:31:47.170416+0000","last_fullsized":"2023-11-28T19:31:47.170416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:22.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081848+0000","last_change":"2023-11-28T19:31:45.134583+0000","last_active":"2023-11-28T19:31:46.081848+0000","last_peered":"2023-11-28T19:31:46.081848+0000","last_clean":"2023-11-28T19:31:46.081848+0000","last_became_active":"2023-11-28T19:31:45.133796+0000","last_became_peered":"2023-11-28T19:31:45.133796+0000","last_unstale":"2023-11-28T19:31:46.081848+0000","last_undegraded":"2023-11-28T19:31:46.081848+0000","last_fullsized":"2023-11-28T19:31:46.081848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:33:50.981202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.170565+0000","last_change":"2023-11-28T19:31:44.271727+0000","last_active":"2023-11-28T19:31:47.170565+0000","last_peered":"2023-11-28T19:31:47.170565+0000","last_clean":"2023-11-28T19:31:47.170565+0000","last_became_active":"2023-11-28T19:31:44.271039+0000","last_became_peered":"2023-11-28T19:31:44.271039+0000","last_unstale":"2023-11-28T19:31:47.170565+0000","last_undegraded":"2023-11-28T19:31:47.170565+0000","last_fullsized":"2023-11-28T19:31:47.170565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:30.332612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.534917+0000","last_change":"2023-11-28T19:31:45.130263+0000","last_active":"2023-11-28T19:31:47.534917+0000","last_peered":"2023-11-28T19:31:47.534917+0000","last_clean":"2023-11-28T19:31:47.534917+0000","last_became_active":"2023-11-28T19:31:45.129426+0000","last_became_peered":"2023-11-28T19:31:45.129426+0000","last_unstale":"2023-11-28T19:31:47.534917+0000","last_undegraded":"2023-11-28T19:31:47.534917+0000","last_fullsized":"2023-11-28T19:31:47.534917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:31.344915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402936+0000","last_change":"2023-11-28T19:31:44.239191+0000","last_active":"2023-11-28T19:31:46.402936+0000","last_peered":"2023-11-28T19:31:46.402936+0000","last_clean":"2023-11-28T19:31:46.402936+0000","last_became_active":"2023-11-28T19:31:44.238364+0000","last_became_peered":"2023-11-28T19:31:44.238364+0000","last_unstale":"2023-11-28T19:31:46.402936+0000","last_undegraded":"2023-11-28T19:31:46.402936+0000","last_fullsized":"2023-11-28T19:31:46.402936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:38.969351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402940+0000","last_change":"2023-11-28T19:31:45.118725+0000","last_active":"2023-11-28T19:31:46.402940+0000","last_peered":"2023-11-28T19:31:46.402940+0000","last_clean":"2023-11-28T19:31:46.402940+0000","last_became_active":"2023-11-28T19:31:45.115412+0000","last_became_peered":"2023-11-28T19:31:45.115412+0000","last_unstale":"2023-11-28T19:31:46.402940+0000","last_undegraded":"2023-11-28T19:31:46.402940+0000","last_fullsized":"2023-11-28T19:31:46.402940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:29.133063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.169300+0000","last_change":"2023-11-28T19:31:44.255229+0000","last_active":"2023-11-28T19:31:47.169300+0000","last_peered":"2023-11-28T19:31:47.169300+0000","last_clean":"2023-11-28T19:31:47.169300+0000","last_became_active":"2023-11-28T19:31:44.254618+0000","last_became_peered":"2023-11-28T19:31:44.254618+0000","last_unstale":"2023-11-28T19:31:47.169300+0000","last_undegraded":"2023-11-28T19:31:47.169300+0000","last_fullsized":"2023-11-28T19:31:47.169300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:13.596047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.919}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T19:31:51.997 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T19:31:52.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf9416640 1 Processor -- start 2023-11-28T19:31:52.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf9416640 1 -- start start 2023-11-28T19:31:52.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf9416640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcbf40b5dd0 0x7fcbf40b6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf9416640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcbf40b47e0 0x7fcbf40b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf9416640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf4142940 con 0x7fcbf4142560 2023-11-28T19:31:52.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf9416640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf406f950 con 0x7fcbf40b5dd0 2023-11-28T19:31:52.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf9416640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf414bb40 con 0x7fcbf40b47e0 2023-11-28T19:31:52.150 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf27fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fcbf40b5dd0 0x7fcbf40b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:52.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf2ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fcbf4142560 0x7fcbf40b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49692/0 (socket says 172.21.15.28:49692) 2023-11-28T19:31:52.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf2ffd640 1 -- 172.21.15.28:0/2877599006 learned_addr learned my addr 172.21.15.28:0/2877599006 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:52.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf27fc640 1 -- 172.21.15.28:0/2877599006 >> v2:172.21.15.131:3300/0 conn(0x7fcbf40b47e0 msgr2=0x7fcbf40b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:52.151 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf37fe640 1 --2- 172.21.15.28:0/2877599006 >> v2:172.21.15.131:3300/0 conn(0x7fcbf40b47e0 0x7fcbf40b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:52.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf27fc640 1 --2- 172.21.15.28:0/2877599006 >> v2:172.21.15.131:3300/0 conn(0x7fcbf40b47e0 0x7fcbf40b69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf27fc640 1 -- 172.21.15.28:0/2877599006 >> v1:172.21.15.28:6789/0 conn(0x7fcbf4142560 legacy=0x7fcbf40b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf27fc640 1 -- 172.21.15.28:0/2877599006 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf414be20 con 0x7fcbf40b5dd0 2023-11-28T19:31:52.152 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.142+0000 7fcbf1ffb640 1 -- 172.21.15.28:0/2877599006 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4141924639 0 0) 0x7fcbf4142940 con 0x7fcbf4142560 2023-11-28T19:31:52.155 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf27fc640 1 --2- 172.21.15.28:0/2877599006 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcbf40b5dd0 0x7fcbf40b6470 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4149320 tx=0x7fcbdc01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9959ba553e7cbf5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf1ffb640 1 -- 172.21.15.28:0/2877599006 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0a8950 con 0x7fcbf40b5dd0 2023-11-28T19:31:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf1ffb640 1 -- 172.21.15.28:0/2877599006 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc0a8ab0 con 0x7fcbf40b5dd0 2023-11-28T19:31:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf1ffb640 1 -- 172.21.15.28:0/2877599006 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0a8e40 con 0x7fcbf40b5dd0 2023-11-28T19:31:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 -- 172.21.15.28:0/2877599006 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcbf40b5dd0 msgr2=0x7fcbf40b6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 --2- 172.21.15.28:0/2877599006 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcbf40b5dd0 0x7fcbf40b6470 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4149320 tx=0x7fcbdc01ec50 comp rx=0 tx=0).stop 2023-11-28T19:31:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 -- 172.21.15.28:0/2877599006 shutdown_connections 2023-11-28T19:31:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 --2- 172.21.15.28:0/2877599006 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcbf40b5dd0 0x7fcbf40b6470 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 --2- 172.21.15.28:0/2877599006 >> v2:172.21.15.131:3300/0 conn(0x7fcbf40b47e0 0x7fcbf40b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 -- 172.21.15.28:0/2877599006 >> 172.21.15.28:0/2877599006 conn(0x7fcbf40bcb40 msgr2=0x7fcbf40bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:52.156 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 -- 172.21.15.28:0/2877599006 shutdown_connections 2023-11-28T19:31:52.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 -- 172.21.15.28:0/2877599006 wait complete. 2023-11-28T19:31:52.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 Processor -- start 2023-11-28T19:31:52.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 -- start start 2023-11-28T19:31:52.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcbf40b47e0 0x7fcbf40715f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbf40b5dd0 0x7fcbf40721f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbf4142560 0x7fcbf4141260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf4071b30 con 0x7fcbf40b47e0 2023-11-28T19:31:52.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf414a5d0 con 0x7fcbf4142560 2023-11-28T19:31:52.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf9416640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf414a7e0 con 0x7fcbf40b5dd0 2023-11-28T19:31:52.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcbf40b47e0 0x7fcbf40715f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:52.157 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcbf40b47e0 0x7fcbf40715f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51254/0 (socket says 172.21.15.28:51254) 2023-11-28T19:31:52.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.146+0000 7fcbf2ffd640 1 -- 172.21.15.28:0/1739292946 learned_addr learned my addr 172.21.15.28:0/1739292946 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:52.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbf2ffd640 1 -- 172.21.15.28:0/1739292946 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbf40b5dd0 msgr2=0x7fcbf40721f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbf2ffd640 1 --2- 172.21.15.28:0/1739292946 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbf40b5dd0 0x7fcbf40721f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbf2ffd640 1 -- 172.21.15.28:0/1739292946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbf4142560 msgr2=0x7fcbf4141260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbf2ffd640 1 --2- 172.21.15.28:0/1739292946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbf4142560 0x7fcbf4141260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbf2ffd640 1 -- 172.21.15.28:0/1739292946 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc009420 con 0x7fcbf40b47e0 2023-11-28T19:31:52.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbf2ffd640 1 --2- 172.21.15.28:0/1739292946 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcbf40b47e0 0x7fcbf40715f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400c480 tx=0x7fcbe400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:52.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbeb7fe640 1 -- 172.21.15.28:0/1739292946 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe40074e0 con 0x7fcbf40b47e0 2023-11-28T19:31:52.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbeb7fe640 1 -- 172.21.15.28:0/1739292946 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe4007660 con 0x7fcbf40b47e0 2023-11-28T19:31:52.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbf9416640 1 -- 172.21.15.28:0/1739292946 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf414aac0 con 0x7fcbf40b47e0 2023-11-28T19:31:52.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbeb7fe640 1 -- 172.21.15.28:0/1739292946 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe4004a30 con 0x7fcbf40b47e0 2023-11-28T19:31:52.158 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbf9416640 1 -- 172.21.15.28:0/1739292946 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf4072730 con 0x7fcbf40b47e0 2023-11-28T19:31:52.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbf9416640 1 -- 172.21.15.28:0/1739292946 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf4074a90 con 0x7fcbf40b47e0 2023-11-28T19:31:52.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbeb7fe640 1 -- 172.21.15.28:0/1739292946 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fcbe4004b90 con 0x7fcbf40b47e0 2023-11-28T19:31:52.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbeb7fe640 1 --2- 172.21.15.28:0/1739292946 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fcbd4066470 0x7fcbd4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbeb7fe640 1 -- 172.21.15.28:0/1739292946 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbe4083390 con 0x7fcbf40b47e0 2023-11-28T19:31:52.159 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbf27fc640 1 --2- 172.21.15.28:0/1739292946 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fcbd4066470 0x7fcbd4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.150+0000 7fcbf27fc640 1 --2- 172.21.15.28:0/1739292946 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fcbd4066470 0x7fcbd4068930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0b2000 tx=0x7fcbdc004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:52.160 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.154+0000 7fcbeb7fe640 1 -- 172.21.15.28:0/1739292946 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fcbe40508a0 con 0x7fcbf40b47e0 2023-11-28T19:31:52.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.306+0000 7fcbf9416640 1 -- 172.21.15.28:0/1739292946 --> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcbf414c3e0 con 0x7fcbd4066470 2023-11-28T19:31:52.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.326+0000 7fcbeb7fe640 1 -- 172.21.15.28:0/1739292946 <== mgr.4100 v2:172.21.15.131:6832/3367043860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264593 (secure 0 0 0) 0x7fcbdc0a8750 con 0x7fcbd4066470 2023-11-28T19:31:52.335 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:52.337 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-28T19:31:52.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.330+0000 7fcbf9416640 1 -- 172.21.15.28:0/1739292946 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fcbd4066470 msgr2=0x7fcbd4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.330+0000 7fcbf9416640 1 --2- 172.21.15.28:0/1739292946 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fcbd4066470 0x7fcbd4068930 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc0b2000 tx=0x7fcbdc004740 comp rx=0 tx=0).stop 2023-11-28T19:31:52.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.330+0000 7fcbf9416640 1 -- 172.21.15.28:0/1739292946 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcbf40b47e0 msgr2=0x7fcbf40715f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.330+0000 7fcbf9416640 1 --2- 172.21.15.28:0/1739292946 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcbf40b47e0 0x7fcbf40715f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fcbe400c480 tx=0x7fcbe400c940 comp rx=0 tx=0).stop 2023-11-28T19:31:52.338 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.330+0000 7fcbf9416640 1 -- 172.21.15.28:0/1739292946 shutdown_connections 2023-11-28T19:31:52.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.330+0000 7fcbf9416640 1 --2- 172.21.15.28:0/1739292946 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fcbd4066470 0x7fcbd4068930 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.330+0000 7fcbf9416640 1 --2- 172.21.15.28:0/1739292946 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcbf4142560 0x7fcbf4141260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.330+0000 7fcbf9416640 1 --2- 172.21.15.28:0/1739292946 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fcbf40b5dd0 0x7fcbf40721f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.330+0000 7fcbf9416640 1 --2- 172.21.15.28:0/1739292946 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fcbf40b47e0 0x7fcbf40715f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.330+0000 7fcbf9416640 1 -- 172.21.15.28:0/1739292946 >> 172.21.15.28:0/1739292946 conn(0x7fcbf40bcb40 msgr2=0x7fcbf413db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:52.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.330+0000 7fcbf9416640 1 -- 172.21.15.28:0/1739292946 shutdown_connections 2023-11-28T19:31:52.339 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.330+0000 7fcbf9416640 1 -- 172.21.15.28:0/1739292946 wait complete. 2023-11-28T19:31:52.352 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-11-28T19:31:51.136612+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235720,"kb_used_data":2920,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739000,"statfs":{"total":773094113280,"available":772852736000,"internally_reserved":0,"allocated":2990080,"data_stored":1790204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.920032"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536482+0000","last_change":"2023-11-28T19:31:45.117939+0000","last_active":"2023-11-28T19:31:47.536482+0000","last_peered":"2023-11-28T19:31:47.536482+0000","last_clean":"2023-11-28T19:31:47.536482+0000","last_became_active":"2023-11-28T19:31:45.116596+0000","last_became_peered":"2023-11-28T19:31:45.116596+0000","last_unstale":"2023-11-28T19:31:47.536482+0000","last_undegraded":"2023-11-28T19:31:47.536482+0000","last_fullsized":"2023-11-28T19:31:47.536482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:19.825586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535628+0000","last_change":"2023-11-28T19:31:45.108670+0000","last_active":"2023-11-28T19:31:47.535628+0000","last_peered":"2023-11-28T19:31:47.535628+0000","last_clean":"2023-11-28T19:31:47.535628+0000","last_became_active":"2023-11-28T19:31:45.107887+0000","last_became_peered":"2023-11-28T19:31:45.107887+0000","last_unstale":"2023-11-28T19:31:47.535628+0000","last_undegraded":"2023-11-28T19:31:47.535628+0000","last_fullsized":"2023-11-28T19:31:47.535628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535253+0000","last_change":"2023-11-28T19:31:45.114729+0000","last_active":"2023-11-28T19:31:47.535253+0000","last_peered":"2023-11-28T19:31:47.535253+0000","last_clean":"2023-11-28T19:31:47.535253+0000","last_became_active":"2023-11-28T19:31:45.113974+0000","last_became_peered":"2023-11-28T19:31:45.113974+0000","last_unstale":"2023-11-28T19:31:47.535253+0000","last_undegraded":"2023-11-28T19:31:47.535253+0000","last_fullsized":"2023-11-28T19:31:47.535253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081481+0000","last_change":"2023-11-28T19:31:45.127387+0000","last_active":"2023-11-28T19:31:46.081481+0000","last_peered":"2023-11-28T19:31:46.081481+0000","last_clean":"2023-11-28T19:31:46.081481+0000","last_became_active":"2023-11-28T19:31:45.126614+0000","last_became_peered":"2023-11-28T19:31:45.126614+0000","last_unstale":"2023-11-28T19:31:46.081481+0000","last_undegraded":"2023-11-28T19:31:46.081481+0000","last_fullsized":"2023-11-28T19:31:46.081481+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:03.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535591+0000","last_change":"2023-11-28T19:31:45.100132+0000","last_active":"2023-11-28T19:31:47.535591+0000","last_peered":"2023-11-28T19:31:47.535591+0000","last_clean":"2023-11-28T19:31:47.535591+0000","last_became_active":"2023-11-28T19:31:45.099229+0000","last_became_peered":"2023-11-28T19:31:45.099229+0000","last_unstale":"2023-11-28T19:31:47.535591+0000","last_undegraded":"2023-11-28T19:31:47.535591+0000","last_fullsized":"2023-11-28T19:31:47.535591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:29.133063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081218+0000","last_change":"2023-11-28T19:31:45.125593+0000","last_active":"2023-11-28T19:31:46.081218+0000","last_peered":"2023-11-28T19:31:46.081218+0000","last_clean":"2023-11-28T19:31:46.081218+0000","last_became_active":"2023-11-28T19:31:45.124811+0000","last_became_peered":"2023-11-28T19:31:45.124811+0000","last_unstale":"2023-11-28T19:31:46.081218+0000","last_undegraded":"2023-11-28T19:31:46.081218+0000","last_fullsized":"2023-11-28T19:31:46.081218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:59:45.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.534522+0000","last_change":"2023-11-28T19:31:45.104970+0000","last_active":"2023-11-28T19:31:47.534522+0000","last_peered":"2023-11-28T19:31:47.534522+0000","last_clean":"2023-11-28T19:31:47.534522+0000","last_became_active":"2023-11-28T19:31:45.104131+0000","last_became_peered":"2023-11-28T19:31:45.104131+0000","last_unstale":"2023-11-28T19:31:47.534522+0000","last_undegraded":"2023-11-28T19:31:47.534522+0000","last_fullsized":"2023-11-28T19:31:47.534522+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:03.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402100+0000","last_change":"2023-11-28T19:31:45.130940+0000","last_active":"2023-11-28T19:31:46.402100+0000","last_peered":"2023-11-28T19:31:46.402100+0000","last_clean":"2023-11-28T19:31:46.402100+0000","last_became_active":"2023-11-28T19:31:45.130171+0000","last_became_peered":"2023-11-28T19:31:45.130171+0000","last_unstale":"2023-11-28T19:31:46.402100+0000","last_undegraded":"2023-11-28T19:31:46.402100+0000","last_fullsized":"2023-11-28T19:31:46.402100+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:31.344915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536485+0000","last_change":"2023-11-28T19:31:45.130835+0000","last_active":"2023-11-28T19:31:47.536485+0000","last_peered":"2023-11-28T19:31:47.536485+0000","last_clean":"2023-11-28T19:31:47.536485+0000","last_became_active":"2023-11-28T19:31:45.130194+0000","last_became_peered":"2023-11-28T19:31:45.130194+0000","last_unstale":"2023-11-28T19:31:47.536485+0000","last_undegraded":"2023-11-28T19:31:47.536485+0000","last_fullsized":"2023-11-28T19:31:47.536485+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:21.761617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999097+0000","last_change":"2023-11-28T19:31:45.127252+0000","last_active":"2023-11-28T19:31:46.999097+0000","last_peered":"2023-11-28T19:31:46.999097+0000","last_clean":"2023-11-28T19:31:46.999097+0000","last_became_active":"2023-11-28T19:31:45.125570+0000","last_became_peered":"2023-11-28T19:31:45.125570+0000","last_unstale":"2023-11-28T19:31:46.999097+0000","last_undegraded":"2023-11-28T19:31:46.999097+0000","last_fullsized":"2023-11-28T19:31:46.999097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998852+0000","last_change":"2023-11-28T19:31:45.127138+0000","last_active":"2023-11-28T19:31:46.998852+0000","last_peered":"2023-11-28T19:31:46.998852+0000","last_clean":"2023-11-28T19:31:46.998852+0000","last_became_active":"2023-11-28T19:31:45.126392+0000","last_became_peered":"2023-11-28T19:31:45.126392+0000","last_unstale":"2023-11-28T19:31:46.998852+0000","last_undegraded":"2023-11-28T19:31:46.998852+0000","last_fullsized":"2023-11-28T19:31:46.998852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536513+0000","last_change":"2023-11-28T19:31:45.116329+0000","last_active":"2023-11-28T19:31:47.536513+0000","last_peered":"2023-11-28T19:31:47.536513+0000","last_clean":"2023-11-28T19:31:47.536513+0000","last_became_active":"2023-11-28T19:31:45.115691+0000","last_became_peered":"2023-11-28T19:31:45.115691+0000","last_unstale":"2023-11-28T19:31:47.536513+0000","last_undegraded":"2023-11-28T19:31:47.536513+0000","last_fullsized":"2023-11-28T19:31:47.536513+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:19.783090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402092+0000","last_change":"2023-11-28T19:31:45.118954+0000","last_active":"2023-11-28T19:31:46.402092+0000","last_peered":"2023-11-28T19:31:46.402092+0000","last_clean":"2023-11-28T19:31:46.402092+0000","last_became_active":"2023-11-28T19:31:45.116311+0000","last_became_peered":"2023-11-28T19:31:45.116311+0000","last_unstale":"2023-11-28T19:31:46.402092+0000","last_undegraded":"2023-11-28T19:31:46.402092+0000","last_fullsized":"2023-11-28T19:31:46.402092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:02.633458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533067+0000","last_change":"2023-11-28T19:31:45.104928+0000","last_active":"2023-11-28T19:31:47.533067+0000","last_peered":"2023-11-28T19:31:47.533067+0000","last_clean":"2023-11-28T19:31:47.533067+0000","last_became_active":"2023-11-28T19:31:45.104131+0000","last_became_peered":"2023-11-28T19:31:45.104131+0000","last_unstale":"2023-11-28T19:31:47.533067+0000","last_undegraded":"2023-11-28T19:31:47.533067+0000","last_fullsized":"2023-11-28T19:31:47.533067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:10.179262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533739+0000","last_change":"2023-11-28T19:31:45.104838+0000","last_active":"2023-11-28T19:31:47.533739+0000","last_peered":"2023-11-28T19:31:47.533739+0000","last_clean":"2023-11-28T19:31:47.533739+0000","last_became_active":"2023-11-28T19:31:45.104087+0000","last_became_peered":"2023-11-28T19:31:45.104087+0000","last_unstale":"2023-11-28T19:31:47.533739+0000","last_undegraded":"2023-11-28T19:31:47.533739+0000","last_fullsized":"2023-11-28T19:31:47.533739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:31.344915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.080886+0000","last_change":"2023-11-28T19:31:45.124848+0000","last_active":"2023-11-28T19:31:46.080886+0000","last_peered":"2023-11-28T19:31:46.080886+0000","last_clean":"2023-11-28T19:31:46.080886+0000","last_became_active":"2023-11-28T19:31:45.124031+0000","last_became_peered":"2023-11-28T19:31:45.124031+0000","last_unstale":"2023-11-28T19:31:46.080886+0000","last_undegraded":"2023-11-28T19:31:46.080886+0000","last_fullsized":"2023-11-28T19:31:46.080886+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082592+0000","last_change":"2023-11-28T19:31:45.134085+0000","last_active":"2023-11-28T19:31:46.082592+0000","last_peered":"2023-11-28T19:31:46.082592+0000","last_clean":"2023-11-28T19:31:46.082592+0000","last_became_active":"2023-11-28T19:31:45.132979+0000","last_became_peered":"2023-11-28T19:31:45.132979+0000","last_unstale":"2023-11-28T19:31:46.082592+0000","last_undegraded":"2023-11-28T19:31:46.082592+0000","last_fullsized":"2023-11-28T19:31:46.082592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:11.287539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077713+0000","last_change":"2023-11-28T19:31:45.117122+0000","last_active":"2023-11-28T19:31:46.077713+0000","last_peered":"2023-11-28T19:31:46.077713+0000","last_clean":"2023-11-28T19:31:46.077713+0000","last_became_active":"2023-11-28T19:31:45.116462+0000","last_became_peered":"2023-11-28T19:31:45.116462+0000","last_unstale":"2023-11-28T19:31:46.077713+0000","last_undegraded":"2023-11-28T19:31:46.077713+0000","last_fullsized":"2023-11-28T19:31:46.077713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:55.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.537088+0000","last_change":"2023-11-28T19:31:45.114295+0000","last_active":"2023-11-28T19:31:47.537088+0000","last_peered":"2023-11-28T19:31:47.537088+0000","last_clean":"2023-11-28T19:31:47.537088+0000","last_became_active":"2023-11-28T19:31:45.113478+0000","last_became_peered":"2023-11-28T19:31:45.113478+0000","last_unstale":"2023-11-28T19:31:47.537088+0000","last_undegraded":"2023-11-28T19:31:47.537088+0000","last_fullsized":"2023-11-28T19:31:47.537088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:39:06.856700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998559+0000","last_change":"2023-11-28T19:31:45.121559+0000","last_active":"2023-11-28T19:31:46.998559+0000","last_peered":"2023-11-28T19:31:46.998559+0000","last_clean":"2023-11-28T19:31:46.998559+0000","last_became_active":"2023-11-28T19:31:45.120810+0000","last_became_peered":"2023-11-28T19:31:45.120810+0000","last_unstale":"2023-11-28T19:31:46.998559+0000","last_undegraded":"2023-11-28T19:31:46.998559+0000","last_fullsized":"2023-11-28T19:31:46.998559+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:31.344915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533823+0000","last_change":"2023-11-28T19:31:45.110520+0000","last_active":"2023-11-28T19:31:47.533823+0000","last_peered":"2023-11-28T19:31:47.533823+0000","last_clean":"2023-11-28T19:31:47.533823+0000","last_became_active":"2023-11-28T19:31:45.109508+0000","last_became_peered":"2023-11-28T19:31:45.109508+0000","last_unstale":"2023-11-28T19:31:47.533823+0000","last_undegraded":"2023-11-28T19:31:47.533823+0000","last_fullsized":"2023-11-28T19:31:47.533823+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:54.812488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081502+0000","last_change":"2023-11-28T19:31:45.135559+0000","last_active":"2023-11-28T19:31:46.081502+0000","last_peered":"2023-11-28T19:31:46.081502+0000","last_clean":"2023-11-28T19:31:46.081502+0000","last_became_active":"2023-11-28T19:31:45.134957+0000","last_became_peered":"2023-11-28T19:31:45.134957+0000","last_unstale":"2023-11-28T19:31:46.081502+0000","last_undegraded":"2023-11-28T19:31:46.081502+0000","last_fullsized":"2023-11-28T19:31:46.081502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:17.751045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402000+0000","last_change":"2023-11-28T19:31:45.106729+0000","last_active":"2023-11-28T19:31:46.402000+0000","last_peered":"2023-11-28T19:31:46.402000+0000","last_clean":"2023-11-28T19:31:46.402000+0000","last_became_active":"2023-11-28T19:31:45.104514+0000","last_became_peered":"2023-11-28T19:31:45.104514+0000","last_unstale":"2023-11-28T19:31:46.402000+0000","last_undegraded":"2023-11-28T19:31:46.402000+0000","last_fullsized":"2023-11-28T19:31:46.402000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:25.412721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081110+0000","last_change":"2023-11-28T19:31:45.128458+0000","last_active":"2023-11-28T19:31:46.081110+0000","last_peered":"2023-11-28T19:31:46.081110+0000","last_clean":"2023-11-28T19:31:46.081110+0000","last_became_active":"2023-11-28T19:31:45.127309+0000","last_became_peered":"2023-11-28T19:31:45.127309+0000","last_unstale":"2023-11-28T19:31:46.081110+0000","last_undegraded":"2023-11-28T19:31:46.081110+0000","last_fullsized":"2023-11-28T19:31:46.081110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402857+0000","last_change":"2023-11-28T19:31:45.106194+0000","last_active":"2023-11-28T19:31:46.402857+0000","last_peered":"2023-11-28T19:31:46.402857+0000","last_clean":"2023-11-28T19:31:46.402857+0000","last_became_active":"2023-11-28T19:31:45.105417+0000","last_became_peered":"2023-11-28T19:31:45.105417+0000","last_unstale":"2023-11-28T19:31:46.402857+0000","last_undegraded":"2023-11-28T19:31:46.402857+0000","last_fullsized":"2023-11-28T19:31:46.402857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:17.751045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999358+0000","last_change":"2023-11-28T19:31:45.113263+0000","last_active":"2023-11-28T19:31:46.999358+0000","last_peered":"2023-11-28T19:31:46.999358+0000","last_clean":"2023-11-28T19:31:46.999358+0000","last_became_active":"2023-11-28T19:31:45.112503+0000","last_became_peered":"2023-11-28T19:31:45.112503+0000","last_unstale":"2023-11-28T19:31:46.999358+0000","last_undegraded":"2023-11-28T19:31:46.999358+0000","last_fullsized":"2023-11-28T19:31:46.999358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:59:45.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535452+0000","last_change":"2023-11-28T19:31:45.102175+0000","last_active":"2023-11-28T19:31:47.535452+0000","last_peered":"2023-11-28T19:31:47.535452+0000","last_clean":"2023-11-28T19:31:47.535452+0000","last_became_active":"2023-11-28T19:31:45.101399+0000","last_became_peered":"2023-11-28T19:31:45.101399+0000","last_unstale":"2023-11-28T19:31:47.535452+0000","last_undegraded":"2023-11-28T19:31:47.535452+0000","last_fullsized":"2023-11-28T19:31:47.535452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402766+0000","last_change":"2023-11-28T19:31:45.105446+0000","last_active":"2023-11-28T19:31:46.402766+0000","last_peered":"2023-11-28T19:31:46.402766+0000","last_clean":"2023-11-28T19:31:46.402766+0000","last_became_active":"2023-11-28T19:31:45.103114+0000","last_became_peered":"2023-11-28T19:31:45.103114+0000","last_unstale":"2023-11-28T19:31:46.402766+0000","last_undegraded":"2023-11-28T19:31:46.402766+0000","last_fullsized":"2023-11-28T19:31:46.402766+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:31:03.927570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.534159+0000","last_change":"2023-11-28T19:31:45.102194+0000","last_active":"2023-11-28T19:31:47.534159+0000","last_peered":"2023-11-28T19:31:47.534159+0000","last_clean":"2023-11-28T19:31:47.534159+0000","last_became_active":"2023-11-28T19:31:45.101351+0000","last_became_peered":"2023-11-28T19:31:45.101351+0000","last_unstale":"2023-11-28T19:31:47.534159+0000","last_undegraded":"2023-11-28T19:31:47.534159+0000","last_fullsized":"2023-11-28T19:31:47.534159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:25.412721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081971+0000","last_change":"2023-11-28T19:31:45.126943+0000","last_active":"2023-11-28T19:31:46.081971+0000","last_peered":"2023-11-28T19:31:46.081971+0000","last_clean":"2023-11-28T19:31:46.081971+0000","last_became_active":"2023-11-28T19:31:45.126265+0000","last_became_peered":"2023-11-28T19:31:45.126265+0000","last_unstale":"2023-11-28T19:31:46.081971+0000","last_undegraded":"2023-11-28T19:31:46.081971+0000","last_fullsized":"2023-11-28T19:31:46.081971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:29.133063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077767+0000","last_change":"2023-11-28T19:31:45.126324+0000","last_active":"2023-11-28T19:31:46.077767+0000","last_peered":"2023-11-28T19:31:46.077767+0000","last_clean":"2023-11-28T19:31:46.077767+0000","last_became_active":"2023-11-28T19:31:45.125509+0000","last_became_peered":"2023-11-28T19:31:45.125509+0000","last_unstale":"2023-11-28T19:31:46.077767+0000","last_undegraded":"2023-11-28T19:31:46.077767+0000","last_fullsized":"2023-11-28T19:31:46.077767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:39.981654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998359+0000","last_change":"2023-11-28T19:31:45.114020+0000","last_active":"2023-11-28T19:31:46.998359+0000","last_peered":"2023-11-28T19:31:46.998359+0000","last_clean":"2023-11-28T19:31:46.998359+0000","last_became_active":"2023-11-28T19:31:45.113322+0000","last_became_peered":"2023-11-28T19:31:45.113322+0000","last_unstale":"2023-11-28T19:31:46.998359+0000","last_undegraded":"2023-11-28T19:31:46.998359+0000","last_fullsized":"2023-11-28T19:31:46.998359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:25.412721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535289+0000","last_change":"2023-11-28T19:31:45.099021+0000","last_active":"2023-11-28T19:31:47.535289+0000","last_peered":"2023-11-28T19:31:47.535289+0000","last_clean":"2023-11-28T19:31:47.535289+0000","last_became_active":"2023-11-28T19:31:45.098188+0000","last_became_peered":"2023-11-28T19:31:45.098188+0000","last_unstale":"2023-11-28T19:31:47.535289+0000","last_undegraded":"2023-11-28T19:31:47.535289+0000","last_fullsized":"2023-11-28T19:31:47.535289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:27.231075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402337+0000","last_change":"2023-11-28T19:31:44.264140+0000","last_active":"2023-11-28T19:31:46.402337+0000","last_peered":"2023-11-28T19:31:46.402337+0000","last_clean":"2023-11-28T19:31:46.402337+0000","last_became_active":"2023-11-28T19:31:44.263733+0000","last_became_peered":"2023-11-28T19:31:44.263733+0000","last_unstale":"2023-11-28T19:31:46.402337+0000","last_undegraded":"2023-11-28T19:31:46.402337+0000","last_fullsized":"2023-11-28T19:31:46.402337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:18.770787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.534476+0000","last_change":"2023-11-28T19:31:45.120512+0000","last_active":"2023-11-28T19:31:47.534476+0000","last_peered":"2023-11-28T19:31:47.534476+0000","last_clean":"2023-11-28T19:31:47.534476+0000","last_became_active":"2023-11-28T19:31:45.119585+0000","last_became_peered":"2023-11-28T19:31:45.119585+0000","last_unstale":"2023-11-28T19:31:47.534476+0000","last_undegraded":"2023-11-28T19:31:47.534476+0000","last_fullsized":"2023-11-28T19:31:47.534476+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:41.003464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998328+0000","last_change":"2023-11-28T19:31:44.262529+0000","last_active":"2023-11-28T19:31:46.998328+0000","last_peered":"2023-11-28T19:31:46.998328+0000","last_clean":"2023-11-28T19:31:46.998328+0000","last_became_active":"2023-11-28T19:31:44.261833+0000","last_became_peered":"2023-11-28T19:31:44.261833+0000","last_unstale":"2023-11-28T19:31:46.998328+0000","last_undegraded":"2023-11-28T19:31:46.998328+0000","last_fullsized":"2023-11-28T19:31:46.998328+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.401940+0000","last_change":"2023-11-28T19:31:44.247016+0000","last_active":"2023-11-28T19:31:46.401940+0000","last_peered":"2023-11-28T19:31:46.401940+0000","last_clean":"2023-11-28T19:31:46.401940+0000","last_became_active":"2023-11-28T19:31:44.246381+0000","last_became_peered":"2023-11-28T19:31:44.246381+0000","last_unstale":"2023-11-28T19:31:46.401940+0000","last_undegraded":"2023-11-28T19:31:46.401940+0000","last_fullsized":"2023-11-28T19:31:46.401940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:09.166959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402003+0000","last_change":"2023-11-28T19:31:45.118713+0000","last_active":"2023-11-28T19:31:46.402003+0000","last_peered":"2023-11-28T19:31:46.402003+0000","last_clean":"2023-11-28T19:31:46.402003+0000","last_became_active":"2023-11-28T19:31:45.114163+0000","last_became_peered":"2023-11-28T19:31:45.114163+0000","last_unstale":"2023-11-28T19:31:46.402003+0000","last_undegraded":"2023-11-28T19:31:46.402003+0000","last_fullsized":"2023-11-28T19:31:46.402003+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:41.003464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081114+0000","last_change":"2023-11-28T19:31:44.262743+0000","last_active":"2023-11-28T19:31:46.081114+0000","last_peered":"2023-11-28T19:31:46.081114+0000","last_clean":"2023-11-28T19:31:46.081114+0000","last_became_active":"2023-11-28T19:31:44.261828+0000","last_became_peered":"2023-11-28T19:31:44.261828+0000","last_unstale":"2023-11-28T19:31:46.081114+0000","last_undegraded":"2023-11-28T19:31:46.081114+0000","last_fullsized":"2023-11-28T19:31:46.081114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:13.596047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533384+0000","last_change":"2023-11-28T19:31:45.102566+0000","last_active":"2023-11-28T19:31:47.533384+0000","last_peered":"2023-11-28T19:31:47.533384+0000","last_clean":"2023-11-28T19:31:47.533384+0000","last_became_active":"2023-11-28T19:31:45.101723+0000","last_became_peered":"2023-11-28T19:31:45.101723+0000","last_unstale":"2023-11-28T19:31:47.533384+0000","last_undegraded":"2023-11-28T19:31:47.533384+0000","last_fullsized":"2023-11-28T19:31:47.533384+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:41.003464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999059+0000","last_change":"2023-11-28T19:31:44.265457+0000","last_active":"2023-11-28T19:31:46.999059+0000","last_peered":"2023-11-28T19:31:46.999059+0000","last_clean":"2023-11-28T19:31:46.999059+0000","last_became_active":"2023-11-28T19:31:44.264577+0000","last_became_peered":"2023-11-28T19:31:44.264577+0000","last_unstale":"2023-11-28T19:31:46.999059+0000","last_undegraded":"2023-11-28T19:31:46.999059+0000","last_fullsized":"2023-11-28T19:31:46.999059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:22:57.628821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082306+0000","last_change":"2023-11-28T19:31:45.133755+0000","last_active":"2023-11-28T19:31:46.082306+0000","last_peered":"2023-11-28T19:31:46.082306+0000","last_clean":"2023-11-28T19:31:46.082306+0000","last_became_active":"2023-11-28T19:31:45.132947+0000","last_became_peered":"2023-11-28T19:31:45.132947+0000","last_unstale":"2023-11-28T19:31:46.082306+0000","last_undegraded":"2023-11-28T19:31:46.082306+0000","last_fullsized":"2023-11-28T19:31:46.082306+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:28:56.420413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082283+0000","last_change":"2023-11-28T19:31:44.271305+0000","last_active":"2023-11-28T19:31:46.082283+0000","last_peered":"2023-11-28T19:31:46.082283+0000","last_clean":"2023-11-28T19:31:46.082283+0000","last_became_active":"2023-11-28T19:31:44.270176+0000","last_became_peered":"2023-11-28T19:31:44.270176+0000","last_unstale":"2023-11-28T19:31:46.082283+0000","last_undegraded":"2023-11-28T19:31:46.082283+0000","last_fullsized":"2023-11-28T19:31:46.082283+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:02:26.218772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535105+0000","last_change":"2023-11-28T19:31:45.127548+0000","last_active":"2023-11-28T19:31:47.535105+0000","last_peered":"2023-11-28T19:31:47.535105+0000","last_clean":"2023-11-28T19:31:47.535105+0000","last_became_active":"2023-11-28T19:31:45.126841+0000","last_became_peered":"2023-11-28T19:31:45.126841+0000","last_unstale":"2023-11-28T19:31:47.535105+0000","last_undegraded":"2023-11-28T19:31:47.535105+0000","last_fullsized":"2023-11-28T19:31:47.535105+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.169947+0000","last_change":"2023-11-28T19:31:44.260935+0000","last_active":"2023-11-28T19:31:47.169947+0000","last_peered":"2023-11-28T19:31:47.169947+0000","last_clean":"2023-11-28T19:31:47.169947+0000","last_became_active":"2023-11-28T19:31:44.260504+0000","last_became_peered":"2023-11-28T19:31:44.260504+0000","last_unstale":"2023-11-28T19:31:47.169947+0000","last_undegraded":"2023-11-28T19:31:47.169947+0000","last_fullsized":"2023-11-28T19:31:47.169947+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:54.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536677+0000","last_change":"2023-11-28T19:31:45.109031+0000","last_active":"2023-11-28T19:31:47.536677+0000","last_peered":"2023-11-28T19:31:47.536677+0000","last_clean":"2023-11-28T19:31:47.536677+0000","last_became_active":"2023-11-28T19:31:45.104913+0000","last_became_peered":"2023-11-28T19:31:45.104913+0000","last_unstale":"2023-11-28T19:31:47.536677+0000","last_undegraded":"2023-11-28T19:31:47.536677+0000","last_fullsized":"2023-11-28T19:31:47.536677+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:55.967723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"20'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998735+0000","last_change":"2023-11-28T19:31:44.250020+0000","last_active":"2023-11-28T19:31:46.998735+0000","last_peered":"2023-11-28T19:31:46.998735+0000","last_clean":"2023-11-28T19:31:46.998735+0000","last_became_active":"2023-11-28T19:31:44.247440+0000","last_became_peered":"2023-11-28T19:31:44.247440+0000","last_unstale":"2023-11-28T19:31:46.998735+0000","last_undegraded":"2023-11-28T19:31:46.998735+0000","last_fullsized":"2023-11-28T19:31:46.998735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:38.969351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536753+0000","last_change":"2023-11-28T19:31:45.108120+0000","last_active":"2023-11-28T19:31:47.536753+0000","last_peered":"2023-11-28T19:31:47.536753+0000","last_clean":"2023-11-28T19:31:47.536753+0000","last_became_active":"2023-11-28T19:31:45.107361+0000","last_became_peered":"2023-11-28T19:31:45.107361+0000","last_unstale":"2023-11-28T19:31:47.536753+0000","last_undegraded":"2023-11-28T19:31:47.536753+0000","last_fullsized":"2023-11-28T19:31:47.536753+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:28:56.420413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.169168+0000","last_change":"2023-11-28T19:31:44.232624+0000","last_active":"2023-11-28T19:31:47.169168+0000","last_peered":"2023-11-28T19:31:47.169168+0000","last_clean":"2023-11-28T19:31:47.169168+0000","last_became_active":"2023-11-28T19:31:44.231887+0000","last_became_peered":"2023-11-28T19:31:44.231887+0000","last_unstale":"2023-11-28T19:31:47.169168+0000","last_undegraded":"2023-11-28T19:31:47.169168+0000","last_fullsized":"2023-11-28T19:31:47.169168+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533213+0000","last_change":"2023-11-28T19:31:45.103017+0000","last_active":"2023-11-28T19:31:47.533213+0000","last_peered":"2023-11-28T19:31:47.533213+0000","last_clean":"2023-11-28T19:31:47.533213+0000","last_became_active":"2023-11-28T19:31:45.102246+0000","last_became_peered":"2023-11-28T19:31:45.102246+0000","last_unstale":"2023-11-28T19:31:47.533213+0000","last_undegraded":"2023-11-28T19:31:47.533213+0000","last_fullsized":"2023-11-28T19:31:47.533213+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:22:58.641123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081739+0000","last_change":"2023-11-28T19:31:44.260611+0000","last_active":"2023-11-28T19:31:46.081739+0000","last_peered":"2023-11-28T19:31:46.081739+0000","last_clean":"2023-11-28T19:31:46.081739+0000","last_became_active":"2023-11-28T19:31:44.259673+0000","last_became_peered":"2023-11-28T19:31:44.259673+0000","last_unstale":"2023-11-28T19:31:46.081739+0000","last_undegraded":"2023-11-28T19:31:46.081739+0000","last_fullsized":"2023-11-28T19:31:46.081739+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:24.400418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535916+0000","last_change":"2023-11-28T19:31:45.119213+0000","last_active":"2023-11-28T19:31:47.535916+0000","last_peered":"2023-11-28T19:31:47.535916+0000","last_clean":"2023-11-28T19:31:47.535916+0000","last_became_active":"2023-11-28T19:31:45.118566+0000","last_became_peered":"2023-11-28T19:31:45.118566+0000","last_unstale":"2023-11-28T19:31:47.535916+0000","last_undegraded":"2023-11-28T19:31:47.535916+0000","last_fullsized":"2023-11-28T19:31:47.535916+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:33:50.981202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998481+0000","last_change":"2023-11-28T19:31:44.264660+0000","last_active":"2023-11-28T19:31:46.998481+0000","last_peered":"2023-11-28T19:31:46.998481+0000","last_clean":"2023-11-28T19:31:46.998481+0000","last_became_active":"2023-11-28T19:31:44.263913+0000","last_became_peered":"2023-11-28T19:31:44.263913+0000","last_unstale":"2023-11-28T19:31:46.998481+0000","last_undegraded":"2023-11-28T19:31:46.998481+0000","last_fullsized":"2023-11-28T19:31:46.998481+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:09.166959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998511+0000","last_change":"2023-11-28T19:31:45.114551+0000","last_active":"2023-11-28T19:31:46.998511+0000","last_peered":"2023-11-28T19:31:46.998511+0000","last_clean":"2023-11-28T19:31:46.998511+0000","last_became_active":"2023-11-28T19:31:45.112479+0000","last_became_peered":"2023-11-28T19:31:45.112479+0000","last_unstale":"2023-11-28T19:31:46.998511+0000","last_undegraded":"2023-11-28T19:31:46.998511+0000","last_fullsized":"2023-11-28T19:31:46.998511+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:02.633458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":20,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077642+0000","last_change":"2023-11-28T19:31:44.252177+0000","last_active":"2023-11-28T19:31:46.077642+0000","last_peered":"2023-11-28T19:31:46.077642+0000","last_clean":"2023-11-28T19:31:46.077642+0000","last_became_active":"2023-11-28T19:31:44.251637+0000","last_became_peered":"2023-11-28T19:31:44.251637+0000","last_unstale":"2023-11-28T19:31:46.077642+0000","last_undegraded":"2023-11-28T19:31:46.077642+0000","last_fullsized":"2023-11-28T19:31:46.077642+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:35.357511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.534729+0000","last_change":"2023-11-28T19:31:45.123799+0000","last_active":"2023-11-28T19:31:47.534729+0000","last_peered":"2023-11-28T19:31:47.534729+0000","last_clean":"2023-11-28T19:31:47.534729+0000","last_became_active":"2023-11-28T19:31:45.123023+0000","last_became_peered":"2023-11-28T19:31:45.123023+0000","last_unstale":"2023-11-28T19:31:47.534729+0000","last_undegraded":"2023-11-28T19:31:47.534729+0000","last_fullsized":"2023-11-28T19:31:47.534729+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:15:17.751045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.163771+0000","last_change":"2023-11-28T19:31:44.247638+0000","last_active":"2023-11-28T19:31:47.163771+0000","last_peered":"2023-11-28T19:31:47.163771+0000","last_clean":"2023-11-28T19:31:47.163771+0000","last_became_active":"2023-11-28T19:31:44.244818+0000","last_became_peered":"2023-11-28T19:31:44.244818+0000","last_unstale":"2023-11-28T19:31:47.163771+0000","last_undegraded":"2023-11-28T19:31:47.163771+0000","last_fullsized":"2023-11-28T19:31:47.163771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:52:35.357511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535833+0000","last_change":"2023-11-28T19:31:45.119195+0000","last_active":"2023-11-28T19:31:47.535833+0000","last_peered":"2023-11-28T19:31:47.535833+0000","last_clean":"2023-11-28T19:31:47.535833+0000","last_became_active":"2023-11-28T19:31:45.118457+0000","last_became_peered":"2023-11-28T19:31:45.118457+0000","last_unstale":"2023-11-28T19:31:47.535833+0000","last_undegraded":"2023-11-28T19:31:47.535833+0000","last_fullsized":"2023-11-28T19:31:47.535833+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:28:05.070597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077969+0000","last_change":"2023-11-28T19:31:44.237773+0000","last_active":"2023-11-28T19:31:46.077969+0000","last_peered":"2023-11-28T19:31:46.077969+0000","last_clean":"2023-11-28T19:31:46.077969+0000","last_became_active":"2023-11-28T19:31:44.237376+0000","last_became_peered":"2023-11-28T19:31:44.237376+0000","last_unstale":"2023-11-28T19:31:46.077969+0000","last_undegraded":"2023-11-28T19:31:46.077969+0000","last_fullsized":"2023-11-28T19:31:46.077969+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:18.770787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536865+0000","last_change":"2023-11-28T19:31:45.133333+0000","last_active":"2023-11-28T19:31:47.536865+0000","last_peered":"2023-11-28T19:31:47.536865+0000","last_clean":"2023-11-28T19:31:47.536865+0000","last_became_active":"2023-11-28T19:31:45.132771+0000","last_became_peered":"2023-11-28T19:31:45.132771+0000","last_unstale":"2023-11-28T19:31:47.536865+0000","last_undegraded":"2023-11-28T19:31:47.536865+0000","last_fullsized":"2023-11-28T19:31:47.536865+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:36:11.287539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.169975+0000","last_change":"2023-11-28T19:31:44.262514+0000","last_active":"2023-11-28T19:31:47.169975+0000","last_peered":"2023-11-28T19:31:47.169975+0000","last_clean":"2023-11-28T19:31:47.169975+0000","last_became_active":"2023-11-28T19:31:44.262050+0000","last_became_peered":"2023-11-28T19:31:44.262050+0000","last_unstale":"2023-11-28T19:31:47.169975+0000","last_undegraded":"2023-11-28T19:31:47.169975+0000","last_fullsized":"2023-11-28T19:31:47.169975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.082192+0000","last_change":"2023-11-28T19:31:45.128723+0000","last_active":"2023-11-28T19:31:46.082192+0000","last_peered":"2023-11-28T19:31:46.082192+0000","last_clean":"2023-11-28T19:31:46.082192+0000","last_became_active":"2023-11-28T19:31:45.128010+0000","last_became_peered":"2023-11-28T19:31:45.128010+0000","last_unstale":"2023-11-28T19:31:46.082192+0000","last_undegraded":"2023-11-28T19:31:46.082192+0000","last_fullsized":"2023-11-28T19:31:46.082192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:21.761617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077647+0000","last_change":"2023-11-28T19:31:44.260788+0000","last_active":"2023-11-28T19:31:46.077647+0000","last_peered":"2023-11-28T19:31:46.077647+0000","last_clean":"2023-11-28T19:31:46.077647+0000","last_became_active":"2023-11-28T19:31:44.260313+0000","last_became_peered":"2023-11-28T19:31:44.260313+0000","last_unstale":"2023-11-28T19:31:46.077647+0000","last_undegraded":"2023-11-28T19:31:46.077647+0000","last_fullsized":"2023-11-28T19:31:46.077647+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:22.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536881+0000","last_change":"2023-11-28T19:31:45.131013+0000","last_active":"2023-11-28T19:31:47.536881+0000","last_peered":"2023-11-28T19:31:47.536881+0000","last_clean":"2023-11-28T19:31:47.536881+0000","last_became_active":"2023-11-28T19:31:45.130317+0000","last_became_peered":"2023-11-28T19:31:45.130317+0000","last_unstale":"2023-11-28T19:31:47.536881+0000","last_undegraded":"2023-11-28T19:31:47.536881+0000","last_fullsized":"2023-11-28T19:31:47.536881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:49:24.093530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":165,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:45.084091+0000","last_change":"2023-11-28T19:31:35.378105+0000","last_active":"2023-11-28T19:31:45.084091+0000","last_peered":"2023-11-28T19:31:45.084091+0000","last_clean":"2023-11-28T19:31:45.084091+0000","last_became_active":"2023-11-28T19:31:35.375035+0000","last_became_peered":"2023-11-28T19:31:35.375035+0000","last_unstale":"2023-11-28T19:31:45.084091+0000","last_undegraded":"2023-11-28T19:31:45.084091+0000","last_fullsized":"2023-11-28T19:31:45.084091+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_clean_scrub_stamp":"2023-11-28T19:31:33.813158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:07.043315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081118+0000","last_change":"2023-11-28T19:31:44.261114+0000","last_active":"2023-11-28T19:31:46.081118+0000","last_peered":"2023-11-28T19:31:46.081118+0000","last_clean":"2023-11-28T19:31:46.081118+0000","last_became_active":"2023-11-28T19:31:44.260407+0000","last_became_peered":"2023-11-28T19:31:44.260407+0000","last_unstale":"2023-11-28T19:31:46.081118+0000","last_undegraded":"2023-11-28T19:31:46.081118+0000","last_fullsized":"2023-11-28T19:31:46.081118+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:41:53.627798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402195+0000","last_change":"2023-11-28T19:31:45.128856+0000","last_active":"2023-11-28T19:31:46.402195+0000","last_peered":"2023-11-28T19:31:46.402195+0000","last_clean":"2023-11-28T19:31:46.402195+0000","last_became_active":"2023-11-28T19:31:45.128241+0000","last_became_peered":"2023-11-28T19:31:45.128241+0000","last_unstale":"2023-11-28T19:31:46.402195+0000","last_undegraded":"2023-11-28T19:31:46.402195+0000","last_fullsized":"2023-11-28T19:31:46.402195+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:09.540360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.170083+0000","last_change":"2023-11-28T19:31:44.265109+0000","last_active":"2023-11-28T19:31:47.170083+0000","last_peered":"2023-11-28T19:31:47.170083+0000","last_clean":"2023-11-28T19:31:47.170083+0000","last_became_active":"2023-11-28T19:31:44.264507+0000","last_became_peered":"2023-11-28T19:31:44.264507+0000","last_unstale":"2023-11-28T19:31:47.170083+0000","last_undegraded":"2023-11-28T19:31:47.170083+0000","last_fullsized":"2023-11-28T19:31:47.170083+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:53:54.955420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533067+0000","last_change":"2023-11-28T19:31:45.123742+0000","last_active":"2023-11-28T19:31:47.533067+0000","last_peered":"2023-11-28T19:31:47.533067+0000","last_clean":"2023-11-28T19:31:47.533067+0000","last_became_active":"2023-11-28T19:31:45.123195+0000","last_became_peered":"2023-11-28T19:31:45.123195+0000","last_unstale":"2023-11-28T19:31:47.533067+0000","last_undegraded":"2023-11-28T19:31:47.533067+0000","last_fullsized":"2023-11-28T19:31:47.533067+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:44:01.822717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.077843+0000","last_change":"2023-11-28T19:31:44.237115+0000","last_active":"2023-11-28T19:31:46.077843+0000","last_peered":"2023-11-28T19:31:46.077843+0000","last_clean":"2023-11-28T19:31:46.077843+0000","last_became_active":"2023-11-28T19:31:44.236631+0000","last_became_peered":"2023-11-28T19:31:44.236631+0000","last_unstale":"2023-11-28T19:31:46.077843+0000","last_undegraded":"2023-11-28T19:31:46.077843+0000","last_fullsized":"2023-11-28T19:31:46.077843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:51:08.730993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533719+0000","last_change":"2023-11-28T19:31:45.081631+0000","last_active":"2023-11-28T19:31:47.533719+0000","last_peered":"2023-11-28T19:31:47.533719+0000","last_clean":"2023-11-28T19:31:47.533719+0000","last_became_active":"2023-11-28T19:31:45.080848+0000","last_became_peered":"2023-11-28T19:31:45.080848+0000","last_unstale":"2023-11-28T19:31:47.533719+0000","last_undegraded":"2023-11-28T19:31:47.533719+0000","last_fullsized":"2023-11-28T19:31:47.533719+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:02.633458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081959+0000","last_change":"2023-11-28T19:31:44.262145+0000","last_active":"2023-11-28T19:31:46.081959+0000","last_peered":"2023-11-28T19:31:46.081959+0000","last_clean":"2023-11-28T19:31:46.081959+0000","last_became_active":"2023-11-28T19:31:44.261242+0000","last_became_peered":"2023-11-28T19:31:44.261242+0000","last_unstale":"2023-11-28T19:31:46.081959+0000","last_undegraded":"2023-11-28T19:31:46.081959+0000","last_fullsized":"2023-11-28T19:31:46.081959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:01.621155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.536151+0000","last_change":"2023-11-28T19:31:45.112331+0000","last_active":"2023-11-28T19:31:47.536151+0000","last_peered":"2023-11-28T19:31:47.536151+0000","last_clean":"2023-11-28T19:31:47.536151+0000","last_became_active":"2023-11-28T19:31:45.111524+0000","last_became_peered":"2023-11-28T19:31:45.111524+0000","last_unstale":"2023-11-28T19:31:47.536151+0000","last_undegraded":"2023-11-28T19:31:47.536151+0000","last_fullsized":"2023-11-28T19:31:47.536151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:14.608349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.169902+0000","last_change":"2023-11-28T19:31:44.248811+0000","last_active":"2023-11-28T19:31:47.169902+0000","last_peered":"2023-11-28T19:31:47.169902+0000","last_clean":"2023-11-28T19:31:47.169902+0000","last_became_active":"2023-11-28T19:31:44.248328+0000","last_became_peered":"2023-11-28T19:31:44.248328+0000","last_unstale":"2023-11-28T19:31:47.169902+0000","last_undegraded":"2023-11-28T19:31:47.169902+0000","last_fullsized":"2023-11-28T19:31:47.169902+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:44:00.810414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081853+0000","last_change":"2023-11-28T19:31:45.127384+0000","last_active":"2023-11-28T19:31:46.081853+0000","last_peered":"2023-11-28T19:31:46.081853+0000","last_clean":"2023-11-28T19:31:46.081853+0000","last_became_active":"2023-11-28T19:31:45.126812+0000","last_became_peered":"2023-11-28T19:31:45.126812+0000","last_unstale":"2023-11-28T19:31:46.081853+0000","last_undegraded":"2023-11-28T19:31:46.081853+0000","last_fullsized":"2023-11-28T19:31:46.081853+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:11:19.825586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.170615+0000","last_change":"2023-11-28T19:31:44.266569+0000","last_active":"2023-11-28T19:31:47.170615+0000","last_peered":"2023-11-28T19:31:47.170615+0000","last_clean":"2023-11-28T19:31:47.170615+0000","last_became_active":"2023-11-28T19:31:44.265844+0000","last_became_peered":"2023-11-28T19:31:44.265844+0000","last_unstale":"2023-11-28T19:31:47.170615+0000","last_undegraded":"2023-11-28T19:31:47.170615+0000","last_fullsized":"2023-11-28T19:31:47.170615+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:52:08.528057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.533229+0000","last_change":"2023-11-28T19:31:45.093284+0000","last_active":"2023-11-28T19:31:47.533229+0000","last_peered":"2023-11-28T19:31:47.533229+0000","last_clean":"2023-11-28T19:31:47.533229+0000","last_became_active":"2023-11-28T19:31:45.092507+0000","last_became_peered":"2023-11-28T19:31:45.092507+0000","last_unstale":"2023-11-28T19:31:47.533229+0000","last_undegraded":"2023-11-28T19:31:47.533229+0000","last_fullsized":"2023-11-28T19:31:47.533229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:34:25.412721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535758+0000","last_change":"2023-11-28T19:31:44.259605+0000","last_active":"2023-11-28T19:31:47.535758+0000","last_peered":"2023-11-28T19:31:47.535758+0000","last_clean":"2023-11-28T19:31:47.535758+0000","last_became_active":"2023-11-28T19:31:44.259061+0000","last_became_peered":"2023-11-28T19:31:44.259061+0000","last_unstale":"2023-11-28T19:31:47.535758+0000","last_undegraded":"2023-11-28T19:31:47.535758+0000","last_fullsized":"2023-11-28T19:31:47.535758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:38.969351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402960+0000","last_change":"2023-11-28T19:31:45.115755+0000","last_active":"2023-11-28T19:31:46.402960+0000","last_peered":"2023-11-28T19:31:46.402960+0000","last_clean":"2023-11-28T19:31:46.402960+0000","last_became_active":"2023-11-28T19:31:45.114511+0000","last_became_peered":"2023-11-28T19:31:45.114511+0000","last_unstale":"2023-11-28T19:31:46.402960+0000","last_undegraded":"2023-11-28T19:31:46.402960+0000","last_fullsized":"2023-11-28T19:31:46.402960+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:28:05.070597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.999199+0000","last_change":"2023-11-28T19:31:44.270120+0000","last_active":"2023-11-28T19:31:46.999199+0000","last_peered":"2023-11-28T19:31:46.999199+0000","last_clean":"2023-11-28T19:31:46.999199+0000","last_became_active":"2023-11-28T19:31:44.269323+0000","last_became_peered":"2023-11-28T19:31:44.269323+0000","last_unstale":"2023-11-28T19:31:46.999199+0000","last_undegraded":"2023-11-28T19:31:46.999199+0000","last_fullsized":"2023-11-28T19:31:46.999199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:44:00.810414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.534717+0000","last_change":"2023-11-28T19:31:45.097994+0000","last_active":"2023-11-28T19:31:47.534717+0000","last_peered":"2023-11-28T19:31:47.534717+0000","last_clean":"2023-11-28T19:31:47.534717+0000","last_became_active":"2023-11-28T19:31:45.096610+0000","last_became_peered":"2023-11-28T19:31:45.096610+0000","last_unstale":"2023-11-28T19:31:47.534717+0000","last_undegraded":"2023-11-28T19:31:47.534717+0000","last_fullsized":"2023-11-28T19:31:47.534717+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:23:02.633458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.170028+0000","last_change":"2023-11-28T19:31:44.263898+0000","last_active":"2023-11-28T19:31:47.170028+0000","last_peered":"2023-11-28T19:31:47.170028+0000","last_clean":"2023-11-28T19:31:47.170028+0000","last_became_active":"2023-11-28T19:31:44.263298+0000","last_became_peered":"2023-11-28T19:31:44.263298+0000","last_unstale":"2023-11-28T19:31:47.170028+0000","last_undegraded":"2023-11-28T19:31:47.170028+0000","last_fullsized":"2023-11-28T19:31:47.170028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:39:18.770787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.535144+0000","last_change":"2023-11-28T19:31:45.091928+0000","last_active":"2023-11-28T19:31:47.535144+0000","last_peered":"2023-11-28T19:31:47.535144+0000","last_clean":"2023-11-28T19:31:47.535144+0000","last_became_active":"2023-11-28T19:31:45.091151+0000","last_became_peered":"2023-11-28T19:31:45.091151+0000","last_unstale":"2023-11-28T19:31:47.535144+0000","last_undegraded":"2023-11-28T19:31:47.535144+0000","last_fullsized":"2023-11-28T19:31:47.535144+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:23.494544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.169815+0000","last_change":"2023-11-28T19:31:44.264492+0000","last_active":"2023-11-28T19:31:47.169815+0000","last_peered":"2023-11-28T19:31:47.169815+0000","last_clean":"2023-11-28T19:31:47.169815+0000","last_became_active":"2023-11-28T19:31:44.263854+0000","last_became_peered":"2023-11-28T19:31:44.263854+0000","last_unstale":"2023-11-28T19:31:47.169815+0000","last_undegraded":"2023-11-28T19:31:47.169815+0000","last_fullsized":"2023-11-28T19:31:47.169815+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:01:09.166959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402342+0000","last_change":"2023-11-28T19:31:45.102246+0000","last_active":"2023-11-28T19:31:46.402342+0000","last_peered":"2023-11-28T19:31:46.402342+0000","last_clean":"2023-11-28T19:31:46.402342+0000","last_became_active":"2023-11-28T19:31:45.099999+0000","last_became_peered":"2023-11-28T19:31:45.099999+0000","last_unstale":"2023-11-28T19:31:46.402342+0000","last_undegraded":"2023-11-28T19:31:46.402342+0000","last_fullsized":"2023-11-28T19:31:46.402342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:59:45.239105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.169838+0000","last_change":"2023-11-28T19:31:44.245502+0000","last_active":"2023-11-28T19:31:47.169838+0000","last_peered":"2023-11-28T19:31:47.169838+0000","last_clean":"2023-11-28T19:31:47.169838+0000","last_became_active":"2023-11-28T19:31:44.240313+0000","last_became_peered":"2023-11-28T19:31:44.240313+0000","last_unstale":"2023-11-28T19:31:47.169838+0000","last_undegraded":"2023-11-28T19:31:47.169838+0000","last_fullsized":"2023-11-28T19:31:47.169838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:22.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402134+0000","last_change":"2023-11-28T19:31:45.107221+0000","last_active":"2023-11-28T19:31:46.402134+0000","last_peered":"2023-11-28T19:31:46.402134+0000","last_clean":"2023-11-28T19:31:46.402134+0000","last_became_active":"2023-11-28T19:31:45.106355+0000","last_became_peered":"2023-11-28T19:31:45.106355+0000","last_unstale":"2023-11-28T19:31:46.402134+0000","last_undegraded":"2023-11-28T19:31:46.402134+0000","last_fullsized":"2023-11-28T19:31:46.402134+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:12:04.951047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.170359+0000","last_change":"2023-11-28T19:31:44.268098+0000","last_active":"2023-11-28T19:31:47.170359+0000","last_peered":"2023-11-28T19:31:47.170359+0000","last_clean":"2023-11-28T19:31:47.170359+0000","last_became_active":"2023-11-28T19:31:44.266655+0000","last_became_peered":"2023-11-28T19:31:44.266655+0000","last_unstale":"2023-11-28T19:31:47.170359+0000","last_undegraded":"2023-11-28T19:31:47.170359+0000","last_fullsized":"2023-11-28T19:31:47.170359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:44:46.910169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.998444+0000","last_change":"2023-11-28T19:31:45.119730+0000","last_active":"2023-11-28T19:31:46.998444+0000","last_peered":"2023-11-28T19:31:46.998444+0000","last_clean":"2023-11-28T19:31:46.998444+0000","last_became_active":"2023-11-28T19:31:45.118799+0000","last_became_peered":"2023-11-28T19:31:45.118799+0000","last_unstale":"2023-11-28T19:31:46.998444+0000","last_undegraded":"2023-11-28T19:31:46.998444+0000","last_fullsized":"2023-11-28T19:31:46.998444+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:03:41.003464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081836+0000","last_change":"2023-11-28T19:31:45.134703+0000","last_active":"2023-11-28T19:31:46.081836+0000","last_peered":"2023-11-28T19:31:46.081836+0000","last_clean":"2023-11-28T19:31:46.081836+0000","last_became_active":"2023-11-28T19:31:45.134050+0000","last_became_peered":"2023-11-28T19:31:45.134050+0000","last_unstale":"2023-11-28T19:31:46.081836+0000","last_undegraded":"2023-11-28T19:31:46.081836+0000","last_fullsized":"2023-11-28T19:31:46.081836+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:28:05.070597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.170416+0000","last_change":"2023-11-28T19:31:44.268054+0000","last_active":"2023-11-28T19:31:47.170416+0000","last_peered":"2023-11-28T19:31:47.170416+0000","last_clean":"2023-11-28T19:31:47.170416+0000","last_became_active":"2023-11-28T19:31:44.267025+0000","last_became_peered":"2023-11-28T19:31:44.267025+0000","last_unstale":"2023-11-28T19:31:47.170416+0000","last_undegraded":"2023-11-28T19:31:47.170416+0000","last_fullsized":"2023-11-28T19:31:47.170416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:51:22.482241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.081848+0000","last_change":"2023-11-28T19:31:45.134583+0000","last_active":"2023-11-28T19:31:46.081848+0000","last_peered":"2023-11-28T19:31:46.081848+0000","last_clean":"2023-11-28T19:31:46.081848+0000","last_became_active":"2023-11-28T19:31:45.133796+0000","last_became_peered":"2023-11-28T19:31:45.133796+0000","last_unstale":"2023-11-28T19:31:46.081848+0000","last_undegraded":"2023-11-28T19:31:46.081848+0000","last_fullsized":"2023-11-28T19:31:46.081848+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:33:50.981202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.170565+0000","last_change":"2023-11-28T19:31:44.271727+0000","last_active":"2023-11-28T19:31:47.170565+0000","last_peered":"2023-11-28T19:31:47.170565+0000","last_clean":"2023-11-28T19:31:47.170565+0000","last_became_active":"2023-11-28T19:31:44.271039+0000","last_became_peered":"2023-11-28T19:31:44.271039+0000","last_unstale":"2023-11-28T19:31:47.170565+0000","last_undegraded":"2023-11-28T19:31:47.170565+0000","last_fullsized":"2023-11-28T19:31:47.170565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:30.332612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.534917+0000","last_change":"2023-11-28T19:31:45.130263+0000","last_active":"2023-11-28T19:31:47.534917+0000","last_peered":"2023-11-28T19:31:47.534917+0000","last_clean":"2023-11-28T19:31:47.534917+0000","last_became_active":"2023-11-28T19:31:45.129426+0000","last_became_peered":"2023-11-28T19:31:45.129426+0000","last_unstale":"2023-11-28T19:31:47.534917+0000","last_undegraded":"2023-11-28T19:31:47.534917+0000","last_fullsized":"2023-11-28T19:31:47.534917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:20:31.344915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402936+0000","last_change":"2023-11-28T19:31:44.239191+0000","last_active":"2023-11-28T19:31:46.402936+0000","last_peered":"2023-11-28T19:31:46.402936+0000","last_clean":"2023-11-28T19:31:46.402936+0000","last_became_active":"2023-11-28T19:31:44.238364+0000","last_became_peered":"2023-11-28T19:31:44.238364+0000","last_unstale":"2023-11-28T19:31:46.402936+0000","last_undegraded":"2023-11-28T19:31:46.402936+0000","last_fullsized":"2023-11-28T19:31:46.402936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:39:38.969351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":21,"state":"active+clean","last_fresh":"2023-11-28T19:31:46.402940+0000","last_change":"2023-11-28T19:31:45.118725+0000","last_active":"2023-11-28T19:31:46.402940+0000","last_peered":"2023-11-28T19:31:46.402940+0000","last_clean":"2023-11-28T19:31:46.402940+0000","last_became_active":"2023-11-28T19:31:45.115412+0000","last_became_peered":"2023-11-28T19:31:45.115412+0000","last_unstale":"2023-11-28T19:31:46.402940+0000","last_undegraded":"2023-11-28T19:31:46.402940+0000","last_fullsized":"2023-11-28T19:31:46.402940+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:44.203813+0000","last_clean_scrub_stamp":"2023-11-28T19:31:44.203813+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:26:29.133063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"20'4","reported_seq":16,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-11-28T19:31:47.169300+0000","last_change":"2023-11-28T19:31:44.255229+0000","last_active":"2023-11-28T19:31:47.169300+0000","last_peered":"2023-11-28T19:31:47.169300+0000","last_clean":"2023-11-28T19:31:47.169300+0000","last_became_active":"2023-11-28T19:31:44.254618+0000","last_became_peered":"2023-11-28T19:31:44.254618+0000","last_unstale":"2023-11-28T19:31:47.169300+0000","last_undegraded":"2023-11-28T19:31:47.169300+0000","last_fullsized":"2023-11-28T19:31:47.169300+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:43.191510+0000","last_clean_scrub_stamp":"2023-11-28T19:31:43.191510+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:55:13.596047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27816,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344024,"statfs":{"total":96636764160,"available":96608280576,"internally_reserved":0,"allocated":815104,"data_stored":666531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.123}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92000000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1519999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0780000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3939999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.919}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27236,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344604,"statfs":{"total":96636764160,"available":96608874496,"internally_reserved":0,"allocated":221184,"data_stored":75671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1579999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":229376,"data_stored":75707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.87}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0920000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31404,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340436,"statfs":{"total":96636764160,"available":96604606464,"internally_reserved":0,"allocated":229376,"data_stored":77193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31392,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340448,"statfs":{"total":96636764160,"available":96604618752,"internally_reserved":0,"allocated":217088,"data_stored":75581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4430000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3069999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3560000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31400,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340440,"statfs":{"total":96636764160,"available":96604610560,"internally_reserved":0,"allocated":225280,"data_stored":75741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0840000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":823296,"data_stored":666587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T19:31:52.357 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-11-28T19:31:52.357 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-11-28T19:31:52.358 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-11-28T19:31:52.358 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-11-28T19:31:52.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff442abc640 1 Processor -- start 2023-11-28T19:31:52.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff442abc640 1 -- start start 2023-11-28T19:31:52.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff442abc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff43c0b6980 0x7ff43c0b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff442abc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff43c141ec0 0x7ff43c142350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff442abc640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43c0b77b0 con 0x7ff43c0b5cb0 2023-11-28T19:31:52.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff442abc640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff43c149070 con 0x7ff43c141ec0 2023-11-28T19:31:52.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff442abc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c0b7a50 con 0x7ff43c0b6980 2023-11-28T19:31:52.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff441059640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff43c141ec0 0x7ff43c142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff441059640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff43c141ec0 0x7ff43c142350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51268/0 (socket says 172.21.15.28:51268) 2023-11-28T19:31:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff441059640 1 -- 172.21.15.28:0/408328150 learned_addr learned my addr 172.21.15.28:0/408328150 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff440858640 1 --2- 172.21.15.28:0/408328150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff43c0b6980 0x7ff43c0b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff441059640 1 -- 172.21.15.28:0/408328150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff43c0b6980 msgr2=0x7ff43c0b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff441059640 1 --2- 172.21.15.28:0/408328150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff43c0b6980 0x7ff43c0b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff441059640 1 -- 172.21.15.28:0/408328150 >> v1:172.21.15.131:6789/0 conn(0x7ff43c0b5cb0 legacy=0x7ff43c148960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff441059640 1 -- 172.21.15.28:0/408328150 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43c148160 con 0x7ff43c141ec0 2023-11-28T19:31:52.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.506+0000 7ff440858640 1 --2- 172.21.15.28:0/408328150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff43c0b6980 0x7ff43c0b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:31:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.510+0000 7ff441059640 1 --2- 172.21.15.28:0/408328150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff43c141ec0 0x7ff43c142350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff434009e50 tx=0x7ff43401c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9251f308bb103d3c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.510+0000 7ff43b7fe640 1 -- 172.21.15.28:0/408328150 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340a5730 con 0x7ff43c141ec0 2023-11-28T19:31:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.510+0000 7ff43b7fe640 1 -- 172.21.15.28:0/408328150 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4340a5890 con 0x7ff43c141ec0 2023-11-28T19:31:52.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.510+0000 7ff43b7fe640 1 -- 172.21.15.28:0/408328150 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340a5c20 con 0x7ff43c141ec0 2023-11-28T19:31:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.510+0000 7ff442abc640 1 -- 172.21.15.28:0/408328150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff43c141ec0 msgr2=0x7ff43c142350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.510+0000 7ff442abc640 1 --2- 172.21.15.28:0/408328150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff43c141ec0 0x7ff43c142350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff434009e50 tx=0x7ff43401c980 comp rx=0 tx=0).stop 2023-11-28T19:31:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.510+0000 7ff442abc640 1 -- 172.21.15.28:0/408328150 shutdown_connections 2023-11-28T19:31:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.510+0000 7ff442abc640 1 --2- 172.21.15.28:0/408328150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff43c141ec0 0x7ff43c142350 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.510+0000 7ff442abc640 1 --2- 172.21.15.28:0/408328150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff43c0b6980 0x7ff43c0b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.510+0000 7ff442abc640 1 -- 172.21.15.28:0/408328150 >> 172.21.15.28:0/408328150 conn(0x7ff43c0bcb00 msgr2=0x7ff43c0bcf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:52.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.510+0000 7ff442abc640 1 -- 172.21.15.28:0/408328150 shutdown_connections 2023-11-28T19:31:52.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.510+0000 7ff442abc640 1 -- 172.21.15.28:0/408328150 wait complete. 2023-11-28T19:31:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.510+0000 7ff442abc640 1 Processor -- start 2023-11-28T19:31:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.510+0000 7ff442abc640 1 -- start start 2023-11-28T19:31:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff442abc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff43c0b5cb0 0x7ff43c1478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff442abc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43c0b6980 0x7ff43c1e5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff442abc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff43c141ec0 0x7ff43c134f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff442abc640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c147e20 con 0x7ff43c141ec0 2023-11-28T19:31:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff442abc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c143230 con 0x7ff43c0b6980 2023-11-28T19:31:52.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff442abc640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43c1434a0 con 0x7ff43c0b5cb0 2023-11-28T19:31:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff441059640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff43c141ec0 0x7ff43c134f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff441059640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff43c141ec0 0x7ff43c134f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51284/0 (socket says 172.21.15.28:51284) 2023-11-28T19:31:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff441059640 1 -- 172.21.15.28:0/3883552217 learned_addr learned my addr 172.21.15.28:0/3883552217 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff440858640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff43c0b5cb0 0x7ff43c1478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff43bfff640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43c0b6980 0x7ff43c1e5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff441059640 1 -- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff43c0b5cb0 msgr2=0x7ff43c1478e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff441059640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff43c0b5cb0 0x7ff43c1478e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff441059640 1 -- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43c0b6980 msgr2=0x7ff43c1e5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff441059640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43c0b6980 0x7ff43c1e5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff441059640 1 -- 172.21.15.28:0/3883552217 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff434009b30 con 0x7ff43c141ec0 2023-11-28T19:31:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff43bfff640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43c0b6980 0x7ff43c1e5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff441059640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff43c141ec0 0x7ff43c134f60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff4340af040 tx=0x7ff434019720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:52.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff4397fa640 1 -- 172.21.15.28:0/3883552217 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340b8670 con 0x7ff43c141ec0 2023-11-28T19:31:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff4397fa640 1 -- 172.21.15.28:0/3883552217 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4340b87f0 con 0x7ff43c141ec0 2023-11-28T19:31:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff442abc640 1 -- 172.21.15.28:0/3883552217 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff43c1e4c60 con 0x7ff43c141ec0 2023-11-28T19:31:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff4397fa640 1 -- 172.21.15.28:0/3883552217 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4340b8ba0 con 0x7ff43c141ec0 2023-11-28T19:31:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff442abc640 1 -- 172.21.15.28:0/3883552217 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff43c143780 con 0x7ff43c141ec0 2023-11-28T19:31:52.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff442abc640 1 -- 172.21.15.28:0/3883552217 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43c067a20 con 0x7ff43c141ec0 2023-11-28T19:31:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff4397fa640 1 -- 172.21.15.28:0/3883552217 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff4340b8d00 con 0x7ff43c141ec0 2023-11-28T19:31:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff4397fa640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff428066470 0x7ff428068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff4397fa640 1 -- 172.21.15.28:0/3883552217 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff43411fcf0 con 0x7ff43c141ec0 2023-11-28T19:31:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.514+0000 7ff440858640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff428066470 0x7ff428068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:52.522 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.518+0000 7ff440858640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff428066470 0x7ff428068930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0098b0 tx=0x7ff42c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:52.524 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.518+0000 7ff4397fa640 1 -- 172.21.15.28:0/3883552217 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff4340ed400 con 0x7ff43c141ec0 2023-11-28T19:31:52.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.698+0000 7ff442abc640 1 -- 172.21.15.28:0/3883552217 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff43c1e5180 con 0x7ff43c141ec0 2023-11-28T19:31:52.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.698+0000 7ff4397fa640 1 -- 172.21.15.28:0/3883552217 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ff4340bc040 con 0x7ff43c141ec0 2023-11-28T19:31:52.705 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:52.705 INFO:teuthology.orchestra.run.smithi028.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-11-28T19:31:52.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.702+0000 7ff442abc640 1 -- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff428066470 msgr2=0x7ff428068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.702+0000 7ff442abc640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff428066470 0x7ff428068930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0098b0 tx=0x7ff42c008040 comp rx=0 tx=0).stop 2023-11-28T19:31:52.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.702+0000 7ff442abc640 1 -- 172.21.15.28:0/3883552217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff43c141ec0 msgr2=0x7ff43c134f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.702+0000 7ff442abc640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff43c141ec0 0x7ff43c134f60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff4340af040 tx=0x7ff434019720 comp rx=0 tx=0).stop 2023-11-28T19:31:52.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.702+0000 7ff442abc640 1 -- 172.21.15.28:0/3883552217 shutdown_connections 2023-11-28T19:31:52.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.702+0000 7ff442abc640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff428066470 0x7ff428068930 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.702+0000 7ff442abc640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff43c141ec0 0x7ff43c134f60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.702+0000 7ff442abc640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff43c0b6980 0x7ff43c1e5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.702+0000 7ff442abc640 1 --2- 172.21.15.28:0/3883552217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff43c0b5cb0 0x7ff43c1478e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.702+0000 7ff442abc640 1 -- 172.21.15.28:0/3883552217 >> 172.21.15.28:0/3883552217 conn(0x7ff43c0bcb00 msgr2=0x7ff43c0b9600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.702+0000 7ff442abc640 1 -- 172.21.15.28:0/3883552217 shutdown_connections 2023-11-28T19:31:52.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.702+0000 7ff442abc640 1 -- 172.21.15.28:0/3883552217 wait complete. 2023-11-28T19:31:52.722 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-11-28T19:31:52.723 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:52.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.826+0000 7f7266d72640 1 Processor -- start 2023-11-28T19:31:52.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.826+0000 7f7266d72640 1 -- start start 2023-11-28T19:31:52.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7266d72640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f726006aaf0 0x7f726006aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7266d72640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f726014ac70 0x7f726014b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7266d72640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f726014b0b0 0x7f726014bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7266d72640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72600bc1c0 con 0x7f726006aaf0 2023-11-28T19:31:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7266d72640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72600bd5e0 con 0x7f726014ac70 2023-11-28T19:31:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7266d72640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f726006bca0 con 0x7f726014b0b0 2023-11-28T19:31:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7264b0e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f726006aaf0 0x7f726006aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7264b0e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f726006aaf0 0x7f726006aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51290/0 (socket says 172.21.15.28:51290) 2023-11-28T19:31:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7264b0e640 1 -- 172.21.15.28:0/3123681950 learned_addr learned my addr 172.21.15.28:0/3123681950 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7264b0e640 1 -- 172.21.15.28:0/3123681950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f726014b0b0 msgr2=0x7f726014bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7264b0e640 1 --2- 172.21.15.28:0/3123681950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f726014b0b0 0x7f726014bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7264b0e640 1 -- 172.21.15.28:0/3123681950 >> v2:172.21.15.131:3300/0 conn(0x7f726014ac70 msgr2=0x7f726014b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7264b0e640 1 --2- 172.21.15.28:0/3123681950 >> v2:172.21.15.131:3300/0 conn(0x7f726014ac70 0x7f726014b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7264b0e640 1 -- 172.21.15.28:0/3123681950 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726006b7a0 con 0x7f726006aaf0 2023-11-28T19:31:52.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7264b0e640 1 --2- 172.21.15.28:0/3123681950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f726006aaf0 0x7f726006aed0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7260074360 tx=0x7f725001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953fe0995467dd82 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:52.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f725f7fe640 1 -- 172.21.15.28:0/3123681950 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72500ab5f0 con 0x7f726006aaf0 2023-11-28T19:31:52.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f725f7fe640 1 -- 172.21.15.28:0/3123681950 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72500ab750 con 0x7f726006aaf0 2023-11-28T19:31:52.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f725f7fe640 1 -- 172.21.15.28:0/3123681950 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72500abae0 con 0x7f726006aaf0 2023-11-28T19:31:52.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7266d72640 1 -- 172.21.15.28:0/3123681950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f726006aaf0 msgr2=0x7f726006aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7266d72640 1 --2- 172.21.15.28:0/3123681950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f726006aaf0 0x7f726006aed0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7260074360 tx=0x7f725001c500 comp rx=0 tx=0).stop 2023-11-28T19:31:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7266d72640 1 -- 172.21.15.28:0/3123681950 shutdown_connections 2023-11-28T19:31:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.830+0000 7f7266d72640 1 --2- 172.21.15.28:0/3123681950 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f726014b0b0 0x7f726014bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 --2- 172.21.15.28:0/3123681950 >> v2:172.21.15.131:3300/0 conn(0x7f726014ac70 0x7f726014b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 --2- 172.21.15.28:0/3123681950 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f726006aaf0 0x7f726006aed0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 -- 172.21.15.28:0/3123681950 >> 172.21.15.28:0/3123681950 conn(0x7f72600bd790 msgr2=0x7f72600bdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 -- 172.21.15.28:0/3123681950 shutdown_connections 2023-11-28T19:31:52.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 -- 172.21.15.28:0/3123681950 wait complete. 2023-11-28T19:31:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 Processor -- start 2023-11-28T19:31:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 -- start start 2023-11-28T19:31:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f726006aaf0 0x7f7260144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f726014ac70 0x7f72600bfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f726014b0b0 0x7f72601e3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7260145630 con 0x7f726014ac70 2023-11-28T19:31:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72601453d0 con 0x7f726006aaf0 2023-11-28T19:31:52.840 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7260144770 con 0x7f726014b0b0 2023-11-28T19:31:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f725ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f726014ac70 0x7f72600bfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f725ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f726014ac70 0x7f72600bfb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51292/0 (socket says 172.21.15.28:51292) 2023-11-28T19:31:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f725ffff640 1 -- 172.21.15.28:0/2046339590 learned_addr learned my addr 172.21.15.28:0/2046339590 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7264b0e640 1 --2- 172.21.15.28:0/2046339590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f726006aaf0 0x7f7260144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f725ffff640 1 -- 172.21.15.28:0/2046339590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f726014b0b0 msgr2=0x7f72601e3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f725ffff640 1 --2- 172.21.15.28:0/2046339590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f726014b0b0 0x7f72601e3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f725ffff640 1 -- 172.21.15.28:0/2046339590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f726006aaf0 msgr2=0x7f7260144230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f725ffff640 1 --2- 172.21.15.28:0/2046339590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f726006aaf0 0x7f7260144230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f725ffff640 1 -- 172.21.15.28:0/2046339590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72500094d0 con 0x7f726014ac70 2023-11-28T19:31:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f725ffff640 1 --2- 172.21.15.28:0/2046339590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f726014ac70 0x7f72600bfb40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f725400b550 tx=0x7f725400ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f725d7fa640 1 -- 172.21.15.28:0/2046339590 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254010870 con 0x7f726014ac70 2023-11-28T19:31:52.841 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f725d7fa640 1 -- 172.21.15.28:0/2046339590 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72540109f0 con 0x7f726014ac70 2023-11-28T19:31:52.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 -- 172.21.15.28:0/2046339590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7260143960 con 0x7f726014ac70 2023-11-28T19:31:52.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f725d7fa640 1 -- 172.21.15.28:0/2046339590 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7254010da0 con 0x7f726014ac70 2023-11-28T19:31:52.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 -- 172.21.15.28:0/2046339590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7260143160 con 0x7f726014ac70 2023-11-28T19:31:52.842 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f7266d72640 1 -- 172.21.15.28:0/2046339590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7260074a90 con 0x7f726014ac70 2023-11-28T19:31:52.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.834+0000 7f725d7fa640 1 -- 172.21.15.28:0/2046339590 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f725400f3c0 con 0x7f726014ac70 2023-11-28T19:31:52.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.838+0000 7f725d7fa640 1 --2- 172.21.15.28:0/2046339590 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f724c0664c0 0x7f724c068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:52.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.838+0000 7f725d7fa640 1 -- 172.21.15.28:0/2046339590 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7254083d30 con 0x7f726014ac70 2023-11-28T19:31:52.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.838+0000 7f7264b0e640 1 --2- 172.21.15.28:0/2046339590 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f724c0664c0 0x7f724c068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:52.843 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.838+0000 7f7264b0e640 1 --2- 172.21.15.28:0/2046339590 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f724c0664c0 0x7f724c068980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f72500af000 tx=0x7f7250008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:52.845 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.842+0000 7f725d7fa640 1 -- 172.21.15.28:0/2046339590 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7254051320 con 0x7f726014ac70 2023-11-28T19:31:52.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.994+0000 7f7266d72640 1 -- 172.21.15.28:0/2046339590 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f726014a1a0 con 0x7f726014ac70 2023-11-28T19:31:53.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.998+0000 7f725d7fa640 1 -- 172.21.15.28:0/2046339590 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f7254054940 con 0x7f726014ac70 2023-11-28T19:31:53.002 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:53.002 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:53.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.998+0000 7f7266d72640 1 -- 172.21.15.28:0/2046339590 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f724c0664c0 msgr2=0x7f724c068980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.998+0000 7f7266d72640 1 --2- 172.21.15.28:0/2046339590 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f724c0664c0 0x7f724c068980 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f72500af000 tx=0x7f7250008040 comp rx=0 tx=0).stop 2023-11-28T19:31:53.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.998+0000 7f7266d72640 1 -- 172.21.15.28:0/2046339590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f726014ac70 msgr2=0x7f72600bfb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.998+0000 7f7266d72640 1 --2- 172.21.15.28:0/2046339590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f726014ac70 0x7f72600bfb40 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f725400b550 tx=0x7f725400ba10 comp rx=0 tx=0).stop 2023-11-28T19:31:53.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.998+0000 7f7266d72640 1 -- 172.21.15.28:0/2046339590 shutdown_connections 2023-11-28T19:31:53.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.998+0000 7f7266d72640 1 --2- 172.21.15.28:0/2046339590 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f724c0664c0 0x7f724c068980 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.998+0000 7f7266d72640 1 --2- 172.21.15.28:0/2046339590 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f726014b0b0 0x7f72601e3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.998+0000 7f7266d72640 1 --2- 172.21.15.28:0/2046339590 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f726014ac70 0x7f72600bfb40 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.998+0000 7f7266d72640 1 --2- 172.21.15.28:0/2046339590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f726006aaf0 0x7f7260144230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.998+0000 7f7266d72640 1 -- 172.21.15.28:0/2046339590 >> 172.21.15.28:0/2046339590 conn(0x7f72600bd790 msgr2=0x7f72600b9920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:53.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.998+0000 7f7266d72640 1 -- 172.21.15.28:0/2046339590 shutdown_connections 2023-11-28T19:31:53.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:52.998+0000 7f7266d72640 1 -- 172.21.15.28:0/2046339590 wait complete. 2023-11-28T19:31:53.021 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:31:33.212362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:31:42.810956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:31:43.579438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T19:31:53.021 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:31:53.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.126+0000 7fd15e247640 1 Processor -- start 2023-11-28T19:31:53.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.126+0000 7fd15e247640 1 -- start start 2023-11-28T19:31:53.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd15e247640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd1580bd340 0x7fd158142120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd15e247640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1580728c0 0x7fd1580b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd15e247640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd158142660 0x7fd1580b4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd15e247640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1580b6e90 con 0x7fd158142660 2023-11-28T19:31:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd15e247640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1580b6560 con 0x7fd1580bd340 2023-11-28T19:31:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd15e247640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1580b6840 con 0x7fd1580728c0 2023-11-28T19:31:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd157fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd158142660 0x7fd1580b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd157fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd158142660 0x7fd1580b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51304/0 (socket says 172.21.15.28:51304) 2023-11-28T19:31:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd157fff640 1 -- 172.21.15.28:0/69723324 learned_addr learned my addr 172.21.15.28:0/69723324 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd1577fe640 1 --2- 172.21.15.28:0/69723324 >> v2:172.21.15.131:3300/0 conn(0x7fd1580bd340 0x7fd158142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd156ffd640 1 --2- 172.21.15.28:0/69723324 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1580728c0 0x7fd1580b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.135 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd157fff640 1 -- 172.21.15.28:0/69723324 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1580728c0 msgr2=0x7fd1580b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:53.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd157fff640 1 --2- 172.21.15.28:0/69723324 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1580728c0 0x7fd1580b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd157fff640 1 -- 172.21.15.28:0/69723324 >> v2:172.21.15.131:3300/0 conn(0x7fd1580bd340 msgr2=0x7fd158142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:53.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd157fff640 1 --2- 172.21.15.28:0/69723324 >> v2:172.21.15.131:3300/0 conn(0x7fd1580bd340 0x7fd158142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd157fff640 1 -- 172.21.15.28:0/69723324 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1580b6b20 con 0x7fd158142660 2023-11-28T19:31:53.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd157fff640 1 --2- 172.21.15.28:0/69723324 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd158142660 0x7fd1580b4990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd150009e50 tx=0x7fd15001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7547446bde9ecbc3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:53.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd1567fc640 1 -- 172.21.15.28:0/69723324 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500af400 con 0x7fd158142660 2023-11-28T19:31:53.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd1567fc640 1 -- 172.21.15.28:0/69723324 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1500ab050 con 0x7fd158142660 2023-11-28T19:31:53.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd1567fc640 1 -- 172.21.15.28:0/69723324 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500af780 con 0x7fd158142660 2023-11-28T19:31:53.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd15e247640 1 -- 172.21.15.28:0/69723324 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd158142660 msgr2=0x7fd1580b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.130+0000 7fd15e247640 1 --2- 172.21.15.28:0/69723324 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd158142660 0x7fd1580b4990 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd150009e50 tx=0x7fd15001f1c0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 -- 172.21.15.28:0/69723324 shutdown_connections 2023-11-28T19:31:53.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 --2- 172.21.15.28:0/69723324 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd158142660 0x7fd1580b4990 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 --2- 172.21.15.28:0/69723324 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1580728c0 0x7fd1580b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 --2- 172.21.15.28:0/69723324 >> v2:172.21.15.131:3300/0 conn(0x7fd1580bd340 0x7fd158142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 -- 172.21.15.28:0/69723324 >> 172.21.15.28:0/69723324 conn(0x7fd15806ab80 msgr2=0x7fd1580bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:53.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 -- 172.21.15.28:0/69723324 shutdown_connections 2023-11-28T19:31:53.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 -- 172.21.15.28:0/69723324 wait complete. 2023-11-28T19:31:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 Processor -- start 2023-11-28T19:31:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 -- start start 2023-11-28T19:31:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1580728c0 0x7fd15813d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1580bd340 0x7fd1581df490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd158142660 0x7fd1580bab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1581df040 con 0x7fd158142660 2023-11-28T19:31:53.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15813a510 con 0x7fd1580bd340 2023-11-28T19:31:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15813a710 con 0x7fd1580728c0 2023-11-28T19:31:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd157fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd158142660 0x7fd1580bab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd157fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd158142660 0x7fd1580bab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51314/0 (socket says 172.21.15.28:51314) 2023-11-28T19:31:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd157fff640 1 -- 172.21.15.28:0/541020449 learned_addr learned my addr 172.21.15.28:0/541020449 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd1577fe640 1 --2- 172.21.15.28:0/541020449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1580728c0 0x7fd15813d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd156ffd640 1 --2- 172.21.15.28:0/541020449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1580bd340 0x7fd1581df490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd157fff640 1 -- 172.21.15.28:0/541020449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1580728c0 msgr2=0x7fd15813d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd157fff640 1 --2- 172.21.15.28:0/541020449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1580728c0 0x7fd15813d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd157fff640 1 -- 172.21.15.28:0/541020449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1580bd340 msgr2=0x7fd1581df490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd157fff640 1 --2- 172.21.15.28:0/541020449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1580bd340 0x7fd1581df490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd157fff640 1 -- 172.21.15.28:0/541020449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd150009b30 con 0x7fd158142660 2023-11-28T19:31:53.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd157fff640 1 --2- 172.21.15.28:0/541020449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd158142660 0x7fd1580bab30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd15001d870 tx=0x7fd15001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd13ffff640 1 -- 172.21.15.28:0/541020449 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500c0070 con 0x7fd158142660 2023-11-28T19:31:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd13ffff640 1 -- 172.21.15.28:0/541020449 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd150009510 con 0x7fd158142660 2023-11-28T19:31:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd13ffff640 1 -- 172.21.15.28:0/541020449 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1500afe20 con 0x7fd158142660 2023-11-28T19:31:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 -- 172.21.15.28:0/541020449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1580b9000 con 0x7fd158142660 2023-11-28T19:31:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 -- 172.21.15.28:0/541020449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd158142b60 con 0x7fd158142660 2023-11-28T19:31:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.134+0000 7fd15e247640 1 -- 172.21.15.28:0/541020449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15813d8a0 con 0x7fd158142660 2023-11-28T19:31:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.138+0000 7fd13ffff640 1 -- 172.21.15.28:0/541020449 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd1500b6040 con 0x7fd158142660 2023-11-28T19:31:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.138+0000 7fd13ffff640 1 --2- 172.21.15.28:0/541020449 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd1440664a0 0x7fd144068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.138+0000 7fd13ffff640 1 -- 172.21.15.28:0/541020449 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1501216b0 con 0x7fd158142660 2023-11-28T19:31:53.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.138+0000 7fd1577fe640 1 --2- 172.21.15.28:0/541020449 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd1440664a0 0x7fd144068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.138+0000 7fd1577fe640 1 --2- 172.21.15.28:0/541020449 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd1440664a0 0x7fd144068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd14800b9d0 tx=0x7fd148008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:53.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.142+0000 7fd13ffff640 1 -- 172.21.15.28:0/541020449 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd15813d8a0 con 0x7fd158142660 2023-11-28T19:31:53.299 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.294+0000 7fd15e247640 1 -- 172.21.15.28:0/541020449 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd15813d8a0 con 0x7fd158142660 2023-11-28T19:31:53.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.294+0000 7fd13ffff640 1 -- 172.21.15.28:0/541020449 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd15813d8a0 con 0x7fd158142660 2023-11-28T19:31:53.300 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-28T19:31:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.298+0000 7fd15e247640 1 -- 172.21.15.28:0/541020449 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd1440664a0 msgr2=0x7fd144068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.298+0000 7fd15e247640 1 --2- 172.21.15.28:0/541020449 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd1440664a0 0x7fd144068960 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd14800b9d0 tx=0x7fd148008040 comp rx=0 tx=0).stop 2023-11-28T19:31:53.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.298+0000 7fd15e247640 1 -- 172.21.15.28:0/541020449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd158142660 msgr2=0x7fd1580bab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.298+0000 7fd15e247640 1 --2- 172.21.15.28:0/541020449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd158142660 0x7fd1580bab30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fd15001d870 tx=0x7fd15001bf60 comp rx=0 tx=0).stop 2023-11-28T19:31:53.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.298+0000 7fd15e247640 1 -- 172.21.15.28:0/541020449 shutdown_connections 2023-11-28T19:31:53.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.298+0000 7fd15e247640 1 --2- 172.21.15.28:0/541020449 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd1440664a0 0x7fd144068960 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.298+0000 7fd15e247640 1 --2- 172.21.15.28:0/541020449 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd158142660 0x7fd1580bab30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.298+0000 7fd15e247640 1 --2- 172.21.15.28:0/541020449 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1580bd340 0x7fd1581df490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.298+0000 7fd15e247640 1 --2- 172.21.15.28:0/541020449 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd1580728c0 0x7fd15813d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.298+0000 7fd15e247640 1 -- 172.21.15.28:0/541020449 >> 172.21.15.28:0/541020449 conn(0x7fd15806ab80 msgr2=0x7fd1580b9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:53.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.298+0000 7fd15e247640 1 -- 172.21.15.28:0/541020449 shutdown_connections 2023-11-28T19:31:53.303 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.298+0000 7fd15e247640 1 -- 172.21.15.28:0/541020449 wait complete. 2023-11-28T19:31:53.319 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:31:53.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.438+0000 7f9ad2caf640 1 Processor -- start 2023-11-28T19:31:53.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.438+0000 7f9ad2caf640 1 -- start start 2023-11-28T19:31:53.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9ad2caf640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9acc0b6ac0 0x7f9acc0bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9ad2caf640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9acc150190 0x7f9acc15a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9ad2caf640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9acc0b9100 con 0x7f9acc0b7ce0 2023-11-28T19:31:53.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9ad2caf640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9acc14a140 con 0x7f9acc150190 2023-11-28T19:31:53.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9ad2caf640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0b8810 con 0x7f9acc0b6ac0 2023-11-28T19:31:53.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9ad124c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9acc150190 0x7f9acc15a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9ad124c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f9acc150190 0x7f9acc15a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51318/0 (socket says 172.21.15.28:51318) 2023-11-28T19:31:53.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9ad124c640 1 -- 172.21.15.28:0/2002264150 learned_addr learned my addr 172.21.15.28:0/2002264150 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:53.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9acbfff640 1 --1- 172.21.15.28:0/2002264150 >> v1:172.21.15.28:6789/0 conn(0x7f9acc0b7ce0 0x7f9acc14fa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49702/0 (socket says 172.21.15.28:49702) 2023-11-28T19:31:53.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9ad0a4b640 1 --2- 172.21.15.28:0/2002264150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9acc0b6ac0 0x7f9acc0bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9ad124c640 1 -- 172.21.15.28:0/2002264150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9acc0b6ac0 msgr2=0x7f9acc0bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:53.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9ad124c640 1 --2- 172.21.15.28:0/2002264150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9acc0b6ac0 0x7f9acc0bd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9ad124c640 1 -- 172.21.15.28:0/2002264150 >> v1:172.21.15.28:6789/0 conn(0x7f9acc0b7ce0 legacy=0x7f9acc14fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9ad124c640 1 -- 172.21.15.28:0/2002264150 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9acc0b6ea0 con 0x7f9acc150190 2023-11-28T19:31:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9ad124c640 1 --2- 172.21.15.28:0/2002264150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9acc150190 0x7f9acc15a1b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009e50 tx=0x7f9ac401f1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90edaf1b8583d08 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9acb7fe640 1 -- 172.21.15.28:0/2002264150 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40af400 con 0x7f9acc150190 2023-11-28T19:31:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9acb7fe640 1 -- 172.21.15.28:0/2002264150 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac40ab050 con 0x7f9acc150190 2023-11-28T19:31:53.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.442+0000 7f9acb7fe640 1 -- 172.21.15.28:0/2002264150 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac40af780 con 0x7f9acc150190 2023-11-28T19:31:53.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2002264150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9acc150190 msgr2=0x7f9acc15a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 --2- 172.21.15.28:0/2002264150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9acc150190 0x7f9acc15a1b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f9ac4009e50 tx=0x7f9ac401f1f0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2002264150 shutdown_connections 2023-11-28T19:31:53.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 --2- 172.21.15.28:0/2002264150 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9acc150190 0x7f9acc15a1b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 --2- 172.21.15.28:0/2002264150 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9acc0b6ac0 0x7f9acc0bd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2002264150 >> 172.21.15.28:0/2002264150 conn(0x7f9acc06ab80 msgr2=0x7f9acc0bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:53.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2002264150 shutdown_connections 2023-11-28T19:31:53.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2002264150 wait complete. 2023-11-28T19:31:53.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 Processor -- start 2023-11-28T19:31:53.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 -- start start 2023-11-28T19:31:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9acc0b6ac0 0x7f9acc0710a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9acc0b7ce0 0x7f9acc06f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9acc150190 0x7f9acc1418a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc0715e0 con 0x7f9acc0b6ac0 2023-11-28T19:31:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc1e5160 con 0x7f9acc0b7ce0 2023-11-28T19:31:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9acc1464d0 con 0x7f9acc150190 2023-11-28T19:31:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad0a4b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9acc0b6ac0 0x7f9acc0710a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad0a4b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9acc0b6ac0 0x7f9acc0710a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51324/0 (socket says 172.21.15.28:51324) 2023-11-28T19:31:53.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad0a4b640 1 -- 172.21.15.28:0/2405932520 learned_addr learned my addr 172.21.15.28:0/2405932520 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:53.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9acbfff640 1 --2- 172.21.15.28:0/2405932520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9acc0b7ce0 0x7f9acc06f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad0a4b640 1 -- 172.21.15.28:0/2405932520 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9acc150190 msgr2=0x7f9acc1418a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad0a4b640 1 --2- 172.21.15.28:0/2405932520 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9acc150190 0x7f9acc1418a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad0a4b640 1 -- 172.21.15.28:0/2405932520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9acc0b7ce0 msgr2=0x7f9acc06f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad0a4b640 1 --2- 172.21.15.28:0/2405932520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9acc0b7ce0 0x7f9acc06f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad0a4b640 1 -- 172.21.15.28:0/2405932520 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac4009b30 con 0x7f9acc0b6ac0 2023-11-28T19:31:53.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9acbfff640 1 --2- 172.21.15.28:0/2405932520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9acc0b7ce0 0x7f9acc06f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:53.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad0a4b640 1 --2- 172.21.15.28:0/2405932520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9acc0b6ac0 0x7f9acc0710a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400d800 tx=0x7f9ab400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:53.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ac97fa640 1 -- 172.21.15.28:0/2405932520 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab400b6c0 con 0x7f9acc0b6ac0 2023-11-28T19:31:53.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ac97fa640 1 -- 172.21.15.28:0/2405932520 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab400b820 con 0x7f9acc0b6ac0 2023-11-28T19:31:53.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2405932520 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9acc1e53b0 con 0x7f9acc0b6ac0 2023-11-28T19:31:53.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ac97fa640 1 -- 172.21.15.28:0/2405932520 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab400bb90 con 0x7f9acc0b6ac0 2023-11-28T19:31:53.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.446+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2405932520 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9acc1e5970 con 0x7f9acc0b6ac0 2023-11-28T19:31:53.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.450+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2405932520 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9acc0b4400 con 0x7f9acc0b6ac0 2023-11-28T19:31:53.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.450+0000 7f9ac97fa640 1 -- 172.21.15.28:0/2405932520 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9ab400bcf0 con 0x7f9acc0b6ac0 2023-11-28T19:31:53.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.450+0000 7f9ac97fa640 1 --2- 172.21.15.28:0/2405932520 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9aac0664a0 0x7f9aac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.450+0000 7f9ac97fa640 1 -- 172.21.15.28:0/2405932520 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ab4084310 con 0x7f9acc0b6ac0 2023-11-28T19:31:53.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.450+0000 7f9acbfff640 1 --2- 172.21.15.28:0/2405932520 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9aac0664a0 0x7f9aac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.450+0000 7f9acbfff640 1 --2- 172.21.15.28:0/2405932520 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9aac0664a0 0x7f9aac068960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9acc04f160 tx=0x7f9abc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:53.458 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.454+0000 7f9ac97fa640 1 -- 172.21.15.28:0/2405932520 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9ab4051820 con 0x7f9acc0b6ac0 2023-11-28T19:31:53.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.602+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2405932520 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9acc074a90 con 0x7f9acc0b6ac0 2023-11-28T19:31:53.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.606+0000 7f9ac97fa640 1 -- 172.21.15.28:0/2405932520 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ab4054e40 con 0x7f9acc0b6ac0 2023-11-28T19:31:53.610 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-28T19:31:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.606+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2405932520 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9aac0664a0 msgr2=0x7f9aac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.606+0000 7f9ad2caf640 1 --2- 172.21.15.28:0/2405932520 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9aac0664a0 0x7f9aac068960 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9acc04f160 tx=0x7f9abc009040 comp rx=0 tx=0).stop 2023-11-28T19:31:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.606+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2405932520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9acc0b6ac0 msgr2=0x7f9acc0710a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.606+0000 7f9ad2caf640 1 --2- 172.21.15.28:0/2405932520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9acc0b6ac0 0x7f9acc0710a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9ab400d800 tx=0x7f9ab400dcc0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.606+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2405932520 shutdown_connections 2023-11-28T19:31:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.606+0000 7f9ad2caf640 1 --2- 172.21.15.28:0/2405932520 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9aac0664a0 0x7f9aac068960 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.606+0000 7f9ad2caf640 1 --2- 172.21.15.28:0/2405932520 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9acc150190 0x7f9acc1418a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.606+0000 7f9ad2caf640 1 --2- 172.21.15.28:0/2405932520 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9acc0b7ce0 0x7f9acc06f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.606+0000 7f9ad2caf640 1 --2- 172.21.15.28:0/2405932520 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9acc0b6ac0 0x7f9acc0710a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.606+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2405932520 >> 172.21.15.28:0/2405932520 conn(0x7f9acc06ab80 msgr2=0x7f9acc14d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:53.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.606+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2405932520 shutdown_connections 2023-11-28T19:31:53.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.606+0000 7f9ad2caf640 1 -- 172.21.15.28:0/2405932520 wait complete. 2023-11-28T19:31:53.628 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:31:53.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f57339d3640 1 Processor -- start 2023-11-28T19:31:53.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f57339d3640 1 -- start start 2023-11-28T19:31:53.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f57339d3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c06b7f0 0x7f572c071c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f57339d3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f572c0b9720 0x7f572c1539c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f57339d3640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f572c0b6cb0 con 0x7f572c0b6870 2023-11-28T19:31:53.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f57339d3640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f572c0668d0 con 0x7f572c0b9720 2023-11-28T19:31:53.757 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f57339d3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0b71d0 con 0x7f572c06b7f0 2023-11-28T19:31:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5730f6e640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f572c0b6870 0x7f572c142ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49712/0 (socket says 172.21.15.28:49712) 2023-11-28T19:31:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5730f6e640 1 -- 172.21.15.28:0/3175342296 learned_addr learned my addr 172.21.15.28:0/3175342296 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f573176f640 1 --2- 172.21.15.28:0/3175342296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c06b7f0 0x7f572c071c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5731f70640 1 --2- 172.21.15.28:0/3175342296 >> v2:172.21.15.131:3300/0 conn(0x7f572c0b9720 0x7f572c1539c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 -- 172.21.15.28:0/3175342296 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4126313848 0 0) 0x7f572c0b6cb0 con 0x7f572c0b6870 2023-11-28T19:31:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 -- 172.21.15.28:0/3175342296 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5718003530 con 0x7f572c0b6870 2023-11-28T19:31:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 -- 172.21.15.28:0/3175342296 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 320042018 0 0) 0x7f5718003530 con 0x7f572c0b6870 2023-11-28T19:31:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 -- 172.21.15.28:0/3175342296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c06b7f0 msgr2=0x7f572c071c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 --2- 172.21.15.28:0/3175342296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c06b7f0 0x7f572c071c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 -- 172.21.15.28:0/3175342296 >> v2:172.21.15.131:3300/0 conn(0x7f572c0b9720 msgr2=0x7f572c1539c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 --2- 172.21.15.28:0/3175342296 >> v2:172.21.15.131:3300/0 conn(0x7f572c0b9720 0x7f572c1539c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.758 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 -- 172.21.15.28:0/3175342296 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c0b74b0 con 0x7f572c0b6870 2023-11-28T19:31:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 -- 172.21.15.28:0/3175342296 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f571c001680 con 0x7f572c0b6870 2023-11-28T19:31:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 -- 172.21.15.28:0/3175342296 >> v1:172.21.15.28:6789/0 conn(0x7f572c0b6870 legacy=0x7f572c142ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 --2- 172.21.15.28:0/3175342296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5718003980 0x7f5718003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 --2- 172.21.15.28:0/3175342296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c06b7f0 0x7f57180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 --2- 172.21.15.28:0/3175342296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5718004d10 0x7f5718005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 -- 172.21.15.28:0/3175342296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0668d0 con 0x7f5718004d10 2023-11-28T19:31:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 -- 172.21.15.28:0/3175342296 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c0b71d0 con 0x7f5718003980 2023-11-28T19:31:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5723fff640 1 -- 172.21.15.28:0/3175342296 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f571800b990 con 0x7f572c06b7f0 2023-11-28T19:31:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5731f70640 1 --2- 172.21.15.28:0/3175342296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5718004d10 0x7f5718005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f573176f640 1 --2- 172.21.15.28:0/3175342296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5718003980 0x7f5718003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5730f6e640 1 --2- 172.21.15.28:0/3175342296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c06b7f0 0x7f57180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5731f70640 1 -- 172.21.15.28:0/3175342296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c06b7f0 msgr2=0x7f57180047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:53.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5731f70640 1 --2- 172.21.15.28:0/3175342296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c06b7f0 0x7f57180047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5731f70640 1 -- 172.21.15.28:0/3175342296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5718003980 msgr2=0x7f5718003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:53.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5731f70640 1 --2- 172.21.15.28:0/3175342296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5718003980 0x7f5718003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5731f70640 1 -- 172.21.15.28:0/3175342296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5718003530 con 0x7f5718004d10 2023-11-28T19:31:53.760 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.750+0000 7f5730f6e640 1 --2- 172.21.15.28:0/3175342296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c06b7f0 0x7f57180047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:53.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.754+0000 7f5731f70640 1 --2- 172.21.15.28:0/3175342296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5718004d10 0x7f5718005190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5724009fc0 tx=0x7f572401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f546593be607a92 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:53.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.754+0000 7f5723fff640 1 -- 172.21.15.28:0/3175342296 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57240a5cb0 con 0x7f5718004d10 2023-11-28T19:31:53.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.754+0000 7f5723fff640 1 -- 172.21.15.28:0/3175342296 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572400f040 con 0x7f5718004d10 2023-11-28T19:31:53.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.754+0000 7f5723fff640 1 -- 172.21.15.28:0/3175342296 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57240ad680 con 0x7f5718004d10 2023-11-28T19:31:53.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.754+0000 7f57339d3640 1 -- 172.21.15.28:0/3175342296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5718004d10 msgr2=0x7f5718005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.754+0000 7f57339d3640 1 --2- 172.21.15.28:0/3175342296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5718004d10 0x7f5718005190 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5724009fc0 tx=0x7f572401cca0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.754+0000 7f5731f70640 1 -- 172.21.15.28:0/3175342296 reap_dead start 2023-11-28T19:31:53.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.754+0000 7f57339d3640 1 -- 172.21.15.28:0/3175342296 shutdown_connections 2023-11-28T19:31:53.763 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.754+0000 7f57339d3640 1 -- 172.21.15.28:0/3175342296 >> 172.21.15.28:0/3175342296 conn(0x7f572c0b9e20 msgr2=0x7f572c0ba230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.754+0000 7f57339d3640 1 -- 172.21.15.28:0/3175342296 shutdown_connections 2023-11-28T19:31:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.754+0000 7f57339d3640 1 -- 172.21.15.28:0/3175342296 wait complete. 2023-11-28T19:31:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.754+0000 7f57339d3640 1 Processor -- start 2023-11-28T19:31:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.754+0000 7f57339d3640 1 -- start start 2023-11-28T19:31:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f57339d3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c148f10 0x7f572c1492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f57339d3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f572c1cf1b0 0x7f572c1498b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f57339d3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f572c147c00 0x7f572c148080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f57339d3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c1cf5f0 con 0x7f572c1cf1b0 2023-11-28T19:31:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f57339d3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c146af0 con 0x7f572c147c00 2023-11-28T19:31:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f57339d3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f572c1485c0 con 0x7f572c148f10 2023-11-28T19:31:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5730f6e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f572c1cf1b0 0x7f572c1498b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.764 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5730f6e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f572c1cf1b0 0x7f572c1498b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51336/0 (socket says 172.21.15.28:51336) 2023-11-28T19:31:53.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5730f6e640 1 -- 172.21.15.28:0/2298069632 learned_addr learned my addr 172.21.15.28:0/2298069632 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:53.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f573176f640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c148f10 0x7f572c1492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5731f70640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f572c147c00 0x7f572c148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5730f6e640 1 -- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c148f10 msgr2=0x7f572c1492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5730f6e640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c148f10 0x7f572c1492f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5730f6e640 1 -- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f572c147c00 msgr2=0x7f572c148080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5730f6e640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f572c147c00 0x7f572c148080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5730f6e640 1 -- 172.21.15.28:0/2298069632 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c1d5c60 con 0x7f572c1cf1b0 2023-11-28T19:31:53.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f573176f640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c148f10 0x7f572c1492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:53.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5731f70640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f572c147c00 0x7f572c148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:53.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5730f6e640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f572c1cf1b0 0x7f572c1498b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f571c00db10 tx=0x7f571c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:53.765 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5721ffb640 1 -- 172.21.15.28:0/2298069632 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c004cc0 con 0x7f572c1cf1b0 2023-11-28T19:31:53.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5721ffb640 1 -- 172.21.15.28:0/2298069632 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571c004e20 con 0x7f572c1cf1b0 2023-11-28T19:31:53.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f57339d3640 1 -- 172.21.15.28:0/2298069632 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572c1d5f40 con 0x7f572c1cf1b0 2023-11-28T19:31:53.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5721ffb640 1 -- 172.21.15.28:0/2298069632 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571c007310 con 0x7f572c1cf1b0 2023-11-28T19:31:53.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f57339d3640 1 -- 172.21.15.28:0/2298069632 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c1476e0 con 0x7f572c1cf1b0 2023-11-28T19:31:53.766 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f57339d3640 1 -- 172.21.15.28:0/2298069632 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572c147900 con 0x7f572c1cf1b0 2023-11-28T19:31:53.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5721ffb640 1 -- 172.21.15.28:0/2298069632 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f571c007470 con 0x7f572c1cf1b0 2023-11-28T19:31:53.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5721ffb640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5710066470 0x7f5710068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:53.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f5721ffb640 1 -- 172.21.15.28:0/2298069632 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f571c083b30 con 0x7f572c1cf1b0 2023-11-28T19:31:53.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.758+0000 7f573176f640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5710066470 0x7f5710068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:53.767 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.762+0000 7f573176f640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5710066470 0x7f5710068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5728009a20 tx=0x7f5728008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:53.768 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.762+0000 7f5721ffb640 1 -- 172.21.15.28:0/2298069632 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f571c051040 con 0x7f572c1cf1b0 2023-11-28T19:31:53.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.922+0000 7f57339d3640 1 -- 172.21.15.28:0/2298069632 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f572c0b8fd0 con 0x7f572c1cf1b0 2023-11-28T19:31:53.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.922+0000 7f5721ffb640 1 -- 172.21.15.28:0/2298069632 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f571c0190a0 con 0x7f572c1cf1b0 2023-11-28T19:31:53.926 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-28T19:31:53.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.922+0000 7f57339d3640 1 -- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5710066470 msgr2=0x7f5710068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.922+0000 7f57339d3640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5710066470 0x7f5710068930 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5728009a20 tx=0x7f5728008040 comp rx=0 tx=0).stop 2023-11-28T19:31:53.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.922+0000 7f57339d3640 1 -- 172.21.15.28:0/2298069632 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f572c1cf1b0 msgr2=0x7f572c1498b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:53.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.922+0000 7f57339d3640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f572c1cf1b0 0x7f572c1498b0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f571c00db10 tx=0x7f571c0016d0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.928 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.922+0000 7f57339d3640 1 -- 172.21.15.28:0/2298069632 shutdown_connections 2023-11-28T19:31:53.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.922+0000 7f57339d3640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f5710066470 0x7f5710068930 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.922+0000 7f57339d3640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f572c147c00 0x7f572c148080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.922+0000 7f57339d3640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f572c1cf1b0 0x7f572c1498b0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.922+0000 7f57339d3640 1 --2- 172.21.15.28:0/2298069632 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f572c148f10 0x7f572c1492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:53.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.922+0000 7f57339d3640 1 -- 172.21.15.28:0/2298069632 >> 172.21.15.28:0/2298069632 conn(0x7f572c0b9e20 msgr2=0x7f572c142c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:53.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.922+0000 7f57339d3640 1 -- 172.21.15.28:0/2298069632 shutdown_connections 2023-11-28T19:31:53.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:53.922+0000 7f57339d3640 1 -- 172.21.15.28:0/2298069632 wait complete. 2023-11-28T19:31:53.945 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:31:54.062 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.058+0000 7f64fd425640 1 Processor -- start 2023-11-28T19:31:54.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.058+0000 7f64fd425640 1 -- start start 2023-11-28T19:31:54.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.058+0000 7f64fd425640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f64f80bab20 0x7f64f80b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.058+0000 7f64fd425640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f80b4650 con 0x7f64f806f540 2023-11-28T19:31:54.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.058+0000 7f64fd425640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64f806d440 con 0x7f64f80b59c0 2023-11-28T19:31:54.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.058+0000 7f64fd425640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64f80b42e0 con 0x7f64f80bab20 2023-11-28T19:31:54.065 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.058+0000 7f64f6ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f64f80bab20 0x7f64f80b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.058+0000 7f64f77fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f64f806f540 0x7f64f8155dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49716/0 (socket says 172.21.15.28:49716) 2023-11-28T19:31:54.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.058+0000 7f64f77fe640 1 -- 172.21.15.28:0/880896420 learned_addr learned my addr 172.21.15.28:0/880896420 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:54.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.058+0000 7f64f5ffb640 1 -- 172.21.15.28:0/880896420 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 602332386 0 0) 0x7f64f80b4650 con 0x7f64f806f540 2023-11-28T19:31:54.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.058+0000 7f64f6ffd640 1 -- 172.21.15.28:0/880896420 >> v1:172.21.15.131:6789/0 conn(0x7f64f80b59c0 legacy=0x7f64f814b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:54.066 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.058+0000 7f64f6ffd640 1 -- 172.21.15.28:0/880896420 >> v1:172.21.15.28:6789/0 conn(0x7f64f806f540 legacy=0x7f64f8155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.058+0000 7f64f6ffd640 1 -- 172.21.15.28:0/880896420 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f80baf00 con 0x7f64f80bab20 2023-11-28T19:31:54.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64f6ffd640 1 --2- 172.21.15.28:0/880896420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64f80bab20 0x7f64f80b5100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0097c0 tx=0x7f64ec01c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89a14b01523cb9a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:54.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64f5ffb640 1 -- 172.21.15.28:0/880896420 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0ab600 con 0x7f64f80bab20 2023-11-28T19:31:54.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64f5ffb640 1 -- 172.21.15.28:0/880896420 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec0a7050 con 0x7f64f80bab20 2023-11-28T19:31:54.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64f5ffb640 1 -- 172.21.15.28:0/880896420 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0ab980 con 0x7f64f80bab20 2023-11-28T19:31:54.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 -- 172.21.15.28:0/880896420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64f80bab20 msgr2=0x7f64f80b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 --2- 172.21.15.28:0/880896420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64f80bab20 0x7f64f80b5100 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0097c0 tx=0x7f64ec01c320 comp rx=0 tx=0).stop 2023-11-28T19:31:54.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 -- 172.21.15.28:0/880896420 shutdown_connections 2023-11-28T19:31:54.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 --2- 172.21.15.28:0/880896420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64f80bab20 0x7f64f80b5100 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 -- 172.21.15.28:0/880896420 >> 172.21.15.28:0/880896420 conn(0x7f64f80beaf0 msgr2=0x7f64f80bef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:54.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 -- 172.21.15.28:0/880896420 shutdown_connections 2023-11-28T19:31:54.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 -- 172.21.15.28:0/880896420 wait complete. 2023-11-28T19:31:54.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 Processor -- start 2023-11-28T19:31:54.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 -- start start 2023-11-28T19:31:54.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64f806f540 0x7f64f81405b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64f80b59c0 0x7f64f8144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64f80bab20 0x7f64f813ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f81e4920 con 0x7f64f806f540 2023-11-28T19:31:54.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64f813de90 con 0x7f64f80b59c0 2023-11-28T19:31:54.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.062+0000 7f64fd425640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64f81e4ba0 con 0x7f64f80bab20 2023-11-28T19:31:54.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64f6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64f806f540 0x7f64f81405b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64f6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64f806f540 0x7f64f81405b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51350/0 (socket says 172.21.15.28:51350) 2023-11-28T19:31:54.073 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64f6ffd640 1 -- 172.21.15.28:0/3588291873 learned_addr learned my addr 172.21.15.28:0/3588291873 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:54.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64f77fe640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64f80bab20 0x7f64f813ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64f67fc640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64f80b59c0 0x7f64f8144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64f6ffd640 1 -- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64f80bab20 msgr2=0x7f64f813ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64f6ffd640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64f80bab20 0x7f64f813ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64f6ffd640 1 -- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64f80b59c0 msgr2=0x7f64f8144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64f6ffd640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64f80b59c0 0x7f64f8144850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.074 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64f6ffd640 1 -- 172.21.15.28:0/3588291873 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64ec009420 con 0x7f64f806f540 2023-11-28T19:31:54.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64f77fe640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64f80bab20 0x7f64f813ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:54.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64f67fc640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64f80b59c0 0x7f64f8144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:54.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64f6ffd640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64f806f540 0x7f64f81405b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0ae040 tx=0x7f64ec01ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:54.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64df7fe640 1 -- 172.21.15.28:0/3588291873 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0b7650 con 0x7f64f806f540 2023-11-28T19:31:54.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64df7fe640 1 -- 172.21.15.28:0/3588291873 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64ec0b77d0 con 0x7f64f806f540 2023-11-28T19:31:54.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64fd425640 1 -- 172.21.15.28:0/3588291873 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64f81e4e80 con 0x7f64f806f540 2023-11-28T19:31:54.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64df7fe640 1 -- 172.21.15.28:0/3588291873 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64ec0b7b80 con 0x7f64f806f540 2023-11-28T19:31:54.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64fd425640 1 -- 172.21.15.28:0/3588291873 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64f8140af0 con 0x7f64f806f540 2023-11-28T19:31:54.075 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64fd425640 1 -- 172.21.15.28:0/3588291873 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64f81e5330 con 0x7f64f806f540 2023-11-28T19:31:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64df7fe640 1 -- 172.21.15.28:0/3588291873 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f64ec0b7ce0 con 0x7f64f806f540 2023-11-28T19:31:54.076 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64df7fe640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f64e40664a0 0x7f64e4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64df7fe640 1 -- 172.21.15.28:0/3588291873 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f64ec11e810 con 0x7f64f806f540 2023-11-28T19:31:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.066+0000 7f64f67fc640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f64e40664a0 0x7f64e4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.070+0000 7f64f67fc640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f64e40664a0 0x7f64e4068960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f64f80b8f30 tx=0x7f64e8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:54.077 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.070+0000 7f64df7fe640 1 -- 172.21.15.28:0/3588291873 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f64f81e5330 con 0x7f64f806f540 2023-11-28T19:31:54.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.254+0000 7f64fd425640 1 -- 172.21.15.28:0/3588291873 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64f81e5330 con 0x7f64f806f540 2023-11-28T19:31:54.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.254+0000 7f64df7fe640 1 -- 172.21.15.28:0/3588291873 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7f64f81e5330 con 0x7f64f806f540 2023-11-28T19:31:54.260 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:54.260 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3575778574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3575778574},{"type":"v1","addr":"172.21.15.131:6835","nonce":3575778574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6833/1578638846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1578638846},{"type":"v1","addr":"172.21.15.28:6833","nonce":1578638846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:31:44.589007+0000","modified":"2023-11-28T19:31:47.643502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2598774147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2598774147},{"type":"v1","addr":"172.21.15.28:6835","nonce":2598774147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:31:54.261 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-11-28T19:31:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.258+0000 7f64fd425640 1 -- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f64e40664a0 msgr2=0x7f64e4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.258+0000 7f64fd425640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f64e40664a0 0x7f64e4068960 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f64f80b8f30 tx=0x7f64e8009040 comp rx=0 tx=0).stop 2023-11-28T19:31:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.258+0000 7f64fd425640 1 -- 172.21.15.28:0/3588291873 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64f806f540 msgr2=0x7f64f81405b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.258+0000 7f64fd425640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64f806f540 0x7f64f81405b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f64ec0ae040 tx=0x7f64ec01ab60 comp rx=0 tx=0).stop 2023-11-28T19:31:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.258+0000 7f64fd425640 1 -- 172.21.15.28:0/3588291873 shutdown_connections 2023-11-28T19:31:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.258+0000 7f64fd425640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f64e40664a0 0x7f64e4068960 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.258+0000 7f64fd425640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f64f80bab20 0x7f64f813ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.258+0000 7f64fd425640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64f80b59c0 0x7f64f8144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.258+0000 7f64fd425640 1 --2- 172.21.15.28:0/3588291873 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f64f806f540 0x7f64f81405b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.258+0000 7f64fd425640 1 -- 172.21.15.28:0/3588291873 >> 172.21.15.28:0/3588291873 conn(0x7f64f80beaf0 msgr2=0x7f64f80bcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:54.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.258+0000 7f64fd425640 1 -- 172.21.15.28:0/3588291873 shutdown_connections 2023-11-28T19:31:54.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.258+0000 7f64fd425640 1 -- 172.21.15.28:0/3588291873 wait complete. 2023-11-28T19:31:54.277 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:54.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f163dc0f640 1 Processor -- start 2023-11-28T19:31:54.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f163dc0f640 1 -- start start 2023-11-28T19:31:54.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f163dc0f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16380b5dd0 0x7f16380b6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.402 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f163dc0f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f16380b47e0 0x7f16380b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f163dc0f640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1638142940 con 0x7f1638142560 2023-11-28T19:31:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f163dc0f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f163806f950 con 0x7f16380b47e0 2023-11-28T19:31:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f163dc0f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f163814bb40 con 0x7f16380b5dd0 2023-11-28T19:31:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f1637fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f16380b47e0 0x7f16380b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f1636ffd640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16380b5dd0 0x7f16380b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f16377fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f1638142560 0x7f16380b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:42680/0 (socket says 172.21.15.28:42680) 2023-11-28T19:31:54.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f16377fe640 1 -- 172.21.15.28:0/744986411 learned_addr learned my addr 172.21.15.28:0/744986411 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:54.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f1637fff640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f16380b47e0 0x7f16380b69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:48212/0 (socket says 172.21.15.28:48212) 2023-11-28T19:31:54.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f1636ffd640 1 -- 172.21.15.28:0/744986411 >> v2:172.21.15.131:3300/0 conn(0x7f16380b47e0 msgr2=0x7f16380b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:54.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f1636ffd640 1 --2- 172.21.15.28:0/744986411 >> v2:172.21.15.131:3300/0 conn(0x7f16380b47e0 0x7f16380b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f1636ffd640 1 -- 172.21.15.28:0/744986411 >> v1:172.21.15.131:6789/0 conn(0x7f1638142560 legacy=0x7f16380b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.398+0000 7f1636ffd640 1 -- 172.21.15.28:0/744986411 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f163814be20 con 0x7f16380b5dd0 2023-11-28T19:31:54.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f1636ffd640 1 --2- 172.21.15.28:0/744986411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16380b5dd0 0x7f16380b6470 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f162c0097c0 tx=0x7f162c01ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56ab9baf5e472ebb server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f16367fc640 1 -- 172.21.15.28:0/744986411 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c0a8970 con 0x7f16380b5dd0 2023-11-28T19:31:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f16367fc640 1 -- 172.21.15.28:0/744986411 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f162c0a8ad0 con 0x7f16380b5dd0 2023-11-28T19:31:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f16367fc640 1 -- 172.21.15.28:0/744986411 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f162c0a8e60 con 0x7f16380b5dd0 2023-11-28T19:31:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 -- 172.21.15.28:0/744986411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16380b5dd0 msgr2=0x7f16380b6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 --2- 172.21.15.28:0/744986411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16380b5dd0 0x7f16380b6470 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f162c0097c0 tx=0x7f162c01ec70 comp rx=0 tx=0).stop 2023-11-28T19:31:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 -- 172.21.15.28:0/744986411 shutdown_connections 2023-11-28T19:31:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 --2- 172.21.15.28:0/744986411 >> v2:172.21.15.131:3300/0 conn(0x7f16380b47e0 0x7f16380b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 --2- 172.21.15.28:0/744986411 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16380b5dd0 0x7f16380b6470 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 -- 172.21.15.28:0/744986411 >> 172.21.15.28:0/744986411 conn(0x7f16380bcb40 msgr2=0x7f16380bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 -- 172.21.15.28:0/744986411 shutdown_connections 2023-11-28T19:31:54.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 -- 172.21.15.28:0/744986411 wait complete. 2023-11-28T19:31:54.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 Processor -- start 2023-11-28T19:31:54.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 -- start start 2023-11-28T19:31:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16380b47e0 0x7f1638140210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16380b5dd0 0x7f16381e18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1638142560 0x7f16380720d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16381e0e90 con 0x7f16380b47e0 2023-11-28T19:31:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16380719d0 con 0x7f1638142560 2023-11-28T19:31:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f163dc0f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1638070770 con 0x7f16380b5dd0 2023-11-28T19:31:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f16377fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16380b47e0 0x7f1638140210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f16377fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16380b47e0 0x7f1638140210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51364/0 (socket says 172.21.15.28:51364) 2023-11-28T19:31:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f16377fe640 1 -- 172.21.15.28:0/3346903148 learned_addr learned my addr 172.21.15.28:0/3346903148 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f1637fff640 1 --2- 172.21.15.28:0/3346903148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1638142560 0x7f16380720d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f1636ffd640 1 --2- 172.21.15.28:0/3346903148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16380b5dd0 0x7f16381e18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f16377fe640 1 -- 172.21.15.28:0/3346903148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16380b5dd0 msgr2=0x7f16381e18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f16377fe640 1 --2- 172.21.15.28:0/3346903148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16380b5dd0 0x7f16381e18e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f16377fe640 1 -- 172.21.15.28:0/3346903148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1638142560 msgr2=0x7f16380720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f16377fe640 1 --2- 172.21.15.28:0/3346903148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1638142560 0x7f16380720d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.402+0000 7f16377fe640 1 -- 172.21.15.28:0/3346903148 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f162c009420 con 0x7f16380b47e0 2023-11-28T19:31:54.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.406+0000 7f16377fe640 1 --2- 172.21.15.28:0/3346903148 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16380b47e0 0x7f1638140210 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f162800c370 tx=0x7f162800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:54.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.406+0000 7f161ffff640 1 -- 172.21.15.28:0/3346903148 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1628005cf0 con 0x7f16380b47e0 2023-11-28T19:31:54.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.406+0000 7f161ffff640 1 -- 172.21.15.28:0/3346903148 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1628005e50 con 0x7f16380b47e0 2023-11-28T19:31:54.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.406+0000 7f161ffff640 1 -- 172.21.15.28:0/3346903148 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16280072f0 con 0x7f16380b47e0 2023-11-28T19:31:54.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.406+0000 7f163dc0f640 1 -- 172.21.15.28:0/3346903148 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1638070a50 con 0x7f16380b47e0 2023-11-28T19:31:54.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.406+0000 7f163dc0f640 1 -- 172.21.15.28:0/3346903148 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16381e13c0 con 0x7f16380b47e0 2023-11-28T19:31:54.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.406+0000 7f163dc0f640 1 -- 172.21.15.28:0/3346903148 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1638070c90 con 0x7f16380b47e0 2023-11-28T19:31:54.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.406+0000 7f161ffff640 1 -- 172.21.15.28:0/3346903148 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1628007450 con 0x7f16380b47e0 2023-11-28T19:31:54.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.406+0000 7f161ffff640 1 --2- 172.21.15.28:0/3346903148 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1624066470 0x7f1624068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.406+0000 7f161ffff640 1 -- 172.21.15.28:0/3346903148 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1628083370 con 0x7f16380b47e0 2023-11-28T19:31:54.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.406+0000 7f1636ffd640 1 --2- 172.21.15.28:0/3346903148 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1624066470 0x7f1624068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.406+0000 7f1636ffd640 1 --2- 172.21.15.28:0/3346903148 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1624066470 0x7f1624068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f162c0b2000 tx=0x7f162c0aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:54.416 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.410+0000 7f161ffff640 1 -- 172.21.15.28:0/3346903148 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1628050880 con 0x7f16380b47e0 2023-11-28T19:31:54.572 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.566+0000 7f163dc0f640 1 -- 172.21.15.28:0/3346903148 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1638074a90 con 0x7f16380b47e0 2023-11-28T19:31:54.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.570+0000 7f161ffff640 1 -- 172.21.15.28:0/3346903148 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f1628053ea0 con 0x7f16380b47e0 2023-11-28T19:31:54.575 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:54.575 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:54.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.570+0000 7f163dc0f640 1 -- 172.21.15.28:0/3346903148 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1624066470 msgr2=0x7f1624068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.570+0000 7f163dc0f640 1 --2- 172.21.15.28:0/3346903148 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1624066470 0x7f1624068930 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f162c0b2000 tx=0x7f162c0aa070 comp rx=0 tx=0).stop 2023-11-28T19:31:54.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.570+0000 7f163dc0f640 1 -- 172.21.15.28:0/3346903148 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16380b47e0 msgr2=0x7f1638140210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.570+0000 7f163dc0f640 1 --2- 172.21.15.28:0/3346903148 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16380b47e0 0x7f1638140210 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f162800c370 tx=0x7f162800c830 comp rx=0 tx=0).stop 2023-11-28T19:31:54.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.570+0000 7f163dc0f640 1 -- 172.21.15.28:0/3346903148 shutdown_connections 2023-11-28T19:31:54.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.570+0000 7f163dc0f640 1 --2- 172.21.15.28:0/3346903148 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1624066470 0x7f1624068930 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.570+0000 7f163dc0f640 1 --2- 172.21.15.28:0/3346903148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1638142560 0x7f16380720d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.570+0000 7f163dc0f640 1 --2- 172.21.15.28:0/3346903148 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f16380b5dd0 0x7f16381e18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.570+0000 7f163dc0f640 1 --2- 172.21.15.28:0/3346903148 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f16380b47e0 0x7f1638140210 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.570+0000 7f163dc0f640 1 -- 172.21.15.28:0/3346903148 >> 172.21.15.28:0/3346903148 conn(0x7f16380bcb40 msgr2=0x7f16380b7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:54.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.570+0000 7f163dc0f640 1 -- 172.21.15.28:0/3346903148 shutdown_connections 2023-11-28T19:31:54.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.570+0000 7f163dc0f640 1 -- 172.21.15.28:0/3346903148 wait complete. 2023-11-28T19:31:54.594 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:31:33.212362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:31:42.810956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:31:43.579438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T19:31:54.594 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:31:54.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f227a1b0640 1 Processor -- start 2023-11-28T19:31:54.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f227a1b0640 1 -- start start 2023-11-28T19:31:54.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f227a1b0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2274148020 0x7f2274148480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f227a1b0640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22740b8da0 con 0x7f22741424d0 2023-11-28T19:31:54.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f227a1b0640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22740b9920 con 0x7f22740b74f0 2023-11-28T19:31:54.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f227a1b0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22740b6d70 con 0x7f2274148020 2023-11-28T19:31:54.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22737fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f22741424d0 0x7f22740717b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49730/0 (socket says 172.21.15.28:49730) 2023-11-28T19:31:54.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22737fe640 1 -- 172.21.15.28:0/1840230289 learned_addr learned my addr 172.21.15.28:0/1840230289 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:54.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f2273fff640 1 --2- 172.21.15.28:0/1840230289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2274148020 0x7f2274148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 -- 172.21.15.28:0/1840230289 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757921265 0 0) 0x7f22740b8da0 con 0x7f22741424d0 2023-11-28T19:31:54.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 -- 172.21.15.28:0/1840230289 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f225c005740 con 0x7f22741424d0 2023-11-28T19:31:54.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 -- 172.21.15.28:0/1840230289 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 832296409 0 0) 0x7f225c005740 con 0x7f22741424d0 2023-11-28T19:31:54.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 -- 172.21.15.28:0/1840230289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2274148020 msgr2=0x7f2274148480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:54.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 --2- 172.21.15.28:0/1840230289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2274148020 0x7f2274148480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 -- 172.21.15.28:0/1840230289 >> v1:172.21.15.131:6789/0 conn(0x7f22740b74f0 legacy=0x7f227406b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 -- 172.21.15.28:0/1840230289 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227406bca0 con 0x7f22741424d0 2023-11-28T19:31:54.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 -- 172.21.15.28:0/1840230289 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f2264001a00 con 0x7f22741424d0 2023-11-28T19:31:54.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 -- 172.21.15.28:0/1840230289 >> v1:172.21.15.28:6789/0 conn(0x7f22741424d0 legacy=0x7f22740717b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 --2- 172.21.15.28:0/1840230289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f225c005bc0 0x7f225c005fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 --2- 172.21.15.28:0/1840230289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2274148020 0x7f225c0069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 --2- 172.21.15.28:0/1840230289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f225c006f20 0x7f225c0073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 -- 172.21.15.28:0/1840230289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22740b6d70 con 0x7f225c006f20 2023-11-28T19:31:54.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 -- 172.21.15.28:0/1840230289 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f225c00dc80 con 0x7f225c005bc0 2023-11-28T19:31:54.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22727fc640 1 -- 172.21.15.28:0/1840230289 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f225c00de40 con 0x7f2274148020 2023-11-28T19:31:54.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f2273fff640 1 --2- 172.21.15.28:0/1840230289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f225c006f20 0x7f225c0073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f2272ffd640 1 --2- 172.21.15.28:0/1840230289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2274148020 0x7f225c0069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f22737fe640 1 --2- 172.21.15.28:0/1840230289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f225c005bc0 0x7f225c005fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f2273fff640 1 -- 172.21.15.28:0/1840230289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2274148020 msgr2=0x7f225c0069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:54.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f2273fff640 1 --2- 172.21.15.28:0/1840230289 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2274148020 0x7f225c0069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f2273fff640 1 -- 172.21.15.28:0/1840230289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f225c005bc0 msgr2=0x7f225c005fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:54.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f2273fff640 1 --2- 172.21.15.28:0/1840230289 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f225c005bc0 0x7f225c005fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.710+0000 7f2273fff640 1 -- 172.21.15.28:0/1840230289 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f225c005740 con 0x7f225c006f20 2023-11-28T19:31:54.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f2273fff640 1 --2- 172.21.15.28:0/1840230289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f225c006f20 0x7f225c0073a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f226c009ab0 tx=0x7f226c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f39e9f63976dc94a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:54.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f22727fc640 1 -- 172.21.15.28:0/1840230289 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c0a5620 con 0x7f225c006f20 2023-11-28T19:31:54.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f22727fc640 1 -- 172.21.15.28:0/1840230289 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226c0a5780 con 0x7f225c006f20 2023-11-28T19:31:54.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f22727fc640 1 -- 172.21.15.28:0/1840230289 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226c0a5b30 con 0x7f225c006f20 2023-11-28T19:31:54.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f227a1b0640 1 -- 172.21.15.28:0/1840230289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f225c006f20 msgr2=0x7f225c0073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f227a1b0640 1 --2- 172.21.15.28:0/1840230289 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f225c006f20 0x7f225c0073a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f226c009ab0 tx=0x7f226c01ca30 comp rx=0 tx=0).stop 2023-11-28T19:31:54.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f2273fff640 1 -- 172.21.15.28:0/1840230289 reap_dead start 2023-11-28T19:31:54.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f227a1b0640 1 -- 172.21.15.28:0/1840230289 shutdown_connections 2023-11-28T19:31:54.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f227a1b0640 1 -- 172.21.15.28:0/1840230289 >> 172.21.15.28:0/1840230289 conn(0x7f22740b9d90 msgr2=0x7f22740ba1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:54.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f227a1b0640 1 -- 172.21.15.28:0/1840230289 shutdown_connections 2023-11-28T19:31:54.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f227a1b0640 1 -- 172.21.15.28:0/1840230289 wait complete. 2023-11-28T19:31:54.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f227a1b0640 1 Processor -- start 2023-11-28T19:31:54.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f227a1b0640 1 -- start start 2023-11-28T19:31:54.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f227a1b0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c006f20 0x7f227413a8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f227a1b0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2274145250 0x7f22741e04d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f227a1b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22741e0a10 0x7f2274138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f227a1b0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227413ade0 con 0x7f2274145250 2023-11-28T19:31:54.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f227a1b0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2274142970 con 0x7f22741e0a10 2023-11-28T19:31:54.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f227a1b0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2274143210 con 0x7f225c006f20 2023-11-28T19:31:54.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f2272ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2274145250 0x7f22741e04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f2272ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2274145250 0x7f22741e04d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51384/0 (socket says 172.21.15.28:51384) 2023-11-28T19:31:54.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.714+0000 7f2272ffd640 1 -- 172.21.15.28:0/4126805296 learned_addr learned my addr 172.21.15.28:0/4126805296 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:54.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f22737fe640 1 --2- 172.21.15.28:0/4126805296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c006f20 0x7f227413a8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f2273fff640 1 --2- 172.21.15.28:0/4126805296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22741e0a10 0x7f2274138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f2272ffd640 1 -- 172.21.15.28:0/4126805296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c006f20 msgr2=0x7f227413a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f2272ffd640 1 --2- 172.21.15.28:0/4126805296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c006f20 0x7f227413a8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f2272ffd640 1 -- 172.21.15.28:0/4126805296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22741e0a10 msgr2=0x7f2274138fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f2272ffd640 1 --2- 172.21.15.28:0/4126805296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22741e0a10 0x7f2274138fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f2272ffd640 1 -- 172.21.15.28:0/4126805296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22741e0e90 con 0x7f2274145250 2023-11-28T19:31:54.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f2272ffd640 1 --2- 172.21.15.28:0/4126805296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2274145250 0x7f22741e04d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f226800e5b0 tx=0x7f226800ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:54.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f225bfff640 1 -- 172.21.15.28:0/4126805296 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22680052e0 con 0x7f2274145250 2023-11-28T19:31:54.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f225bfff640 1 -- 172.21.15.28:0/4126805296 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2268005440 con 0x7f2274145250 2023-11-28T19:31:54.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f227a1b0640 1 -- 172.21.15.28:0/4126805296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2274142bc0 con 0x7f2274145250 2023-11-28T19:31:54.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f225bfff640 1 -- 172.21.15.28:0/4126805296 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2268003820 con 0x7f2274145250 2023-11-28T19:31:54.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f227a1b0640 1 -- 172.21.15.28:0/4126805296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2274145e70 con 0x7f2274145250 2023-11-28T19:31:54.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f227a1b0640 1 -- 172.21.15.28:0/4126805296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2274143880 con 0x7f2274145250 2023-11-28T19:31:54.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f225bfff640 1 -- 172.21.15.28:0/4126805296 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2268003980 con 0x7f2274145250 2023-11-28T19:31:54.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f225bfff640 1 --2- 172.21.15.28:0/4126805296 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2260066470 0x7f2260068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:54.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f225bfff640 1 -- 172.21.15.28:0/4126805296 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2268083d40 con 0x7f2274145250 2023-11-28T19:31:54.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f22737fe640 1 --2- 172.21.15.28:0/4126805296 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2260066470 0x7f2260068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:54.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.718+0000 7f22737fe640 1 --2- 172.21.15.28:0/4126805296 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2260066470 0x7f2260068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2264002240 tx=0x7f2264009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:54.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.722+0000 7f225bfff640 1 -- 172.21.15.28:0/4126805296 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2268051130 con 0x7f2274145250 2023-11-28T19:31:54.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.874+0000 7f227a1b0640 1 -- 172.21.15.28:0/4126805296 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2274143880 con 0x7f2274145250 2023-11-28T19:31:54.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.874+0000 7f225bfff640 1 -- 172.21.15.28:0/4126805296 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2268054750 con 0x7f2274145250 2023-11-28T19:31:54.879 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-28T19:31:54.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.874+0000 7f227a1b0640 1 -- 172.21.15.28:0/4126805296 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2260066470 msgr2=0x7f2260068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.874+0000 7f227a1b0640 1 --2- 172.21.15.28:0/4126805296 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2260066470 0x7f2260068930 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f2264002240 tx=0x7f2264009040 comp rx=0 tx=0).stop 2023-11-28T19:31:54.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.874+0000 7f227a1b0640 1 -- 172.21.15.28:0/4126805296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2274145250 msgr2=0x7f22741e04d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:54.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.874+0000 7f227a1b0640 1 --2- 172.21.15.28:0/4126805296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2274145250 0x7f22741e04d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f226800e5b0 tx=0x7f226800ea70 comp rx=0 tx=0).stop 2023-11-28T19:31:54.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.874+0000 7f227a1b0640 1 -- 172.21.15.28:0/4126805296 shutdown_connections 2023-11-28T19:31:54.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.874+0000 7f227a1b0640 1 --2- 172.21.15.28:0/4126805296 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2260066470 0x7f2260068930 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.874+0000 7f227a1b0640 1 --2- 172.21.15.28:0/4126805296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22741e0a10 0x7f2274138fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.874+0000 7f227a1b0640 1 --2- 172.21.15.28:0/4126805296 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2274145250 0x7f22741e04d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.874+0000 7f227a1b0640 1 --2- 172.21.15.28:0/4126805296 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f225c006f20 0x7f227413a8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:54.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.874+0000 7f227a1b0640 1 -- 172.21.15.28:0/4126805296 >> 172.21.15.28:0/4126805296 conn(0x7f22740b9d90 msgr2=0x7f227406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:54.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.878+0000 7f227a1b0640 1 -- 172.21.15.28:0/4126805296 shutdown_connections 2023-11-28T19:31:54.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:54.878+0000 7f227a1b0640 1 -- 172.21.15.28:0/4126805296 wait complete. 2023-11-28T19:31:54.897 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:31:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4c188b640 1 Processor -- start 2023-11-28T19:31:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4c188b640 1 -- start start 2023-11-28T19:31:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4c188b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4bc06aed0 0x7fd4bc14b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4c188b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd4bc14bc20 0x7fd4bc155da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4c188b640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc0bd5e0 con 0x7fd4bc06aaf0 2023-11-28T19:31:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4c188b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc0bc1c0 con 0x7fd4bc14bc20 2023-11-28T19:31:55.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4c188b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc06b310 con 0x7fd4bc06aed0 2023-11-28T19:31:55.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4bb7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd4bc14bc20 0x7fd4bc155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4baffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd4bc06aaf0 0x7fd4bc14ac70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49742/0 (socket says 172.21.15.28:49742) 2023-11-28T19:31:55.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4baffd640 1 -- 172.21.15.28:0/2501768100 learned_addr learned my addr 172.21.15.28:0/2501768100 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:55.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4ba7fc640 1 -- 172.21.15.28:0/2501768100 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297761850 0 0) 0x7fd4bc0bd5e0 con 0x7fd4bc06aaf0 2023-11-28T19:31:55.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4ba7fc640 1 -- 172.21.15.28:0/2501768100 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4a8003530 con 0x7fd4bc06aaf0 2023-11-28T19:31:55.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4b3fff640 1 --2- 172.21.15.28:0/2501768100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4bc06aed0 0x7fd4bc14b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4bb7fe640 1 -- 172.21.15.28:0/2501768100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4bc06aed0 msgr2=0x7fd4bc14b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:55.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4bb7fe640 1 --2- 172.21.15.28:0/2501768100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4bc06aed0 0x7fd4bc14b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4bb7fe640 1 -- 172.21.15.28:0/2501768100 >> v1:172.21.15.28:6789/0 conn(0x7fd4bc06aaf0 legacy=0x7fd4bc14ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4bb7fe640 1 -- 172.21.15.28:0/2501768100 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc06bca0 con 0x7fd4bc14bc20 2023-11-28T19:31:55.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4bb7fe640 1 --2- 172.21.15.28:0/2501768100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4bc14bc20 0x7fd4bc155da0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009d90 tx=0x7fd4b401c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab7cf37002b36b78 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:55.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4ba7fc640 1 -- 172.21.15.28:0/2501768100 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40a5810 con 0x7fd4bc14bc20 2023-11-28T19:31:55.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4ba7fc640 1 -- 172.21.15.28:0/2501768100 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b40a5970 con 0x7fd4bc14bc20 2023-11-28T19:31:55.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.006+0000 7fd4ba7fc640 1 -- 172.21.15.28:0/2501768100 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40a5ce0 con 0x7fd4bc14bc20 2023-11-28T19:31:55.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 -- 172.21.15.28:0/2501768100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4bc14bc20 msgr2=0x7fd4bc155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 --2- 172.21.15.28:0/2501768100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4bc14bc20 0x7fd4bc155da0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd4b4009d90 tx=0x7fd4b401c950 comp rx=0 tx=0).stop 2023-11-28T19:31:55.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 -- 172.21.15.28:0/2501768100 shutdown_connections 2023-11-28T19:31:55.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 --2- 172.21.15.28:0/2501768100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4bc14bc20 0x7fd4bc155da0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 --2- 172.21.15.28:0/2501768100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4bc06aed0 0x7fd4bc14b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 -- 172.21.15.28:0/2501768100 >> 172.21.15.28:0/2501768100 conn(0x7fd4bc0bd790 msgr2=0x7fd4bc0bdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:55.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 -- 172.21.15.28:0/2501768100 shutdown_connections 2023-11-28T19:31:55.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 -- 172.21.15.28:0/2501768100 wait complete. 2023-11-28T19:31:55.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 Processor -- start 2023-11-28T19:31:55.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 -- start start 2023-11-28T19:31:55.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4bc06aaf0 0x7fd4bc1410c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4bc06aed0 0x7fd4bc1466c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4bc14bc20 0x7fd4bc1e6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc141600 con 0x7fd4bc14bc20 2023-11-28T19:31:55.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc1e3950 con 0x7fd4bc06aed0 2023-11-28T19:31:55.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc1e41f0 con 0x7fd4bc06aaf0 2023-11-28T19:31:55.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4bb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4bc14bc20 0x7fd4bc1e6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4bb7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4bc14bc20 0x7fd4bc1e6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:51402/0 (socket says 172.21.15.28:51402) 2023-11-28T19:31:55.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4bb7fe640 1 -- 172.21.15.28:0/4275511399 learned_addr learned my addr 172.21.15.28:0/4275511399 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:55.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4baffd640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4bc06aaf0 0x7fd4bc1410c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4b3fff640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4bc06aed0 0x7fd4bc1466c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4bb7fe640 1 -- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4bc06aaf0 msgr2=0x7fd4bc1410c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4bb7fe640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4bc06aaf0 0x7fd4bc1410c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4bb7fe640 1 -- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4bc06aed0 msgr2=0x7fd4bc1466c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4bb7fe640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4bc06aed0 0x7fd4bc1466c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4bb7fe640 1 -- 172.21.15.28:0/4275511399 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4009a70 con 0x7fd4bc14bc20 2023-11-28T19:31:55.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4b3fff640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4bc06aed0 0x7fd4bc1466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:55.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4bb7fe640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4bc14bc20 0x7fd4bc1e6e50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd4b401ce30 tx=0x7fd4b40196f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:55.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4b8ff9640 1 -- 172.21.15.28:0/4275511399 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40bd070 con 0x7fd4bc14bc20 2023-11-28T19:31:55.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4b8ff9640 1 -- 172.21.15.28:0/4275511399 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b40039a0 con 0x7fd4bc14bc20 2023-11-28T19:31:55.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 -- 172.21.15.28:0/4275511399 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc147fe0 con 0x7fd4bc14bc20 2023-11-28T19:31:55.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4b8ff9640 1 -- 172.21.15.28:0/4275511399 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4003d70 con 0x7fd4bc14bc20 2023-11-28T19:31:55.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.010+0000 7fd4c188b640 1 -- 172.21.15.28:0/4275511399 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc0bff40 con 0x7fd4bc14bc20 2023-11-28T19:31:55.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.014+0000 7fd4c188b640 1 -- 172.21.15.28:0/4275511399 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc1e4380 con 0x7fd4bc14bc20 2023-11-28T19:31:55.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.014+0000 7fd4b8ff9640 1 -- 172.21.15.28:0/4275511399 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd4b40b4070 con 0x7fd4bc14bc20 2023-11-28T19:31:55.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.014+0000 7fd4b8ff9640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd49c066470 0x7fd49c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.014+0000 7fd4b8ff9640 1 -- 172.21.15.28:0/4275511399 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4b411e350 con 0x7fd4bc14bc20 2023-11-28T19:31:55.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.014+0000 7fd4baffd640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd49c066470 0x7fd49c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.014+0000 7fd4baffd640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd49c066470 0x7fd49c068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac005890 tx=0x7fd4ac009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:55.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.018+0000 7fd4b8ff9640 1 -- 172.21.15.28:0/4275511399 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd4b40eb860 con 0x7fd4bc14bc20 2023-11-28T19:31:55.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.166+0000 7fd4c188b640 1 -- 172.21.15.28:0/4275511399 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd4bc1e3cb0 con 0x7fd4bc14bc20 2023-11-28T19:31:55.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.166+0000 7fd4b8ff9640 1 -- 172.21.15.28:0/4275511399 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd4b40eee80 con 0x7fd4bc14bc20 2023-11-28T19:31:55.173 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-28T19:31:55.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.170+0000 7fd4c188b640 1 -- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd49c066470 msgr2=0x7fd49c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.170+0000 7fd4c188b640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd49c066470 0x7fd49c068930 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac005890 tx=0x7fd4ac009040 comp rx=0 tx=0).stop 2023-11-28T19:31:55.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.170+0000 7fd4c188b640 1 -- 172.21.15.28:0/4275511399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4bc14bc20 msgr2=0x7fd4bc1e6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.170+0000 7fd4c188b640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4bc14bc20 0x7fd4bc1e6e50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd4b401ce30 tx=0x7fd4b40196f0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.170+0000 7fd4c188b640 1 -- 172.21.15.28:0/4275511399 shutdown_connections 2023-11-28T19:31:55.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.170+0000 7fd4c188b640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd49c066470 0x7fd49c068930 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.170+0000 7fd4c188b640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd4bc14bc20 0x7fd4bc1e6e50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.170+0000 7fd4c188b640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd4bc06aed0 0x7fd4bc1466c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.170+0000 7fd4c188b640 1 --2- 172.21.15.28:0/4275511399 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd4bc06aaf0 0x7fd4bc1410c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.170+0000 7fd4c188b640 1 -- 172.21.15.28:0/4275511399 >> 172.21.15.28:0/4275511399 conn(0x7fd4bc0bd790 msgr2=0x7fd4bc0bf670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:55.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.170+0000 7fd4c188b640 1 -- 172.21.15.28:0/4275511399 shutdown_connections 2023-11-28T19:31:55.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.170+0000 7fd4c188b640 1 -- 172.21.15.28:0/4275511399 wait complete. 2023-11-28T19:31:55.191 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:31:55.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.306+0000 7f84b435f640 1 Processor -- start 2023-11-28T19:31:55.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.306+0000 7f84b435f640 1 -- start start 2023-11-28T19:31:55.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b435f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f84ac072940 0x7f84ac154c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b435f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ac143b60 con 0x7f84ac0a2d60 2023-11-28T19:31:55.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b435f640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ac0bd7f0 con 0x7f84ac0bc120 2023-11-28T19:31:55.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b435f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ac0b6f30 con 0x7f84ac072940 2023-11-28T19:31:55.314 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b18fa640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f84ac0a2d60 0x7f84ac14c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42346/0 (socket says 172.21.15.28:42346) 2023-11-28T19:31:55.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b18fa640 1 -- 172.21.15.28:0/2425449114 learned_addr learned my addr 172.21.15.28:0/2425449114 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:55.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b28fc640 1 --2- 172.21.15.28:0/2425449114 >> v2:172.21.15.131:3300/0 conn(0x7f84ac072940 0x7f84ac154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 -- 172.21.15.28:0/2425449114 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1625798157 0 0) 0x7f84ac143b60 con 0x7f84ac0a2d60 2023-11-28T19:31:55.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 -- 172.21.15.28:0/2425449114 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8498003530 con 0x7f84ac0a2d60 2023-11-28T19:31:55.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 -- 172.21.15.28:0/2425449114 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3326484307 0 0) 0x7f8498003530 con 0x7f84ac0a2d60 2023-11-28T19:31:55.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 -- 172.21.15.28:0/2425449114 >> v2:172.21.15.131:3300/0 conn(0x7f84ac072940 msgr2=0x7f84ac154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:55.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 --2- 172.21.15.28:0/2425449114 >> v2:172.21.15.131:3300/0 conn(0x7f84ac072940 0x7f84ac154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 -- 172.21.15.28:0/2425449114 >> v1:172.21.15.131:6789/0 conn(0x7f84ac0bc120 legacy=0x7f84ac0bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 -- 172.21.15.28:0/2425449114 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac0b7aa0 con 0x7f84ac0a2d60 2023-11-28T19:31:55.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 -- 172.21.15.28:0/2425449114 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f84a0001680 con 0x7f84ac0a2d60 2023-11-28T19:31:55.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 -- 172.21.15.28:0/2425449114 >> v1:172.21.15.28:6789/0 conn(0x7f84ac0a2d60 legacy=0x7f84ac14c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 --2- 172.21.15.28:0/2425449114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8498003980 0x7f8498003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 --2- 172.21.15.28:0/2425449114 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84980047d0 0x7f8498004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 --2- 172.21.15.28:0/2425449114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8498005190 0x7f849800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 -- 172.21.15.28:0/2425449114 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac0b6f30 con 0x7f84980047d0 2023-11-28T19:31:55.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 -- 172.21.15.28:0/2425449114 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849800c040 con 0x7f8498005190 2023-11-28T19:31:55.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b10f9640 1 -- 172.21.15.28:0/2425449114 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849800c200 con 0x7f8498003980 2023-11-28T19:31:55.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b18fa640 1 --2- 172.21.15.28:0/2425449114 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84980047d0 0x7f8498004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b20fb640 1 --2- 172.21.15.28:0/2425449114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8498003980 0x7f8498003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b18fa640 1 -- 172.21.15.28:0/2425449114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8498003980 msgr2=0x7f8498003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:55.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b18fa640 1 --2- 172.21.15.28:0/2425449114 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8498003980 0x7f8498003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b18fa640 1 -- 172.21.15.28:0/2425449114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8498005190 msgr2=0x7f849800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:55.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b18fa640 1 --2- 172.21.15.28:0/2425449114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8498005190 0x7f849800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b18fa640 1 -- 172.21.15.28:0/2425449114 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8498003530 con 0x7f84980047d0 2023-11-28T19:31:55.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b28fc640 1 -- 172.21.15.28:0/2425449114 reap_dead start 2023-11-28T19:31:55.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.310+0000 7f84b18fa640 1 --2- 172.21.15.28:0/2425449114 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84980047d0 0x7f8498004c50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f84a000c210 tx=0x7f84a001cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bff4f90558409e2e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:55.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b10f9640 1 -- 172.21.15.28:0/2425449114 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a00a5b20 con 0x7f84980047d0 2023-11-28T19:31:55.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b10f9640 1 -- 172.21.15.28:0/2425449114 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a00a5c80 con 0x7f84980047d0 2023-11-28T19:31:55.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b10f9640 1 -- 172.21.15.28:0/2425449114 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0005b20 con 0x7f84980047d0 2023-11-28T19:31:55.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 -- 172.21.15.28:0/2425449114 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84980047d0 msgr2=0x7f8498004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 --2- 172.21.15.28:0/2425449114 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84980047d0 0x7f8498004c50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f84a000c210 tx=0x7f84a001cc20 comp rx=0 tx=0).stop 2023-11-28T19:31:55.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 -- 172.21.15.28:0/2425449114 shutdown_connections 2023-11-28T19:31:55.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 --2- 172.21.15.28:0/2425449114 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84980047d0 0x7f8498004c50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 -- 172.21.15.28:0/2425449114 >> 172.21.15.28:0/2425449114 conn(0x7f84ac06ab80 msgr2=0x7f84ac0bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:55.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 -- 172.21.15.28:0/2425449114 shutdown_connections 2023-11-28T19:31:55.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 -- 172.21.15.28:0/2425449114 wait complete. 2023-11-28T19:31:55.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 Processor -- start 2023-11-28T19:31:55.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 -- start start 2023-11-28T19:31:55.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84980047d0 0x7f84ac0a2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac13c720 0x7f84ac138dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84ac139300 0x7f84ac1e1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac0a26b0 con 0x7f84ac139300 2023-11-28T19:31:55.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac139780 con 0x7f84980047d0 2023-11-28T19:31:55.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ac1e0e60 con 0x7f84ac13c720 2023-11-28T19:31:55.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b28fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84ac139300 0x7f84ac1e1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b28fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84ac139300 0x7f84ac1e1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60614/0 (socket says 172.21.15.28:60614) 2023-11-28T19:31:55.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b28fc640 1 -- 172.21.15.28:0/3201537698 learned_addr learned my addr 172.21.15.28:0/3201537698 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:55.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b20fb640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84980047d0 0x7f84ac0a2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b18fa640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac13c720 0x7f84ac138dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b28fc640 1 -- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac13c720 msgr2=0x7f84ac138dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b28fc640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac13c720 0x7f84ac138dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b28fc640 1 -- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84980047d0 msgr2=0x7f84ac0a2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b28fc640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84980047d0 0x7f84ac0a2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b28fc640 1 -- 172.21.15.28:0/3201537698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ac1e4b40 con 0x7f84ac139300 2023-11-28T19:31:55.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b20fb640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84980047d0 0x7f84ac0a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:55.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b28fc640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84ac139300 0x7f84ac1e1310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0bda60 tx=0x7f84a400ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:55.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f849effd640 1 -- 172.21.15.28:0/3201537698 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4010040 con 0x7f84ac139300 2023-11-28T19:31:55.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f849effd640 1 -- 172.21.15.28:0/3201537698 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a400bb30 con 0x7f84ac139300 2023-11-28T19:31:55.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 -- 172.21.15.28:0/3201537698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ac1e4e20 con 0x7f84ac139300 2023-11-28T19:31:55.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f849effd640 1 -- 172.21.15.28:0/3201537698 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a4014400 con 0x7f84ac139300 2023-11-28T19:31:55.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.314+0000 7f84b435f640 1 -- 172.21.15.28:0/3201537698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ac146d00 con 0x7f84ac139300 2023-11-28T19:31:55.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.318+0000 7f84b435f640 1 -- 172.21.15.28:0/3201537698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ac074a90 con 0x7f84ac139300 2023-11-28T19:31:55.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.318+0000 7f849effd640 1 -- 172.21.15.28:0/3201537698 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f84a4014560 con 0x7f84ac139300 2023-11-28T19:31:55.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.318+0000 7f849effd640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8490066470 0x7f8490068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.318+0000 7f849effd640 1 -- 172.21.15.28:0/3201537698 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84a4084df0 con 0x7f84ac139300 2023-11-28T19:31:55.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.318+0000 7f84b20fb640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8490066470 0x7f8490068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.325 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.322+0000 7f84b20fb640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8490066470 0x7f8490068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f84ac069e90 tx=0x7f84a8009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:55.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.322+0000 7f849effd640 1 -- 172.21.15.28:0/3201537698 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f84a40522c0 con 0x7f84ac139300 2023-11-28T19:31:55.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.474+0000 7f84b435f640 1 -- 172.21.15.28:0/3201537698 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f84ac0b6bf0 con 0x7f84ac139300 2023-11-28T19:31:55.481 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.474+0000 7f849effd640 1 -- 172.21.15.28:0/3201537698 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f84a40558e0 con 0x7f84ac139300 2023-11-28T19:31:55.481 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-28T19:31:55.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.478+0000 7f84b435f640 1 -- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8490066470 msgr2=0x7f8490068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.478+0000 7f84b435f640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8490066470 0x7f8490068930 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f84ac069e90 tx=0x7f84a8009040 comp rx=0 tx=0).stop 2023-11-28T19:31:55.483 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.478+0000 7f84b435f640 1 -- 172.21.15.28:0/3201537698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84ac139300 msgr2=0x7f84ac1e1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.478+0000 7f84b435f640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84ac139300 0x7f84ac1e1310 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f84ac0bda60 tx=0x7f84a400ef50 comp rx=0 tx=0).stop 2023-11-28T19:31:55.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.478+0000 7f84b435f640 1 -- 172.21.15.28:0/3201537698 shutdown_connections 2023-11-28T19:31:55.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.478+0000 7f84b435f640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8490066470 0x7f8490068930 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.478+0000 7f84b435f640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f84ac139300 0x7f84ac1e1310 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.478+0000 7f84b435f640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f84ac13c720 0x7f84ac138dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.478+0000 7f84b435f640 1 --2- 172.21.15.28:0/3201537698 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f84980047d0 0x7f84ac0a2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.478+0000 7f84b435f640 1 -- 172.21.15.28:0/3201537698 >> 172.21.15.28:0/3201537698 conn(0x7f84ac06ab80 msgr2=0x7f84ac0bd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:55.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.478+0000 7f84b435f640 1 -- 172.21.15.28:0/3201537698 shutdown_connections 2023-11-28T19:31:55.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.478+0000 7f84b435f640 1 -- 172.21.15.28:0/3201537698 wait complete. 2023-11-28T19:31:55.498 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:31:55.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979f86a640 1 Processor -- start 2023-11-28T19:31:55.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979f86a640 1 -- start start 2023-11-28T19:31:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979f86a640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f97980b5dd0 0x7f97980b6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979f86a640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f97980b47e0 0x7f97980b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979f86a640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9798142940 con 0x7f9798142560 2023-11-28T19:31:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979f86a640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979806f950 con 0x7f97980b47e0 2023-11-28T19:31:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979f86a640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f979814bb40 con 0x7f97980b5dd0 2023-11-28T19:31:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979de07640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f97980b47e0 0x7f97980b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979d606640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9798142560 0x7f97980b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42362/0 (socket says 172.21.15.28:42362) 2023-11-28T19:31:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979d606640 1 -- 172.21.15.28:0/345830062 learned_addr learned my addr 172.21.15.28:0/345830062 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:55.607 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979ce05640 1 --2- 172.21.15.28:0/345830062 >> v2:172.21.15.131:3300/0 conn(0x7f97980b5dd0 0x7f97980b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979de07640 1 -- 172.21.15.28:0/345830062 >> v2:172.21.15.131:3300/0 conn(0x7f97980b5dd0 msgr2=0x7f97980b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:55.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979de07640 1 --2- 172.21.15.28:0/345830062 >> v2:172.21.15.131:3300/0 conn(0x7f97980b5dd0 0x7f97980b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979de07640 1 -- 172.21.15.28:0/345830062 >> v1:172.21.15.28:6789/0 conn(0x7f9798142560 legacy=0x7f97980b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.608 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979de07640 1 -- 172.21.15.28:0/345830062 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f979814be20 con 0x7f97980b47e0 2023-11-28T19:31:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f979de07640 1 --2- 172.21.15.28:0/345830062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97980b47e0 0x7f97980b69b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f979806ce00 tx=0x7f979001f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496eed397d76510b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.602+0000 7f978ffff640 1 -- 172.21.15.28:0/345830062 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97900b0440 con 0x7f97980b47e0 2023-11-28T19:31:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f978ffff640 1 -- 172.21.15.28:0/345830062 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97900b05a0 con 0x7f97980b47e0 2023-11-28T19:31:55.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f978ffff640 1 -- 172.21.15.28:0/345830062 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97900b0930 con 0x7f97980b47e0 2023-11-28T19:31:55.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 -- 172.21.15.28:0/345830062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97980b47e0 msgr2=0x7f97980b69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 --2- 172.21.15.28:0/345830062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97980b47e0 0x7f97980b69b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f979806ce00 tx=0x7f979001f0f0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 -- 172.21.15.28:0/345830062 shutdown_connections 2023-11-28T19:31:55.610 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 --2- 172.21.15.28:0/345830062 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97980b47e0 0x7f97980b69b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 --2- 172.21.15.28:0/345830062 >> v2:172.21.15.131:3300/0 conn(0x7f97980b5dd0 0x7f97980b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 -- 172.21.15.28:0/345830062 >> 172.21.15.28:0/345830062 conn(0x7f97980bcb40 msgr2=0x7f97980bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 -- 172.21.15.28:0/345830062 shutdown_connections 2023-11-28T19:31:55.611 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 -- 172.21.15.28:0/345830062 wait complete. 2023-11-28T19:31:55.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 Processor -- start 2023-11-28T19:31:55.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 -- start start 2023-11-28T19:31:55.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97980b47e0 0x7f9798140630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97980b5dd0 0x7f97980bc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9798142560 0x7f9798141800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97980bc780 con 0x7f97980b5dd0 2023-11-28T19:31:55.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9798141d40 con 0x7f9798142560 2023-11-28T19:31:55.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9798072730 con 0x7f97980b47e0 2023-11-28T19:31:55.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979ce05640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97980b5dd0 0x7f97980bc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979ce05640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97980b5dd0 0x7f97980bc240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60632/0 (socket says 172.21.15.28:60632) 2023-11-28T19:31:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979ce05640 1 -- 172.21.15.28:0/1811968986 learned_addr learned my addr 172.21.15.28:0/1811968986 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979ce05640 1 -- 172.21.15.28:0/1811968986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97980b47e0 msgr2=0x7f9798140630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979de07640 1 --2- 172.21.15.28:0/1811968986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9798142560 0x7f9798141800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979d606640 1 --2- 172.21.15.28:0/1811968986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97980b47e0 0x7f9798140630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979ce05640 1 --2- 172.21.15.28:0/1811968986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97980b47e0 0x7f9798140630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979ce05640 1 -- 172.21.15.28:0/1811968986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9798142560 msgr2=0x7f9798141800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979ce05640 1 --2- 172.21.15.28:0/1811968986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9798142560 0x7f9798141800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979ce05640 1 -- 172.21.15.28:0/1811968986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9790009a70 con 0x7f97980b5dd0 2023-11-28T19:31:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979ce05640 1 --2- 172.21.15.28:0/1811968986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97980b5dd0 0x7f97980bc240 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f978800d7d0 tx=0x7f978800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f978dffb640 1 -- 172.21.15.28:0/1811968986 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978800b6c0 con 0x7f97980b5dd0 2023-11-28T19:31:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f978dffb640 1 -- 172.21.15.28:0/1811968986 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f978800b820 con 0x7f97980b5dd0 2023-11-28T19:31:55.614 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 -- 172.21.15.28:0/1811968986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9798071e90 con 0x7f97980b5dd0 2023-11-28T19:31:55.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f978dffb640 1 -- 172.21.15.28:0/1811968986 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f978800bbd0 con 0x7f97980b5dd0 2023-11-28T19:31:55.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 -- 172.21.15.28:0/1811968986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9798072450 con 0x7f97980b5dd0 2023-11-28T19:31:55.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.606+0000 7f979f86a640 1 -- 172.21.15.28:0/1811968986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9798074a90 con 0x7f97980b5dd0 2023-11-28T19:31:55.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.610+0000 7f978dffb640 1 -- 172.21.15.28:0/1811968986 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f978800bd30 con 0x7f97980b5dd0 2023-11-28T19:31:55.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.610+0000 7f978dffb640 1 --2- 172.21.15.28:0/1811968986 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f977c066470 0x7f977c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.610+0000 7f978dffb640 1 -- 172.21.15.28:0/1811968986 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9788084370 con 0x7f97980b5dd0 2023-11-28T19:31:55.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.610+0000 7f979d606640 1 --2- 172.21.15.28:0/1811968986 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f977c066470 0x7f977c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.610+0000 7f979d606640 1 --2- 172.21.15.28:0/1811968986 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f977c066470 0x7f977c068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9794005890 tx=0x7f9794009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:55.618 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.614+0000 7f978dffb640 1 -- 172.21.15.28:0/1811968986 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9788051880 con 0x7f97980b5dd0 2023-11-28T19:31:55.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.798+0000 7f979f86a640 1 -- 172.21.15.28:0/1811968986 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9798072a30 con 0x7f97980b5dd0 2023-11-28T19:31:55.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.798+0000 7f978dffb640 1 -- 172.21.15.28:0/1811968986 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7f9788054ea0 con 0x7f97980b5dd0 2023-11-28T19:31:55.803 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:55.803 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3575778574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3575778574},{"type":"v1","addr":"172.21.15.131:6835","nonce":3575778574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6833/1578638846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1578638846},{"type":"v1","addr":"172.21.15.28:6833","nonce":1578638846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:31:44.589007+0000","modified":"2023-11-28T19:31:47.643502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2598774147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2598774147},{"type":"v1","addr":"172.21.15.28:6835","nonce":2598774147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:31:55.803 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-11-28T19:31:55.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.798+0000 7f979f86a640 1 -- 172.21.15.28:0/1811968986 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f977c066470 msgr2=0x7f977c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.798+0000 7f979f86a640 1 --2- 172.21.15.28:0/1811968986 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f977c066470 0x7f977c068930 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9794005890 tx=0x7f9794009040 comp rx=0 tx=0).stop 2023-11-28T19:31:55.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.798+0000 7f979f86a640 1 -- 172.21.15.28:0/1811968986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97980b5dd0 msgr2=0x7f97980bc240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.798+0000 7f979f86a640 1 --2- 172.21.15.28:0/1811968986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97980b5dd0 0x7f97980bc240 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f978800d7d0 tx=0x7f978800dc90 comp rx=0 tx=0).stop 2023-11-28T19:31:55.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.798+0000 7f979f86a640 1 -- 172.21.15.28:0/1811968986 shutdown_connections 2023-11-28T19:31:55.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.798+0000 7f979f86a640 1 --2- 172.21.15.28:0/1811968986 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f977c066470 0x7f977c068930 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.798+0000 7f979f86a640 1 --2- 172.21.15.28:0/1811968986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9798142560 0x7f9798141800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.798+0000 7f979f86a640 1 --2- 172.21.15.28:0/1811968986 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f97980b5dd0 0x7f97980bc240 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.798+0000 7f979f86a640 1 --2- 172.21.15.28:0/1811968986 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f97980b47e0 0x7f9798140630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.798+0000 7f979f86a640 1 -- 172.21.15.28:0/1811968986 >> 172.21.15.28:0/1811968986 conn(0x7f97980bcb40 msgr2=0x7f97980b9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:55.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.798+0000 7f979f86a640 1 -- 172.21.15.28:0/1811968986 shutdown_connections 2023-11-28T19:31:55.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.798+0000 7f979f86a640 1 -- 172.21.15.28:0/1811968986 wait complete. 2023-11-28T19:31:55.820 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:55.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f5846586640 1 Processor -- start 2023-11-28T19:31:55.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f5846586640 1 -- start start 2023-11-28T19:31:55.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f5846586640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f584014ccc0 0x7f5840154c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f5846586640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f584006f780 con 0x7f584014c860 2023-11-28T19:31:55.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f5846586640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5840072320 con 0x7f58400b8f30 2023-11-28T19:31:55.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f5846586640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5840143aa0 con 0x7f584014ccc0 2023-11-28T19:31:55.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583f7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f584014c860 0x7f58400b6250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42368/0 (socket says 172.21.15.28:42368) 2023-11-28T19:31:55.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583f7fe640 1 -- 172.21.15.28:0/1328428126 learned_addr learned my addr 172.21.15.28:0/1328428126 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:55.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f5844b23640 1 --2- 172.21.15.28:0/1328428126 >> v2:172.21.15.131:3300/0 conn(0x7f584014ccc0 0x7f5840154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 -- 172.21.15.28:0/1328428126 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 214208377 0 0) 0x7f58280014a0 con 0x7f584014c860 2023-11-28T19:31:55.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 -- 172.21.15.28:0/1328428126 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f582c003530 con 0x7f584014c860 2023-11-28T19:31:55.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 -- 172.21.15.28:0/1328428126 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3785902027 0 0) 0x7f582c003530 con 0x7f584014c860 2023-11-28T19:31:55.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 -- 172.21.15.28:0/1328428126 >> v2:172.21.15.131:3300/0 conn(0x7f584014ccc0 msgr2=0x7f5840154c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:55.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 --2- 172.21.15.28:0/1328428126 >> v2:172.21.15.131:3300/0 conn(0x7f584014ccc0 0x7f5840154c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 -- 172.21.15.28:0/1328428126 >> v1:172.21.15.131:6789/0 conn(0x7f58400b8f30 legacy=0x7f5840071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 -- 172.21.15.28:0/1328428126 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f584006fcf0 con 0x7f584014c860 2023-11-28T19:31:55.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 -- 172.21.15.28:0/1328428126 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f5828001b90 con 0x7f584014c860 2023-11-28T19:31:55.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f5844b23640 1 --2- 172.21.15.28:0/1328428126 >> v2:172.21.15.131:3300/0 conn(0x7f584014ccc0 0x7f5840154c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:31:55.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 -- 172.21.15.28:0/1328428126 >> v1:172.21.15.28:6789/0 conn(0x7f584014c860 legacy=0x7f58400b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 --2- 172.21.15.28:0/1328428126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f582c003980 0x7f582c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 --2- 172.21.15.28:0/1328428126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f582c0047d0 0x7f582c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 --2- 172.21.15.28:0/1328428126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f582c005190 0x7f582c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 -- 172.21.15.28:0/1328428126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5840143aa0 con 0x7f582c0047d0 2023-11-28T19:31:55.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 -- 172.21.15.28:0/1328428126 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c00c0e0 con 0x7f582c005190 2023-11-28T19:31:55.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583effd640 1 -- 172.21.15.28:0/1328428126 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f582c00c2a0 con 0x7f582c003980 2023-11-28T19:31:55.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583f7fe640 1 --2- 172.21.15.28:0/1328428126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f582c0047d0 0x7f582c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f5844b23640 1 --2- 172.21.15.28:0/1328428126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f582c005190 0x7f582c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583f7fe640 1 -- 172.21.15.28:0/1328428126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f582c003980 msgr2=0x7f582c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:55.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583f7fe640 1 --2- 172.21.15.28:0/1328428126 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f582c003980 0x7f582c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583f7fe640 1 -- 172.21.15.28:0/1328428126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f582c005190 msgr2=0x7f582c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:55.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583f7fe640 1 --2- 172.21.15.28:0/1328428126 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f582c005190 0x7f582c00b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f583f7fe640 1 -- 172.21.15.28:0/1328428126 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c003530 con 0x7f582c0047d0 2023-11-28T19:31:55.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.926+0000 7f5844b23640 1 -- 172.21.15.28:0/1328428126 reap_dead start 2023-11-28T19:31:55.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583f7fe640 1 --2- 172.21.15.28:0/1328428126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f582c0047d0 0x7f582c004c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f582800a7e0 tx=0x7f582801fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c39f39eb86ad99b9 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:55.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583effd640 1 -- 172.21.15.28:0/1328428126 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280aa670 con 0x7f582c0047d0 2023-11-28T19:31:55.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583effd640 1 -- 172.21.15.28:0/1328428126 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58280aa7f0 con 0x7f582c0047d0 2023-11-28T19:31:55.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583effd640 1 -- 172.21.15.28:0/1328428126 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58280aabe0 con 0x7f582c0047d0 2023-11-28T19:31:55.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 -- 172.21.15.28:0/1328428126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f582c0047d0 msgr2=0x7f582c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 --2- 172.21.15.28:0/1328428126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f582c0047d0 0x7f582c004c50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f582800a7e0 tx=0x7f582801fa40 comp rx=0 tx=0).stop 2023-11-28T19:31:55.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 -- 172.21.15.28:0/1328428126 shutdown_connections 2023-11-28T19:31:55.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 --2- 172.21.15.28:0/1328428126 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f582c0047d0 0x7f582c004c50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 -- 172.21.15.28:0/1328428126 >> 172.21.15.28:0/1328428126 conn(0x7f58400bcb40 msgr2=0x7f58400bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:55.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 -- 172.21.15.28:0/1328428126 shutdown_connections 2023-11-28T19:31:55.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 -- 172.21.15.28:0/1328428126 wait complete. 2023-11-28T19:31:55.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 Processor -- start 2023-11-28T19:31:55.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 -- start start 2023-11-28T19:31:55.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f582c0047d0 0x7f584013c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5840147b20 0x7f58401d2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58401d2b80 0x7f58401398f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584013c8b0 con 0x7f582c0047d0 2023-11-28T19:31:55.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58401d21b0 con 0x7f5840147b20 2023-11-28T19:31:55.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58401d3000 con 0x7f58401d2b80 2023-11-28T19:31:55.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f582c0047d0 0x7f584013c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f582c0047d0 0x7f584013c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60664/0 (socket says 172.21.15.28:60664) 2023-11-28T19:31:55.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583ffff640 1 -- 172.21.15.28:0/1868175358 learned_addr learned my addr 172.21.15.28:0/1868175358 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:55.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583ffff640 1 -- 172.21.15.28:0/1868175358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58401d2b80 msgr2=0x7f58401398f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583ffff640 1 --2- 172.21.15.28:0/1868175358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58401d2b80 0x7f58401398f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583ffff640 1 -- 172.21.15.28:0/1868175358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5840147b20 msgr2=0x7f58401d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:55.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583ffff640 1 --2- 172.21.15.28:0/1868175358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5840147b20 0x7f58401d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:55.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583ffff640 1 -- 172.21.15.28:0/1868175358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5840149a00 con 0x7f582c0047d0 2023-11-28T19:31:55.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583ffff640 1 --2- 172.21.15.28:0/1868175358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f582c0047d0 0x7f584013c370 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f583000c430 tx=0x7f583000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:55.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583cff9640 1 -- 172.21.15.28:0/1868175358 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58300052d0 con 0x7f582c0047d0 2023-11-28T19:31:55.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583cff9640 1 -- 172.21.15.28:0/1868175358 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5830005430 con 0x7f582c0047d0 2023-11-28T19:31:55.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f583cff9640 1 -- 172.21.15.28:0/1868175358 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5830003840 con 0x7f582c0047d0 2023-11-28T19:31:55.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 -- 172.21.15.28:0/1868175358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5840149ce0 con 0x7f582c0047d0 2023-11-28T19:31:55.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.930+0000 7f5846586640 1 -- 172.21.15.28:0/1868175358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5840149fc0 con 0x7f582c0047d0 2023-11-28T19:31:55.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.934+0000 7f5846586640 1 -- 172.21.15.28:0/1868175358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5840074a90 con 0x7f582c0047d0 2023-11-28T19:31:55.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.934+0000 7f583cff9640 1 -- 172.21.15.28:0/1868175358 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f58300039a0 con 0x7f582c0047d0 2023-11-28T19:31:55.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.934+0000 7f583cff9640 1 --2- 172.21.15.28:0/1868175358 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f58200664a0 0x7f5820068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:55.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.934+0000 7f583cff9640 1 -- 172.21.15.28:0/1868175358 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5830082d50 con 0x7f582c0047d0 2023-11-28T19:31:55.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.934+0000 7f583f7fe640 1 --2- 172.21.15.28:0/1868175358 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f58200664a0 0x7f5820068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:55.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.934+0000 7f583f7fe640 1 --2- 172.21.15.28:0/1868175358 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f58200664a0 0x7f5820068960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f58280b0000 tx=0x7f58280b5040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:55.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:55.938+0000 7f583cff9640 1 -- 172.21.15.28:0/1868175358 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5830086030 con 0x7f582c0047d0 2023-11-28T19:31:56.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.090+0000 7f5846586640 1 -- 172.21.15.28:0/1868175358 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5840072320 con 0x7f582c0047d0 2023-11-28T19:31:56.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.094+0000 7f583cff9640 1 -- 172.21.15.28:0/1868175358 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f5840072320 con 0x7f582c0047d0 2023-11-28T19:31:56.100 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:56.100 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:56.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.098+0000 7f5846586640 1 -- 172.21.15.28:0/1868175358 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f58200664a0 msgr2=0x7f5820068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.098+0000 7f5846586640 1 --2- 172.21.15.28:0/1868175358 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f58200664a0 0x7f5820068960 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f58280b0000 tx=0x7f58280b5040 comp rx=0 tx=0).stop 2023-11-28T19:31:56.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.098+0000 7f5846586640 1 -- 172.21.15.28:0/1868175358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f582c0047d0 msgr2=0x7f584013c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.098+0000 7f5846586640 1 --2- 172.21.15.28:0/1868175358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f582c0047d0 0x7f584013c370 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f583000c430 tx=0x7f583000c8f0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.098+0000 7f5846586640 1 -- 172.21.15.28:0/1868175358 shutdown_connections 2023-11-28T19:31:56.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.098+0000 7f5846586640 1 --2- 172.21.15.28:0/1868175358 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f58200664a0 0x7f5820068960 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.098+0000 7f5846586640 1 --2- 172.21.15.28:0/1868175358 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f58401d2b80 0x7f58401398f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.098+0000 7f5846586640 1 --2- 172.21.15.28:0/1868175358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5840147b20 0x7f58401d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.098+0000 7f5846586640 1 --2- 172.21.15.28:0/1868175358 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f582c0047d0 0x7f584013c370 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.098+0000 7f5846586640 1 -- 172.21.15.28:0/1868175358 >> 172.21.15.28:0/1868175358 conn(0x7f58400bcb40 msgr2=0x7f58400bbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:56.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.098+0000 7f5846586640 1 -- 172.21.15.28:0/1868175358 shutdown_connections 2023-11-28T19:31:56.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.098+0000 7f5846586640 1 -- 172.21.15.28:0/1868175358 wait complete. 2023-11-28T19:31:56.119 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:31:56.241 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.234+0000 7fed72190640 1 Processor -- start 2023-11-28T19:31:56.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed72190640 1 -- start start 2023-11-28T19:31:56.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed72190640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fed6c0b5dd0 0x7fed6c0b6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed72190640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fed6c0b47e0 0x7fed6c0b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed72190640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6c142940 con 0x7fed6c142560 2023-11-28T19:31:56.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed72190640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6c06f950 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed72190640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6c14bb40 con 0x7fed6c0b47e0 2023-11-28T19:31:56.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed6affd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fed6c0b5dd0 0x7fed6c0b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed6b7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fed6c142560 0x7fed6c0b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42378/0 (socket says 172.21.15.28:42378) 2023-11-28T19:31:56.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed6b7fe640 1 -- 172.21.15.28:0/3102000420 learned_addr learned my addr 172.21.15.28:0/3102000420 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:56.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed6affd640 1 -- 172.21.15.28:0/3102000420 >> v2:172.21.15.131:3300/0 conn(0x7fed6c0b47e0 msgr2=0x7fed6c0b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:56.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed6bfff640 1 --2- 172.21.15.28:0/3102000420 >> v2:172.21.15.131:3300/0 conn(0x7fed6c0b47e0 0x7fed6c0b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed6a7fc640 1 -- 172.21.15.28:0/3102000420 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2749128504 0 0) 0x7fed6c142940 con 0x7fed6c142560 2023-11-28T19:31:56.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed6affd640 1 --2- 172.21.15.28:0/3102000420 >> v2:172.21.15.131:3300/0 conn(0x7fed6c0b47e0 0x7fed6c0b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed6affd640 1 -- 172.21.15.28:0/3102000420 >> v1:172.21.15.28:6789/0 conn(0x7fed6c142560 legacy=0x7fed6c0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed6affd640 1 -- 172.21.15.28:0/3102000420 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c14be20 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed6bfff640 1 --2- 172.21.15.28:0/3102000420 >> v2:172.21.15.131:3300/0 conn(0x7fed6c0b47e0 0x7fed6c0b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:56.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed6affd640 1 --2- 172.21.15.28:0/3102000420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed6c0b5dd0 0x7fed6c0b6470 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fed6c149320 tx=0x7fed5c01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=447a0c983fbab8c6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:56.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed6a7fc640 1 -- 172.21.15.28:0/3102000420 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0a8950 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed6a7fc640 1 -- 172.21.15.28:0/3102000420 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c0a8ab0 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.238+0000 7fed6a7fc640 1 -- 172.21.15.28:0/3102000420 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0a8e40 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 -- 172.21.15.28:0/3102000420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed6c0b5dd0 msgr2=0x7fed6c0b6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 --2- 172.21.15.28:0/3102000420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed6c0b5dd0 0x7fed6c0b6470 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fed6c149320 tx=0x7fed5c01ec50 comp rx=0 tx=0).stop 2023-11-28T19:31:56.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 -- 172.21.15.28:0/3102000420 shutdown_connections 2023-11-28T19:31:56.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 --2- 172.21.15.28:0/3102000420 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed6c0b5dd0 0x7fed6c0b6470 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 --2- 172.21.15.28:0/3102000420 >> v2:172.21.15.131:3300/0 conn(0x7fed6c0b47e0 0x7fed6c0b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 -- 172.21.15.28:0/3102000420 >> 172.21.15.28:0/3102000420 conn(0x7fed6c0bcb40 msgr2=0x7fed6c0bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:56.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 -- 172.21.15.28:0/3102000420 shutdown_connections 2023-11-28T19:31:56.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 -- 172.21.15.28:0/3102000420 wait complete. 2023-11-28T19:31:56.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 Processor -- start 2023-11-28T19:31:56.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 -- start start 2023-11-28T19:31:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed6c0b47e0 0x7fed6c140e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed6c0b5dd0 0x7fed6c145200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed6c142560 0x7fed6c145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c141350 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c14b400 con 0x7fed6c0b47e0 2023-11-28T19:31:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed6c142fc0 con 0x7fed6c142560 2023-11-28T19:31:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed6affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed6c0b5dd0 0x7fed6c145200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed6affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed6c0b5dd0 0x7fed6c145200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60682/0 (socket says 172.21.15.28:60682) 2023-11-28T19:31:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed6affd640 1 -- 172.21.15.28:0/3203121864 learned_addr learned my addr 172.21.15.28:0/3203121864 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:56.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed6bfff640 1 --2- 172.21.15.28:0/3203121864 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed6c142560 0x7fed6c145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed6b7fe640 1 --2- 172.21.15.28:0/3203121864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed6c0b47e0 0x7fed6c140e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed6affd640 1 -- 172.21.15.28:0/3203121864 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed6c142560 msgr2=0x7fed6c145740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed6affd640 1 --2- 172.21.15.28:0/3203121864 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed6c142560 0x7fed6c145740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed6affd640 1 -- 172.21.15.28:0/3203121864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed6c0b47e0 msgr2=0x7fed6c140e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed6affd640 1 --2- 172.21.15.28:0/3203121864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed6c0b47e0 0x7fed6c140e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed6affd640 1 -- 172.21.15.28:0/3203121864 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed5c009420 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed6affd640 1 --2- 172.21.15.28:0/3203121864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed6c0b5dd0 0x7fed6c145200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0b3040 tx=0x7fed5c01b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:56.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed53fff640 1 -- 172.21.15.28:0/3203121864 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0b9630 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed53fff640 1 -- 172.21.15.28:0/3203121864 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5c0b97b0 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed53fff640 1 -- 172.21.15.28:0/3203121864 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5c0b9b60 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 -- 172.21.15.28:0/3203121864 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed6c1432a0 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.242+0000 7fed72190640 1 -- 172.21.15.28:0/3203121864 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed6c143860 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.246+0000 7fed72190640 1 -- 172.21.15.28:0/3203121864 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6c074a90 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.246+0000 7fed53fff640 1 -- 172.21.15.28:0/3203121864 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fed5c0b7040 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.246+0000 7fed53fff640 1 --2- 172.21.15.28:0/3203121864 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fed58066470 0x7fed58068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.246+0000 7fed53fff640 1 -- 172.21.15.28:0/3203121864 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed5c121ed0 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.246+0000 7fed6b7fe640 1 --2- 172.21.15.28:0/3203121864 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fed58066470 0x7fed58068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.246+0000 7fed6b7fe640 1 --2- 172.21.15.28:0/3203121864 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fed58066470 0x7fed58068930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fed60000f70 tx=0x7fed60009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:56.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.250+0000 7fed53fff640 1 -- 172.21.15.28:0/3203121864 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fed5c0ef3e0 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.441 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.434+0000 7fed72190640 1 -- 172.21.15.28:0/3203121864 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed6c0b9fa0 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.438+0000 7fed53fff640 1 -- 172.21.15.28:0/3203121864 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7fed5c0b5090 con 0x7fed6c0b5dd0 2023-11-28T19:31:56.442 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:56.442 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3575778574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3575778574},{"type":"v1","addr":"172.21.15.131:6835","nonce":3575778574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6833/1578638846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1578638846},{"type":"v1","addr":"172.21.15.28:6833","nonce":1578638846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:31:44.589007+0000","modified":"2023-11-28T19:31:47.643502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2598774147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2598774147},{"type":"v1","addr":"172.21.15.28:6835","nonce":2598774147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:31:56.442 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-11-28T19:31:56.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.438+0000 7fed72190640 1 -- 172.21.15.28:0/3203121864 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fed58066470 msgr2=0x7fed58068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.438+0000 7fed72190640 1 --2- 172.21.15.28:0/3203121864 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fed58066470 0x7fed58068930 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fed60000f70 tx=0x7fed60009040 comp rx=0 tx=0).stop 2023-11-28T19:31:56.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.438+0000 7fed72190640 1 -- 172.21.15.28:0/3203121864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed6c0b5dd0 msgr2=0x7fed6c145200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.438+0000 7fed72190640 1 --2- 172.21.15.28:0/3203121864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed6c0b5dd0 0x7fed6c145200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fed5c0b3040 tx=0x7fed5c01b9f0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.438+0000 7fed72190640 1 -- 172.21.15.28:0/3203121864 shutdown_connections 2023-11-28T19:31:56.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.438+0000 7fed72190640 1 --2- 172.21.15.28:0/3203121864 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fed58066470 0x7fed58068930 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.438+0000 7fed72190640 1 --2- 172.21.15.28:0/3203121864 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fed6c142560 0x7fed6c145740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.438+0000 7fed72190640 1 --2- 172.21.15.28:0/3203121864 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fed6c0b5dd0 0x7fed6c145200 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.438+0000 7fed72190640 1 --2- 172.21.15.28:0/3203121864 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed6c0b47e0 0x7fed6c140e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.438+0000 7fed72190640 1 -- 172.21.15.28:0/3203121864 >> 172.21.15.28:0/3203121864 conn(0x7fed6c0bcb40 msgr2=0x7fed6c0b5280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:56.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.438+0000 7fed72190640 1 -- 172.21.15.28:0/3203121864 shutdown_connections 2023-11-28T19:31:56.445 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.438+0000 7fed72190640 1 -- 172.21.15.28:0/3203121864 wait complete. 2023-11-28T19:31:56.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T19:31:44.589007+0000', 'modified': '2023-11-28T19:31:47.643502+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4245}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4245': {'gid': 4245, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.28:6835/2598774147', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6834', 'nonce': 2598774147}, {'type': 'v1', 'addr': '172.21.15.28:6835', 'nonce': 2598774147}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T19:31:56.762 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T19:31:56.763 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T19:31:56.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f4370a75640 1 Processor -- start 2023-11-28T19:31:56.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f4370a75640 1 -- start start 2023-11-28T19:31:56.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f4370a75640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f436c0b6010 0x7f436c0bb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f4370a75640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f436c145290 0x7f436c145740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f4370a75640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f436c0b7780 con 0x7f436c14c170 2023-11-28T19:31:56.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f4370a75640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f436c14b4a0 con 0x7f436c0b6010 2023-11-28T19:31:56.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f4370a75640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c0c1bf0 con 0x7f436c145290 2023-11-28T19:31:56.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f436a59c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f436c0b6010 0x7f436c0bb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.896 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f436ad9d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f436c145290 0x7f436c145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f4369d9b640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f436c14c170 0x7f436c0b6f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:37510/0 (socket says 172.21.15.28:37510) 2023-11-28T19:31:56.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f4369d9b640 1 -- 172.21.15.28:0/3763459299 learned_addr learned my addr 172.21.15.28:0/3763459299 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:56.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f436ad9d640 1 -- 172.21.15.28:0/3763459299 >> v2:172.21.15.131:3300/0 conn(0x7f436c0b6010 msgr2=0x7f436c0bb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:56.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f436ad9d640 1 --2- 172.21.15.28:0/3763459299 >> v2:172.21.15.131:3300/0 conn(0x7f436c0b6010 0x7f436c0bb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f436ad9d640 1 -- 172.21.15.28:0/3763459299 >> v1:172.21.15.131:6789/0 conn(0x7f436c14c170 legacy=0x7f436c0b6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.890+0000 7f436ad9d640 1 -- 172.21.15.28:0/3763459299 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f436c14b690 con 0x7f436c145290 2023-11-28T19:31:56.898 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.894+0000 7f436ad9d640 1 --2- 172.21.15.28:0/3763459299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f436c145290 0x7f436c145740 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4364009d90 tx=0x7f436401c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e3084b26def09e6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:56.899 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.894+0000 7f436959a640 1 -- 172.21.15.28:0/3763459299 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43640a59e0 con 0x7f436c145290 2023-11-28T19:31:56.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.894+0000 7f436959a640 1 -- 172.21.15.28:0/3763459299 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43640a5b40 con 0x7f436c145290 2023-11-28T19:31:56.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.894+0000 7f436959a640 1 -- 172.21.15.28:0/3763459299 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43640ad440 con 0x7f436c145290 2023-11-28T19:31:56.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.894+0000 7f4370a75640 1 -- 172.21.15.28:0/3763459299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f436c145290 msgr2=0x7f436c145740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.894+0000 7f4370a75640 1 --2- 172.21.15.28:0/3763459299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f436c145290 0x7f436c145740 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f4364009d90 tx=0x7f436401c920 comp rx=0 tx=0).stop 2023-11-28T19:31:56.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.894+0000 7f4370a75640 1 -- 172.21.15.28:0/3763459299 shutdown_connections 2023-11-28T19:31:56.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.894+0000 7f4370a75640 1 --2- 172.21.15.28:0/3763459299 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f436c145290 0x7f436c145740 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.894+0000 7f4370a75640 1 --2- 172.21.15.28:0/3763459299 >> v2:172.21.15.131:3300/0 conn(0x7f436c0b6010 0x7f436c0bb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.894+0000 7f4370a75640 1 -- 172.21.15.28:0/3763459299 >> 172.21.15.28:0/3763459299 conn(0x7f436c0c0c80 msgr2=0x7f436c0c1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:56.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.894+0000 7f4370a75640 1 -- 172.21.15.28:0/3763459299 shutdown_connections 2023-11-28T19:31:56.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.894+0000 7f4370a75640 1 -- 172.21.15.28:0/3763459299 wait complete. 2023-11-28T19:31:56.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.894+0000 7f4370a75640 1 Processor -- start 2023-11-28T19:31:56.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.894+0000 7f4370a75640 1 -- start start 2023-11-28T19:31:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4370a75640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f436c0b6010 0x7f436c14d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4370a75640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f436c145290 0x7f436c145790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4370a75640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f436c14c170 0x7f436c13fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4370a75640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c155770 con 0x7f436c145290 2023-11-28T19:31:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4370a75640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f436c14e7c0 con 0x7f436c14c170 2023-11-28T19:31:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4370a75640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f436c148540 con 0x7f436c0b6010 2023-11-28T19:31:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4369d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f436c145290 0x7f436c145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4369d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f436c145290 0x7f436c145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60688/0 (socket says 172.21.15.28:60688) 2023-11-28T19:31:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4369d9b640 1 -- 172.21.15.28:0/2106529725 learned_addr learned my addr 172.21.15.28:0/2106529725 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:56.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f436a59c640 1 --2- 172.21.15.28:0/2106529725 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f436c0b6010 0x7f436c14d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f436ad9d640 1 --2- 172.21.15.28:0/2106529725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f436c14c170 0x7f436c13fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4369d9b640 1 -- 172.21.15.28:0/2106529725 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f436c0b6010 msgr2=0x7f436c14d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4369d9b640 1 --2- 172.21.15.28:0/2106529725 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f436c0b6010 0x7f436c14d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4369d9b640 1 -- 172.21.15.28:0/2106529725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f436c14c170 msgr2=0x7f436c13fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4369d9b640 1 --2- 172.21.15.28:0/2106529725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f436c14c170 0x7f436c13fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4369d9b640 1 -- 172.21.15.28:0/2106529725 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4364009a70 con 0x7f436c145290 2023-11-28T19:31:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4369d9b640 1 --2- 172.21.15.28:0/2106529725 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f436c145290 0x7f436c145790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f435400c3a0 tx=0x7f435400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4362ffd640 1 -- 172.21.15.28:0/2106529725 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354005cf0 con 0x7f436c145290 2023-11-28T19:31:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4362ffd640 1 -- 172.21.15.28:0/2106529725 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4354005e50 con 0x7f436c145290 2023-11-28T19:31:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4362ffd640 1 -- 172.21.15.28:0/2106529725 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43540072f0 con 0x7f436c145290 2023-11-28T19:31:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4370a75640 1 -- 172.21.15.28:0/2106529725 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f436c155490 con 0x7f436c145290 2023-11-28T19:31:56.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4370a75640 1 -- 172.21.15.28:0/2106529725 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f436c148020 con 0x7f436c145290 2023-11-28T19:31:56.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4362ffd640 1 -- 172.21.15.28:0/2106529725 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4354007450 con 0x7f436c145290 2023-11-28T19:31:56.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4362ffd640 1 --2- 172.21.15.28:0/2106529725 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f434c066470 0x7f434c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4362ffd640 1 -- 172.21.15.28:0/2106529725 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43540831d0 con 0x7f436c145290 2023-11-28T19:31:56.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f436a59c640 1 --2- 172.21.15.28:0/2106529725 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f434c066470 0x7f434c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4373ba8000 1 Processor -- start 2023-11-28T19:31:56.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.898+0000 7f4373ba8000 1 -- start start 2023-11-28T19:31:56.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436a59c640 1 --2- 172.21.15.28:0/2106529725 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f434c066470 0x7f434c068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f435c009af0 tx=0x7f435c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:56.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5350 0x5621be0f5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f5c70 0x5621be0f00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f0630 0x5621be0f0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621bdf26130 con 0x5621be0f5350 2023-11-28T19:31:56.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621bdf139a0 con 0x5621be0f0630 2023-11-28T19:31:56.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621bdf10ed0 con 0x5621be0f5c70 2023-11-28T19:31:56.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436a59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5350 0x5621be0f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436a59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5350 0x5621be0f5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60698/0 (socket says 172.21.15.28:60698) 2023-11-28T19:31:56.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436a59c640 1 -- 172.21.15.28:0/1171816754 learned_addr learned my addr 172.21.15.28:0/1171816754 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:56.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436ad9d640 1 --2- 172.21.15.28:0/1171816754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f0630 0x5621be0f0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4369d9b640 1 --2- 172.21.15.28:0/1171816754 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f5c70 0x5621be0f00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436a59c640 1 -- 172.21.15.28:0/1171816754 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f5c70 msgr2=0x5621be0f00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:56.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436a59c640 1 --2- 172.21.15.28:0/1171816754 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f5c70 0x5621be0f00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436a59c640 1 -- 172.21.15.28:0/1171816754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f0630 msgr2=0x5621be0f0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:56.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436a59c640 1 --2- 172.21.15.28:0/1171816754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f0630 0x5621be0f0a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436a59c640 1 -- 172.21.15.28:0/1171816754 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621bdc04890 con 0x5621be0f5350 2023-11-28T19:31:56.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436a59c640 1 --2- 172.21.15.28:0/1171816754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5350 0x5621be0f5730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f435c011dc0 tx=0x7f435c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=867ae58042f92c7c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:56.909 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f434bfff640 1 -- 172.21.15.28:0/1171816754 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c011df0 con 0x5621be0f5350 2023-11-28T19:31:56.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f434bfff640 1 -- 172.21.15.28:0/1171816754 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c021440 con 0x5621be0f5350 2023-11-28T19:31:56.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f434bfff640 1 -- 172.21.15.28:0/1171816754 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c0217b0 con 0x5621be0f5350 2023-11-28T19:31:56.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 -- 172.21.15.28:0/1171816754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5350 msgr2=0x5621be0f5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 --2- 172.21.15.28:0/1171816754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5350 0x5621be0f5730 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f435c011dc0 tx=0x7f435c014000 comp rx=0 tx=0).stop 2023-11-28T19:31:56.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 -- 172.21.15.28:0/1171816754 shutdown_connections 2023-11-28T19:31:56.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 --2- 172.21.15.28:0/1171816754 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f0630 0x5621be0f0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 --2- 172.21.15.28:0/1171816754 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f5c70 0x5621be0f00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 --2- 172.21.15.28:0/1171816754 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5350 0x5621be0f5730 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 -- 172.21.15.28:0/1171816754 >> 172.21.15.28:0/1171816754 conn(0x5621be0ebea0 msgr2=0x5621be0ee290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:56.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 -- 172.21.15.28:0/1171816754 shutdown_connections 2023-11-28T19:31:56.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 -- 172.21.15.28:0/1171816754 wait complete. 2023-11-28T19:31:56.910 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 -- start start 2023-11-28T19:31:56.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 Processor -- start 2023-11-28T19:31:56.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f0630 0x5621be0b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f5350 0x5621be0b8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5c70 0x5621be0b9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621bdf0c7c0 con 0x5621be0f5c70 2023-11-28T19:31:56.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621bdec4bf0 con 0x5621be0f0630 2023-11-28T19:31:56.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621bdecaa90 con 0x5621be0f5350 2023-11-28T19:31:56.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4373ba8000 10 client.0 _ll_register_callbacks cb 0x5621be0a73c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T19:31:56.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5c70 0x5621be0b9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5c70 0x5621be0b9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60708/0 (socket says 172.21.15.28:60708) 2023-11-28T19:31:56.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436ad9d640 1 -- 172.21.15.28:0/818692674 learned_addr learned my addr 172.21.15.28:0/818692674 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:56.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436a59c640 1 --2- 172.21.15.28:0/818692674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f0630 0x5621be0b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f4369d9b640 1 --2- 172.21.15.28:0/818692674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f5350 0x5621be0b8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436ad9d640 1 -- 172.21.15.28:0/818692674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f5350 msgr2=0x5621be0b8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:56.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436ad9d640 1 --2- 172.21.15.28:0/818692674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f5350 0x5621be0b8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436ad9d640 1 -- 172.21.15.28:0/818692674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f0630 msgr2=0x5621be0b8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:56.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436ad9d640 1 --2- 172.21.15.28:0/818692674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f0630 0x5621be0b8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436ad9d640 1 -- 172.21.15.28:0/818692674 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c011a70 con 0x5621be0f5c70 2023-11-28T19:31:56.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f436ad9d640 1 --2- 172.21.15.28:0/818692674 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5c70 0x5621be0b9510 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f436401a550 tx=0x7f436401b160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92432ef22873c986 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:56.915 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.902+0000 7f43497fa640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-11-28T19:31:56.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f43497fa640 1 -- 172.21.15.28:0/818692674 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43640ad740 con 0x5621be0f5c70 2023-11-28T19:31:56.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f43497fa640 1 -- 172.21.15.28:0/818692674 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f43640ad8a0 con 0x5621be0f5c70 2023-11-28T19:31:56.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 -- 172.21.15.28:0/818692674 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621bdece470 con 0x5621be0f5c70 2023-11-28T19:31:56.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f43497fa640 1 -- 172.21.15.28:0/818692674 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f43640ada60 con 0x5621be0f5c70 2023-11-28T19:31:56.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 10 client.4614 fetch_fsmap learned FSMap version 8 2023-11-28T19:31:56.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 -- 172.21.15.28:0/818692674 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5621bdecd190 con 0x5621be0f5c70 2023-11-28T19:31:56.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f43497fa640 1 -- 172.21.15.28:0/818692674 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5621bdece470 con 0x5621be0f5c70 2023-11-28T19:31:56.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f43497fa640 1 -- 172.21.15.28:0/818692674 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 8) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f43640adbc0 con 0x5621be0f5c70 2023-11-28T19:31:56.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 10 client.4614 fetch_fsmap finished waiting for FSMap version 8 2023-11-28T19:31:56.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 10 client.4614 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T19:31:56.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 20 client.4614 populate_metadata read hostname 'smithi028' 2023-11-28T19:31:56.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 --2- 172.21.15.28:0/818692674 >> [v2:172.21.15.28:6834/2598774147,v1:172.21.15.28:6835/2598774147] conn(0x5621be1043e0 0x5621be1067d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.916 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 4 client.4614 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T19:31:56.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 -- 172.21.15.28:0/818692674 --> [v2:172.21.15.28:6834/2598774147,v1:172.21.15.28:6835/2598774147] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621bded1b50 con 0x5621be1043e0 2023-11-28T19:31:56.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f436a59c640 1 --2- 172.21.15.28:0/818692674 >> [v2:172.21.15.28:6834/2598774147,v1:172.21.15.28:6835/2598774147] conn(0x5621be1043e0 0x5621be1067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f43497fa640 10 client.4614 ms_handle_connect on v2:172.21.15.28:6834/2598774147 2023-11-28T19:31:56.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f436a59c640 1 --2- 172.21.15.28:0/818692674 >> [v2:172.21.15.28:6834/2598774147,v1:172.21.15.28:6835/2598774147] conn(0x5621be1043e0 0x5621be1067d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56fe8be5672c40ac server_cookie=fa3b8233c8d811d8 in_seq=0 out_seq=0 2023-11-28T19:31:56.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f43497fa640 1 -- 172.21.15.28:0/818692674 <== mds.0 v2:172.21.15.28:6834/2598774147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5621bded1b50 con 0x5621be1043e0 2023-11-28T19:31:56.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f43497fa640 10 client.4614 handle_command_reply: tid=0 2023-11-28T19:31:56.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 client.4614 shutdown 2023-11-28T19:31:56.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 -- 172.21.15.28:0/818692674 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5c70 msgr2=0x5621be0b9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 --2- 172.21.15.28:0/818692674 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5c70 0x5621be0b9510 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f436401a550 tx=0x7f436401b160 comp rx=0 tx=0).stop 2023-11-28T19:31:56.917 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 -- 172.21.15.28:0/818692674 shutdown_connections 2023-11-28T19:31:56.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 --2- 172.21.15.28:0/818692674 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5c70 0x5621be0b9510 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 --2- 172.21.15.28:0/818692674 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f5350 0x5621be0b8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 --2- 172.21.15.28:0/818692674 >> [v2:172.21.15.28:6834/2598774147,v1:172.21.15.28:6835/2598774147] conn(0x5621be1043e0 0x5621be1067d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 --2- 172.21.15.28:0/818692674 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f0630 0x5621be0b8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f43497fa640 0 client.4614 ms_handle_reset on v2:172.21.15.28:6834/2598774147 2023-11-28T19:31:56.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 -- 172.21.15.28:0/818692674 >> 172.21.15.28:0/818692674 conn(0x5621be0ebea0 msgr2=0x5621be0ee290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:56.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 -- 172.21.15.28:0/818692674 shutdown_connections 2023-11-28T19:31:56.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 1 -- 172.21.15.28:0/818692674 wait complete. 2023-11-28T19:31:56.918 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.906+0000 7f4373ba8000 20 client.4614 trim_cache size 0 max 16384 2023-11-28T19:31:56.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 Processor -- start 2023-11-28T19:31:56.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 -- start start 2023-11-28T19:31:56.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f0630 0x5621be1067d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f5350 0x5621be106d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5c70 0x5621be107250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621bdbc5940 con 0x5621be0f5c70 2023-11-28T19:31:56.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621bdecb8f0 con 0x5621be0f5350 2023-11-28T19:31:56.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621bdec1760 con 0x5621be0f0630 2023-11-28T19:31:56.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f436ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5c70 0x5621be107250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f436ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5c70 0x5621be107250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60714/0 (socket says 172.21.15.28:60714) 2023-11-28T19:31:56.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f436ad9d640 1 -- 172.21.15.28:0/4114654710 learned_addr learned my addr 172.21.15.28:0/4114654710 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:56.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f436ad9d640 1 -- 172.21.15.28:0/4114654710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f0630 msgr2=0x5621be1067d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:56.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f436ad9d640 1 --2- 172.21.15.28:0/4114654710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f0630 0x5621be1067d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f436ad9d640 1 -- 172.21.15.28:0/4114654710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f5350 msgr2=0x5621be106d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:56.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f436ad9d640 1 --2- 172.21.15.28:0/4114654710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f5350 0x5621be106d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f436ad9d640 1 -- 172.21.15.28:0/4114654710 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621bdeb3490 con 0x5621be0f5c70 2023-11-28T19:31:56.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f436ad9d640 1 --2- 172.21.15.28:0/4114654710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5c70 0x5621be107250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f436401afd0 tx=0x7f43640b4000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e41463485cc7f8b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:56.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4360ff9640 1 -- 172.21.15.28:0/4114654710 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43640039a0 con 0x5621be0f5c70 2023-11-28T19:31:56.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4360ff9640 1 -- 172.21.15.28:0/4114654710 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4364003b00 con 0x5621be0f5c70 2023-11-28T19:31:56.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4360ff9640 1 -- 172.21.15.28:0/4114654710 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4364003e90 con 0x5621be0f5c70 2023-11-28T19:31:56.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 -- 172.21.15.28:0/4114654710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5c70 msgr2=0x5621be107250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 --2- 172.21.15.28:0/4114654710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5c70 0x5621be107250 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f436401afd0 tx=0x7f43640b4000 comp rx=0 tx=0).stop 2023-11-28T19:31:56.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 -- 172.21.15.28:0/4114654710 shutdown_connections 2023-11-28T19:31:56.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 --2- 172.21.15.28:0/4114654710 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5c70 0x5621be107250 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 --2- 172.21.15.28:0/4114654710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f5350 0x5621be106d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 --2- 172.21.15.28:0/4114654710 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f0630 0x5621be1067d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 -- 172.21.15.28:0/4114654710 >> 172.21.15.28:0/4114654710 conn(0x5621be0ebea0 msgr2=0x5621be0c02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:56.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 -- 172.21.15.28:0/4114654710 shutdown_connections 2023-11-28T19:31:56.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 -- 172.21.15.28:0/4114654710 wait complete. 2023-11-28T19:31:56.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 -- start start 2023-11-28T19:31:56.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.922+0000 7f4373ba8000 1 Processor -- start 2023-11-28T19:31:56.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f0630 0x5621be1227d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5350 0x5621be122d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f5c70 0x5621be123250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621bdf107c0 con 0x5621be0f5350 2023-11-28T19:31:56.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621bdf4e140 con 0x5621be0f5c70 2023-11-28T19:31:56.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5621bdf09bc0 con 0x5621be0f0630 2023-11-28T19:31:56.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 10 client.0 _ll_register_callbacks cb 0x5621bde906e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T19:31:56.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4369d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5350 0x5621be122d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4369d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5350 0x5621be122d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60722/0 (socket says 172.21.15.28:60722) 2023-11-28T19:31:56.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4369d9b640 1 -- 172.21.15.28:0/1677562370 learned_addr learned my addr 172.21.15.28:0/1677562370 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:56.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4369d9b640 1 -- 172.21.15.28:0/1677562370 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f0630 msgr2=0x5621be1227d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:56.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4369d9b640 1 --2- 172.21.15.28:0/1677562370 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f0630 0x5621be1227d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4369d9b640 1 -- 172.21.15.28:0/1677562370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f5c70 msgr2=0x5621be123250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:56.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4369d9b640 1 --2- 172.21.15.28:0/1677562370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f5c70 0x5621be123250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4369d9b640 1 -- 172.21.15.28:0/1677562370 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5621bdecd190 con 0x5621be0f5350 2023-11-28T19:31:56.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4369d9b640 1 --2- 172.21.15.28:0/1677562370 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5350 0x5621be122d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f435405c170 tx=0x7f4354053df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6884fe2dc484751b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:56.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f43497fa640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-11-28T19:31:56.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f43497fa640 1 -- 172.21.15.28:0/1677562370 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43540584f0 con 0x5621be0f5350 2023-11-28T19:31:56.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f43497fa640 1 -- 172.21.15.28:0/1677562370 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f435406a030 con 0x5621be0f5350 2023-11-28T19:31:56.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 -- 172.21.15.28:0/1677562370 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621bdf0b110 con 0x5621be0f5350 2023-11-28T19:31:56.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f43497fa640 1 -- 172.21.15.28:0/1677562370 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f435405c6a0 con 0x5621be0f5350 2023-11-28T19:31:56.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 10 client.4620 fetch_fsmap learned FSMap version 8 2023-11-28T19:31:56.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 -- 172.21.15.28:0/1677562370 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5621bdc04cc0 con 0x5621be0f5350 2023-11-28T19:31:56.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f43497fa640 1 -- 172.21.15.28:0/1677562370 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5621bdf0b110 con 0x5621be0f5350 2023-11-28T19:31:56.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f43497fa640 1 -- 172.21.15.28:0/1677562370 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 8) v1 ==== 2719+0+0 (secure 0 0 0) 0x7f4354058170 con 0x5621be0f5350 2023-11-28T19:31:56.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 10 client.4620 fetch_fsmap finished waiting for FSMap version 8 2023-11-28T19:31:56.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 10 client.4620 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T19:31:56.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 20 client.4620 populate_metadata read hostname 'smithi028' 2023-11-28T19:31:56.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 --2- 172.21.15.28:0/1677562370 >> [v2:172.21.15.28:6834/2598774147,v1:172.21.15.28:6835/2598774147] conn(0x5621be15c240 0x5621be15e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:56.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 4 client.4620 mds_command: new command op to 4245 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T19:31:56.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 -- 172.21.15.28:0/1677562370 --> [v2:172.21.15.28:6834/2598774147,v1:172.21.15.28:6835/2598774147] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5621bdf3a9a0 con 0x5621be15c240 2023-11-28T19:31:56.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f436a59c640 1 --2- 172.21.15.28:0/1677562370 >> [v2:172.21.15.28:6834/2598774147,v1:172.21.15.28:6835/2598774147] conn(0x5621be15c240 0x5621be15e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:56.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f43497fa640 10 client.4620 ms_handle_connect on v2:172.21.15.28:6834/2598774147 2023-11-28T19:31:56.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f436a59c640 1 --2- 172.21.15.28:0/1677562370 >> [v2:172.21.15.28:6834/2598774147,v1:172.21.15.28:6835/2598774147] conn(0x5621be15c240 0x5621be15e630 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17fc5f8e93d9e4f2 server_cookie=bc1e3960d81c0731 in_seq=0 out_seq=0 2023-11-28T19:31:56.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f43497fa640 1 -- 172.21.15.28:0/1677562370 <== mds.0 v2:172.21.15.28:6834/2598774147 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x5621bdf3a9a0 con 0x5621be15c240 2023-11-28T19:31:56.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f43497fa640 10 client.4620 handle_command_reply: tid=0 2023-11-28T19:31:56.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 client.4620 shutdown 2023-11-28T19:31:56.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 -- 172.21.15.28:0/1677562370 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5350 msgr2=0x5621be122d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 --2- 172.21.15.28:0/1677562370 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5350 0x5621be122d10 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f435405c170 tx=0x7f4354053df0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 -- 172.21.15.28:0/1677562370 shutdown_connections 2023-11-28T19:31:56.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 --2- 172.21.15.28:0/1677562370 >> [v2:172.21.15.28:6834/2598774147,v1:172.21.15.28:6835/2598774147] conn(0x5621be15c240 0x5621be15e630 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 --2- 172.21.15.28:0/1677562370 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5621be0f5c70 0x5621be123250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 --2- 172.21.15.28:0/1677562370 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5621be0f5350 0x5621be122d10 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f43497fa640 0 client.4620 ms_handle_reset on v2:172.21.15.28:6834/2598774147 2023-11-28T19:31:56.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 --2- 172.21.15.28:0/1677562370 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5621be0f0630 0x5621be1227d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 -- 172.21.15.28:0/1677562370 >> 172.21.15.28:0/1677562370 conn(0x5621be0ebea0 msgr2=0x5621be0c0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:56.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 -- 172.21.15.28:0/1677562370 shutdown_connections 2023-11-28T19:31:56.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 1 -- 172.21.15.28:0/1677562370 wait complete. 2023-11-28T19:31:56.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4373ba8000 20 client.4620 trim_cache size 0 max 16384 2023-11-28T19:31:56.939 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-11-28T19:31:56.940 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "ae116b99-23bb-451b-9ddc-fdb049a33145", 2023-11-28T19:31:56.940 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2023-11-28T19:31:56.940 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4245, 2023-11-28T19:31:56.940 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2023-11-28T19:31:56.940 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2023-11-28T19:31:56.940 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2023-11-28T19:31:56.940 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 11.678569159, 2023-11-28T19:31:56.940 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 8, 2023-11-28T19:31:56.940 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 21, 2023-11-28T19:31:56.940 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 21, 2023-11-28T19:31:56.940 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 18.665332630000002 2023-11-28T19:31:56.941 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-11-28T19:31:56.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4370a75640 1 -- 172.21.15.28:0/2106529725 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f434c066470 msgr2=0x7f434c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4370a75640 1 --2- 172.21.15.28:0/2106529725 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f434c066470 0x7f434c068930 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f435c009af0 tx=0x7f435c008040 comp rx=0 tx=0).stop 2023-11-28T19:31:56.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4370a75640 1 -- 172.21.15.28:0/2106529725 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f436c145290 msgr2=0x7f436c145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:56.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4370a75640 1 --2- 172.21.15.28:0/2106529725 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f436c145290 0x7f436c145790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f435400c3a0 tx=0x7f435400c860 comp rx=0 tx=0).stop 2023-11-28T19:31:56.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4370a75640 1 -- 172.21.15.28:0/2106529725 shutdown_connections 2023-11-28T19:31:56.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4370a75640 1 --2- 172.21.15.28:0/2106529725 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f434c066470 0x7f434c068930 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4370a75640 1 --2- 172.21.15.28:0/2106529725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f436c14c170 0x7f436c13fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4370a75640 1 --2- 172.21.15.28:0/2106529725 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f436c145290 0x7f436c145790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4370a75640 1 --2- 172.21.15.28:0/2106529725 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f436c0b6010 0x7f436c14d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:56.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4370a75640 1 -- 172.21.15.28:0/2106529725 >> 172.21.15.28:0/2106529725 conn(0x7f436c0c0c80 msgr2=0x7f436c14a990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:56.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4370a75640 1 -- 172.21.15.28:0/2106529725 shutdown_connections 2023-11-28T19:31:56.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:56.926+0000 7f4370a75640 1 -- 172.21.15.28:0/2106529725 wait complete. 2023-11-28T19:31:56.948 INFO:teuthology.run_tasks:Running task kclient... 2023-11-28T19:31:57.009 INFO:tasks.kclient:Mounting kernel clients... 2023-11-28T19:31:57.009 INFO:tasks.kclient:config is {'client.0': {}} 2023-11-28T19:31:57.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:57.009 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2023-11-28T19:31:57.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:57.021 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link delete ceph-brx 2023-11-28T19:31:57.088 INFO:teuthology.orchestra.run.smithi203.stderr:Cannot find device "ceph-brx" 2023-11-28T19:31:57.090 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-11-28T19:31:57.091 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-11-28T19:31:57.091 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-11-28T19:31:57.091 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T19:31:57.091 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T19:31:57.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.214+0000 7f9e4a5e9640 1 Processor -- start 2023-11-28T19:31:57.221 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.214+0000 7f9e4a5e9640 1 -- start start 2023-11-28T19:31:57.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e4a5e9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9e440bbad0 0x7f9e4414b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:57.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e4a5e9640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e440bce60 con 0x7f9e4406ab60 2023-11-28T19:31:57.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e4a5e9640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e440a6b70 con 0x7f9e4406af40 2023-11-28T19:31:57.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e4a5e9640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e440bd5d0 con 0x7f9e440bbad0 2023-11-28T19:31:57.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e43fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9e4406ab60 0x7f9e440a6040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42388/0 (socket says 172.21.15.28:42388) 2023-11-28T19:31:57.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e43fff640 1 -- 172.21.15.28:0/1526697338 learned_addr learned my addr 172.21.15.28:0/1526697338 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:57.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e437fe640 1 --2- 172.21.15.28:0/1526697338 >> v2:172.21.15.131:3300/0 conn(0x7f9e440bbad0 0x7f9e4414b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:57.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e42ffd640 1 -- 172.21.15.28:0/1526697338 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2422385985 0 0) 0x7f9e440bce60 con 0x7f9e4406ab60 2023-11-28T19:31:57.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e42ffd640 1 -- 172.21.15.28:0/1526697338 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e2c003530 con 0x7f9e4406ab60 2023-11-28T19:31:57.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e42ffd640 1 -- 172.21.15.28:0/1526697338 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4059680766 0 0) 0x7f9e440a6b70 con 0x7f9e4406af40 2023-11-28T19:31:57.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e42ffd640 1 -- 172.21.15.28:0/1526697338 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e440bce60 con 0x7f9e4406af40 2023-11-28T19:31:57.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e437fe640 1 -- 172.21.15.28:0/1526697338 >> v1:172.21.15.131:6789/0 conn(0x7f9e4406af40 legacy=0x7f9e44155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:57.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e437fe640 1 -- 172.21.15.28:0/1526697338 >> v1:172.21.15.28:6789/0 conn(0x7f9e4406ab60 legacy=0x7f9e440a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:57.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e437fe640 1 -- 172.21.15.28:0/1526697338 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e440bff70 con 0x7f9e440bbad0 2023-11-28T19:31:57.225 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.218+0000 7f9e437fe640 1 --2- 172.21.15.28:0/1526697338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e440bbad0 0x7f9e4414b5f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e380097c0 tx=0x7f9e3801c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6604a715ded9fd9a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:57.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e42ffd640 1 -- 172.21.15.28:0/1526697338 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e380ad660 con 0x7f9e440bbad0 2023-11-28T19:31:57.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e42ffd640 1 -- 172.21.15.28:0/1526697338 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e380ad7c0 con 0x7f9e440bbad0 2023-11-28T19:31:57.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e42ffd640 1 -- 172.21.15.28:0/1526697338 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e380adb30 con 0x7f9e440bbad0 2023-11-28T19:31:57.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/1526697338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e440bbad0 msgr2=0x7f9e4414b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:57.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 --2- 172.21.15.28:0/1526697338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e440bbad0 0x7f9e4414b5f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9e380097c0 tx=0x7f9e3801c450 comp rx=0 tx=0).stop 2023-11-28T19:31:57.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/1526697338 shutdown_connections 2023-11-28T19:31:57.226 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 --2- 172.21.15.28:0/1526697338 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e440bbad0 0x7f9e4414b5f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:57.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/1526697338 >> 172.21.15.28:0/1526697338 conn(0x7f9e440c0c90 msgr2=0x7f9e440c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:57.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/1526697338 shutdown_connections 2023-11-28T19:31:57.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/1526697338 wait complete. 2023-11-28T19:31:57.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 Processor -- start 2023-11-28T19:31:57.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 -- start start 2023-11-28T19:31:57.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e4406ab60 0x7f9e44148ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:57.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4406af40 0x7f9e44143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:57.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e440bbad0 0x7f9e441e7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:57.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44144310 con 0x7f9e440bbad0 2023-11-28T19:31:57.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e441e41b0 con 0x7f9e4406af40 2023-11-28T19:31:57.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e44149f70 con 0x7f9e4406ab60 2023-11-28T19:31:57.229 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e48b86640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e440bbad0 0x7f9e441e7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:57.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e48b86640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e440bbad0 0x7f9e441e7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60730/0 (socket says 172.21.15.28:60730) 2023-11-28T19:31:57.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e48b86640 1 -- 172.21.15.28:0/945231279 learned_addr learned my addr 172.21.15.28:0/945231279 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:57.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e437fe640 1 --2- 172.21.15.28:0/945231279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4406af40 0x7f9e44143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:57.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e43fff640 1 --2- 172.21.15.28:0/945231279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e4406ab60 0x7f9e44148ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:57.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e48b86640 1 -- 172.21.15.28:0/945231279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e4406ab60 msgr2=0x7f9e44148ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:57.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e48b86640 1 --2- 172.21.15.28:0/945231279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e4406ab60 0x7f9e44148ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:57.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e48b86640 1 -- 172.21.15.28:0/945231279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4406af40 msgr2=0x7f9e44143dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:57.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e48b86640 1 --2- 172.21.15.28:0/945231279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4406af40 0x7f9e44143dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:57.230 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e48b86640 1 -- 172.21.15.28:0/945231279 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e38009420 con 0x7f9e440bbad0 2023-11-28T19:31:57.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e48b86640 1 --2- 172.21.15.28:0/945231279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e440bbad0 0x7f9e441e7610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00c410 tx=0x7f9e3c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:57.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e40ff9640 1 -- 172.21.15.28:0/945231279 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c0052d0 con 0x7f9e440bbad0 2023-11-28T19:31:57.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e40ff9640 1 -- 172.21.15.28:0/945231279 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c005430 con 0x7f9e440bbad0 2023-11-28T19:31:57.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/945231279 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e441e4420 con 0x7f9e440bbad0 2023-11-28T19:31:57.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e40ff9640 1 -- 172.21.15.28:0/945231279 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c003800 con 0x7f9e440bbad0 2023-11-28T19:31:57.231 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.222+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/945231279 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e441e49e0 con 0x7f9e440bbad0 2023-11-28T19:31:57.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.226+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/945231279 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e440a2170 con 0x7f9e440bbad0 2023-11-28T19:31:57.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.226+0000 7f9e40ff9640 1 -- 172.21.15.28:0/945231279 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9e3c003960 con 0x7f9e440bbad0 2023-11-28T19:31:57.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.226+0000 7f9e40ff9640 1 --2- 172.21.15.28:0/945231279 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9e30066470 0x7f9e30068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:57.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.226+0000 7f9e40ff9640 1 -- 172.21.15.28:0/945231279 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e3c083370 con 0x7f9e440bbad0 2023-11-28T19:31:57.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.226+0000 7f9e43fff640 1 --2- 172.21.15.28:0/945231279 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9e30066470 0x7f9e30068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:57.232 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.226+0000 7f9e43fff640 1 --2- 172.21.15.28:0/945231279 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9e30066470 0x7f9e30068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9e34001570 tx=0x7f9e34009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:57.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.230+0000 7f9e40ff9640 1 -- 172.21.15.28:0/945231279 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e3c0508a0 con 0x7f9e440bbad0 2023-11-28T19:31:57.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.414+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/945231279 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f9e440b4240 con 0x7f9e440bbad0 2023-11-28T19:31:57.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.414+0000 7f9e40ff9640 1 -- 172.21.15.28:0/945231279 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9e3c053ec0 con 0x7f9e440bbad0 2023-11-28T19:31:57.421 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T19:31:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.418+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/945231279 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9e30066470 msgr2=0x7f9e30068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.418+0000 7f9e4a5e9640 1 --2- 172.21.15.28:0/945231279 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9e30066470 0x7f9e30068930 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9e34001570 tx=0x7f9e34009040 comp rx=0 tx=0).stop 2023-11-28T19:31:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.418+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/945231279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e440bbad0 msgr2=0x7f9e441e7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.418+0000 7f9e4a5e9640 1 --2- 172.21.15.28:0/945231279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e440bbad0 0x7f9e441e7610 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00c410 tx=0x7f9e3c00c8d0 comp rx=0 tx=0).stop 2023-11-28T19:31:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.418+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/945231279 shutdown_connections 2023-11-28T19:31:57.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.418+0000 7f9e4a5e9640 1 --2- 172.21.15.28:0/945231279 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9e30066470 0x7f9e30068930 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.418+0000 7f9e4a5e9640 1 --2- 172.21.15.28:0/945231279 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e440bbad0 0x7f9e441e7610 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.418+0000 7f9e4a5e9640 1 --2- 172.21.15.28:0/945231279 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e4406af40 0x7f9e44143dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.418+0000 7f9e4a5e9640 1 --2- 172.21.15.28:0/945231279 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e4406ab60 0x7f9e44148ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.418+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/945231279 >> 172.21.15.28:0/945231279 conn(0x7f9e440c0c90 msgr2=0x7f9e440a50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.418+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/945231279 shutdown_connections 2023-11-28T19:31:57.424 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:57.418+0000 7f9e4a5e9640 1 -- 172.21.15.28:0/945231279 wait complete. 2023-11-28T19:31:57.438 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-11-28T19:31:57.438 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T19:31:57.438 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi203.front.sepia.ceph.com 2023-11-28T19:31:57.438 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T19:31:57.438 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T19:31:57.438 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-11-28T19:31:57.438 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-11-28T19:31:57.439 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T19:31:57.439 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T19:31:57.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:57.439 DEBUG:teuthology.orchestra.run.smithi203:> ip addr 2023-11-28T19:31:57.448 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T19:31:57.448 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T19:31:57.449 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T19:31:57.449 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:31:57.449 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2023-11-28T19:31:57.449 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:31:57.449 INFO:teuthology.orchestra.run.smithi203.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:31:57.449 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:44 brd ff:ff:ff:ff:ff:ff 2023-11-28T19:31:57.449 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f0 2023-11-28T19:31:57.449 INFO:teuthology.orchestra.run.smithi203.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:31:57.449 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:45 brd ff:ff:ff:ff:ff:ff 2023-11-28T19:31:57.449 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f1 2023-11-28T19:31:57.449 INFO:teuthology.orchestra.run.smithi203.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:31:57.449 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:22 brd ff:ff:ff:ff:ff:ff 2023-11-28T19:31:57.450 INFO:teuthology.orchestra.run.smithi203.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T19:31:57.450 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:23 brd ff:ff:ff:ff:ff:ff 2023-11-28T19:31:57.450 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.21.15.203/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T19:31:57.450 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft 42364sec preferred_lft 42364sec 2023-11-28T19:31:57.450 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::ec4:7aff:fe8f:4a23/64 scope link 2023-11-28T19:31:57.450 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:31:57.450 INFO:teuthology.orchestra.run.smithi203.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T19:31:57.450 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 02:42:af:f6:0d:0f brd ff:ff:ff:ff:ff:ff 2023-11-28T19:31:57.450 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T19:31:57.450 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:31:57.451 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-11-28T19:31:57.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:57.452 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec bash -c ' 2023-11-28T19:31:57.452 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2023-11-28T19:31:57.452 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add name ceph-brx type bridge 2023-11-28T19:31:57.452 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip addr flush dev ceph-brx 2023-11-28T19:31:57.452 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set ceph-brx up 2023-11-28T19:31:57.452 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-11-28T19:31:57.452 DEBUG:teuthology.orchestra.run.smithi203:> ') 2023-11-28T19:31:57.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:57.576 DEBUG:teuthology.orchestra.run.smithi203:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T19:31:57.595 INFO:teuthology.orchestra.run.smithi203.stdout:1 2023-11-28T19:31:57.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:57.598 DEBUG:teuthology.orchestra.run.smithi203:> route 2023-11-28T19:31:57.683 INFO:teuthology.orchestra.run.smithi203.stdout:Kernel IP routing table 2023-11-28T19:31:57.684 INFO:teuthology.orchestra.run.smithi203.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T19:31:57.684 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T19:31:57.684 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T19:31:57.684 INFO:teuthology.orchestra.run.smithi203.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T19:31:57.684 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T19:31:57.685 INFO:teuthology.orchestra.run.smithi203.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:31:57.685 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:31:57.685 INFO:teuthology.orchestra.run.smithi203.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:31:57.685 INFO:teuthology.orchestra.run.smithi203.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T19:31:57.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:57.686 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec bash -c ' 2023-11-28T19:31:57.686 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2023-11-28T19:31:57.686 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T19:31:57.687 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T19:31:57.687 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T19:31:57.687 DEBUG:teuthology.orchestra.run.smithi203:> ') 2023-11-28T19:31:57.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:57.779 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2023-11-28T19:31:57.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:57.789 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list-id 2023-11-28T19:31:57.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:57.844 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec bash -c ' 2023-11-28T19:31:57.844 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2023-11-28T19:31:57.844 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T19:31:57.844 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-11-28T19:31:57.844 DEBUG:teuthology.orchestra.run.smithi203:> ') 2023-11-28T19:31:57.928 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-11-28T19:31:57.928 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:57.928 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec bash -c ' 2023-11-28T19:31:57.929 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2023-11-28T19:31:57.929 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-11-28T19:31:57.929 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-11-28T19:31:57.929 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-11-28T19:31:57.929 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-11-28T19:31:57.930 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-11-28T19:31:57.930 DEBUG:teuthology.orchestra.run.smithi203:> ') 2023-11-28T19:31:58.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:58.103 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec bash -c ' 2023-11-28T19:31:58.103 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2023-11-28T19:31:58.103 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set brx.0 up 2023-11-28T19:31:58.103 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set dev brx.0 master ceph-brx 2023-11-28T19:31:58.103 DEBUG:teuthology.orchestra.run.smithi203:> ') 2023-11-28T19:31:58.143 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T19:31:58.144 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T19:31:58.196 INFO:teuthology.orchestra.run.smithi203.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T19:31:58.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T19:31:58.196 DEBUG:teuthology.orchestra.run.smithi203:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T19:31:58.247 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-28T19:31:58.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:58.247 DEBUG:teuthology.orchestra.run.smithi203:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T19:31:58.353 INFO:teuthology.orchestra.run.smithi203.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T19:31:58.354 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T19:31:58.452 INFO:teuthology.orchestra.run.smithi203.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T19:31:58.452 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T19:31:58.452 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-11-28T19:31:58.453 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: trying mount with new device syntax: 0@ae116b99-23bb-451b-9ddc-fdb049a33145.cephfs=/ 2023-11-28T19:31:58.453 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.28:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-11-28T19:31:58.456 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T19:31:58.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:58.457 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T19:31:58.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:58.480 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T19:31:58.573 INFO:teuthology.orchestra.run.smithi203.stdout:client4504 2023-11-28T19:31:58.573 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:31:58.573 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:31:58.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:58.628 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T19:31:58.702 INFO:teuthology.orchestra.run.smithi203.stdout:client4504 2023-11-28T19:31:58.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:58.703 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T19:31:58.768 INFO:teuthology.orchestra.run.smithi203.stdout:client4504 2023-11-28T19:31:58.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:31:58.769 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/ae116b99-23bb-451b-9ddc-fdb049a33145.client4504/status') 2023-11-28T19:31:58.842 INFO:teuthology.orchestra.run.smithi203.stdout:instance: client.4504 (3)172.21.15.203:0/3336651145 2023-11-28T19:31:58.843 INFO:teuthology.orchestra.run.smithi203.stdout:blocklisted: false 2023-11-28T19:31:58.843 INFO:teuthology.orchestra.run.smithi203.stderr:0+1 records in 2023-11-28T19:31:58.843 INFO:teuthology.orchestra.run.smithi203.stderr:0+1 records out 2023-11-28T19:31:58.843 INFO:teuthology.orchestra.run.smithi203.stderr:71 bytes copied, 5.321e-05 s, 1.3 MB/s 2023-11-28T19:31:58.845 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-11-28T19:31:58.861 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:31:58.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.994+0000 7ff37d3f2640 1 Processor -- start 2023-11-28T19:31:58.997 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.994+0000 7ff37d3f2640 1 -- start start 2023-11-28T19:31:58.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff37814c860 0x7ff3780b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:58.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff37814ccc0 0x7ff3780b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:58.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff37806f780 con 0x7ff3780b8f30 2023-11-28T19:31:58.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3780b6cd0 con 0x7ff37814ccc0 2023-11-28T19:31:58.998 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff378143aa0 con 0x7ff37814c860 2023-11-28T19:31:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff3777fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff37814ccc0 0x7ff3780b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff3767fc640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff37814c860 0x7ff3780b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff376ffd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff3780b8f30 0x7ff378071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:37528/0 (socket says 172.21.15.28:37528) 2023-11-28T19:31:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff376ffd640 1 -- 172.21.15.28:0/3404514709 learned_addr learned my addr 172.21.15.28:0/3404514709 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff3777fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff37814ccc0 0x7ff3780b6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:53636/0 (socket says 172.21.15.28:53636) 2023-11-28T19:31:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff3777fe640 1 -- 172.21.15.28:0/3404514709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff37814c860 msgr2=0x7ff3780b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff3777fe640 1 --2- 172.21.15.28:0/3404514709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff37814c860 0x7ff3780b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff3777fe640 1 -- 172.21.15.28:0/3404514709 >> v1:172.21.15.131:6789/0 conn(0x7ff3780b8f30 legacy=0x7ff378071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:58.999 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff3777fe640 1 -- 172.21.15.28:0/3404514709 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff378072320 con 0x7ff37814ccc0 2023-11-28T19:31:59.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff3777fe640 1 --2- 172.21.15.28:0/3404514709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff37814ccc0 0x7ff3780b6790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff370009d90 tx=0x7ff37001c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e593714ecfa0bda server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:59.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff375ffb640 1 -- 172.21.15.28:0/3404514709 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3700a5810 con 0x7ff37814ccc0 2023-11-28T19:31:59.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff375ffb640 1 -- 172.21.15.28:0/3404514709 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3700a5970 con 0x7ff37814ccc0 2023-11-28T19:31:59.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff375ffb640 1 -- 172.21.15.28:0/3404514709 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3700a5d00 con 0x7ff37814ccc0 2023-11-28T19:31:59.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 -- 172.21.15.28:0/3404514709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff37814ccc0 msgr2=0x7ff3780b6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 --2- 172.21.15.28:0/3404514709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff37814ccc0 0x7ff3780b6790 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7ff370009d90 tx=0x7ff37001c950 comp rx=0 tx=0).stop 2023-11-28T19:31:59.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 -- 172.21.15.28:0/3404514709 shutdown_connections 2023-11-28T19:31:59.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 --2- 172.21.15.28:0/3404514709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff37814ccc0 0x7ff3780b6790 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 --2- 172.21.15.28:0/3404514709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff37814c860 0x7ff3780b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 -- 172.21.15.28:0/3404514709 >> 172.21.15.28:0/3404514709 conn(0x7ff3780bcb40 msgr2=0x7ff3780bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:59.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 -- 172.21.15.28:0/3404514709 shutdown_connections 2023-11-28T19:31:59.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 -- 172.21.15.28:0/3404514709 wait complete. 2023-11-28T19:31:59.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 Processor -- start 2023-11-28T19:31:59.005 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:58.998+0000 7ff37d3f2640 1 -- start start 2023-11-28T19:31:59.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff37d3f2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3780b8f30 0x7ff378141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff37d3f2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff37814c860 0x7ff3781367d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff37d3f2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff37814ccc0 0x7ff3781336d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff37d3f2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff378142010 con 0x7ff3780b8f30 2023-11-28T19:31:59.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff37d3f2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff378142f20 con 0x7ff37814ccc0 2023-11-28T19:31:59.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff37d3f2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3780b3a70 con 0x7ff37814c860 2023-11-28T19:31:59.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff376ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3780b8f30 0x7ff378141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff376ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3780b8f30 0x7ff378141ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60734/0 (socket says 172.21.15.28:60734) 2023-11-28T19:31:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff376ffd640 1 -- 172.21.15.28:0/2888062330 learned_addr learned my addr 172.21.15.28:0/2888062330 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff3777fe640 1 --2- 172.21.15.28:0/2888062330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff37814ccc0 0x7ff3781336d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff3767fc640 1 --2- 172.21.15.28:0/2888062330 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff37814c860 0x7ff3781367d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff376ffd640 1 -- 172.21.15.28:0/2888062330 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff37814c860 msgr2=0x7ff3781367d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff376ffd640 1 --2- 172.21.15.28:0/2888062330 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff37814c860 0x7ff3781367d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff376ffd640 1 -- 172.21.15.28:0/2888062330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff37814ccc0 msgr2=0x7ff3781336d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff376ffd640 1 --2- 172.21.15.28:0/2888062330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff37814ccc0 0x7ff3781336d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff376ffd640 1 -- 172.21.15.28:0/2888062330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff370009a70 con 0x7ff3780b8f30 2023-11-28T19:31:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff376ffd640 1 --2- 172.21.15.28:0/2888062330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3780b8f30 0x7ff378141ad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff36800c530 tx=0x7ff36800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff35f7fe640 1 -- 172.21.15.28:0/2888062330 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368005cf0 con 0x7ff3780b8f30 2023-11-28T19:31:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff35f7fe640 1 -- 172.21.15.28:0/2888062330 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff368005e50 con 0x7ff3780b8f30 2023-11-28T19:31:59.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff35f7fe640 1 -- 172.21.15.28:0/2888062330 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff368007270 con 0x7ff3780b8f30 2023-11-28T19:31:59.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff37d3f2640 1 -- 172.21.15.28:0/2888062330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff378140cd0 con 0x7ff3780b8f30 2023-11-28T19:31:59.009 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff37d3f2640 1 -- 172.21.15.28:0/2888062330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3781414c0 con 0x7ff3780b8f30 2023-11-28T19:31:59.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff37d3f2640 1 -- 172.21.15.28:0/2888062330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff378074a90 con 0x7ff3780b8f30 2023-11-28T19:31:59.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff35f7fe640 1 -- 172.21.15.28:0/2888062330 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff3680073d0 con 0x7ff3780b8f30 2023-11-28T19:31:59.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff35f7fe640 1 --2- 172.21.15.28:0/2888062330 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff364066470 0x7ff364068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff35f7fe640 1 -- 172.21.15.28:0/2888062330 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff368083060 con 0x7ff3780b8f30 2023-11-28T19:31:59.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff3767fc640 1 --2- 172.21.15.28:0/2888062330 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff364066470 0x7ff364068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.006+0000 7ff3767fc640 1 --2- 172.21.15.28:0/2888062330 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff364066470 0x7ff364068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff37813c420 tx=0x7ff36c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:59.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.010+0000 7ff35f7fe640 1 -- 172.21.15.28:0/2888062330 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff368050620 con 0x7ff3780b8f30 2023-11-28T19:31:59.169 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.166+0000 7ff37d3f2640 1 -- 172.21.15.28:0/2888062330 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff37806f780 con 0x7ff3780b8f30 2023-11-28T19:31:59.170 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.170+0000 7ff35f7fe640 1 -- 172.21.15.28:0/2888062330 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7ff37806f780 con 0x7ff3780b8f30 2023-11-28T19:31:59.171 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:31:59.171 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:31:59.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.170+0000 7ff37d3f2640 1 -- 172.21.15.28:0/2888062330 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff364066470 msgr2=0x7ff364068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.170+0000 7ff37d3f2640 1 --2- 172.21.15.28:0/2888062330 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff364066470 0x7ff364068930 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7ff37813c420 tx=0x7ff36c008040 comp rx=0 tx=0).stop 2023-11-28T19:31:59.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.170+0000 7ff37d3f2640 1 -- 172.21.15.28:0/2888062330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3780b8f30 msgr2=0x7ff378141ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.170+0000 7ff37d3f2640 1 --2- 172.21.15.28:0/2888062330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3780b8f30 0x7ff378141ad0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff36800c530 tx=0x7ff36800c9f0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.170+0000 7ff37d3f2640 1 -- 172.21.15.28:0/2888062330 shutdown_connections 2023-11-28T19:31:59.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.170+0000 7ff37d3f2640 1 --2- 172.21.15.28:0/2888062330 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff364066470 0x7ff364068930 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.170+0000 7ff37d3f2640 1 --2- 172.21.15.28:0/2888062330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff37814ccc0 0x7ff3781336d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.170+0000 7ff37d3f2640 1 --2- 172.21.15.28:0/2888062330 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff37814c860 0x7ff3781367d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.170+0000 7ff37d3f2640 1 --2- 172.21.15.28:0/2888062330 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff3780b8f30 0x7ff378141ad0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.170+0000 7ff37d3f2640 1 -- 172.21.15.28:0/2888062330 >> 172.21.15.28:0/2888062330 conn(0x7ff3780bcb40 msgr2=0x7ff3780baf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:59.173 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.170+0000 7ff37d3f2640 1 -- 172.21.15.28:0/2888062330 shutdown_connections 2023-11-28T19:31:59.174 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.170+0000 7ff37d3f2640 1 -- 172.21.15.28:0/2888062330 wait complete. 2023-11-28T19:31:59.189 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:31:33.212362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:31:42.810956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:31:43.579438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T19:31:59.190 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:31:59.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa7a0d5f640 1 Processor -- start 2023-11-28T19:31:59.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa7a0d5f640 1 -- start start 2023-11-28T19:31:59.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa7a0d5f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa79c0a2d60 0x7fa79c14c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa7a0d5f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79c143b60 con 0x7fa79c072940 2023-11-28T19:31:59.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa7a0d5f640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa79c0bd7f0 con 0x7fa79c0bc120 2023-11-28T19:31:59.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa7a0d5f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b6f30 con 0x7fa79c0a2d60 2023-11-28T19:31:59.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79ad9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fa79c072940 0x7fa79c153c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42400/0 (socket says 172.21.15.28:42400) 2023-11-28T19:31:59.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79ad9d640 1 -- 172.21.15.28:0/2648334422 learned_addr learned my addr 172.21.15.28:0/2648334422 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:59.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa799d9b640 1 --2- 172.21.15.28:0/2648334422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa79c0a2d60 0x7fa79c14c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 -- 172.21.15.28:0/2648334422 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 471979966 0 0) 0x7fa79c143b60 con 0x7fa79c072940 2023-11-28T19:31:59.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 -- 172.21.15.28:0/2648334422 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa784003530 con 0x7fa79c072940 2023-11-28T19:31:59.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 -- 172.21.15.28:0/2648334422 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2683876460 0 0) 0x7fa784003530 con 0x7fa79c072940 2023-11-28T19:31:59.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 -- 172.21.15.28:0/2648334422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa79c0a2d60 msgr2=0x7fa79c14c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:59.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 --2- 172.21.15.28:0/2648334422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa79c0a2d60 0x7fa79c14c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 -- 172.21.15.28:0/2648334422 >> v1:172.21.15.131:6789/0 conn(0x7fa79c0bc120 legacy=0x7fa79c0bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 -- 172.21.15.28:0/2648334422 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c0b7aa0 con 0x7fa79c072940 2023-11-28T19:31:59.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 -- 172.21.15.28:0/2648334422 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7fa794001a00 con 0x7fa79c072940 2023-11-28T19:31:59.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 -- 172.21.15.28:0/2648334422 >> v1:172.21.15.28:6789/0 conn(0x7fa79c072940 legacy=0x7fa79c153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 --2- 172.21.15.28:0/2648334422 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7840039b0 0x7fa784003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.309 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 --2- 172.21.15.28:0/2648334422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa79c0a2d60 0x7fa7840047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 --2- 172.21.15.28:0/2648334422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa784004d10 0x7fa784005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 -- 172.21.15.28:0/2648334422 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c0b6f30 con 0x7fa7840039b0 2023-11-28T19:31:59.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 -- 172.21.15.28:0/2648334422 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78400bbb0 con 0x7fa784004d10 2023-11-28T19:31:59.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79959a640 1 -- 172.21.15.28:0/2648334422 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78400bd70 con 0x7fa79c0a2d60 2023-11-28T19:31:59.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79a59c640 1 --2- 172.21.15.28:0/2648334422 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7840039b0 0x7fa784003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa799d9b640 1 --2- 172.21.15.28:0/2648334422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa79c0a2d60 0x7fa7840047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79ad9d640 1 --2- 172.21.15.28:0/2648334422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa784004d10 0x7fa784005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79a59c640 1 -- 172.21.15.28:0/2648334422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa79c0a2d60 msgr2=0x7fa7840047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:59.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79a59c640 1 --2- 172.21.15.28:0/2648334422 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa79c0a2d60 0x7fa7840047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79a59c640 1 -- 172.21.15.28:0/2648334422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa784004d10 msgr2=0x7fa784005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:59.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79a59c640 1 --2- 172.21.15.28:0/2648334422 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa784004d10 0x7fa784005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.310 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.306+0000 7fa79a59c640 1 -- 172.21.15.28:0/2648334422 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa784003530 con 0x7fa7840039b0 2023-11-28T19:31:59.311 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa79a59c640 1 --2- 172.21.15.28:0/2648334422 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7840039b0 0x7fa784003df0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa78c001780 tx=0x7fa78c01c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aceb972e8a8c793 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:59.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa79959a640 1 -- 172.21.15.28:0/2648334422 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c0052d0 con 0x7fa7840039b0 2023-11-28T19:31:59.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa79959a640 1 -- 172.21.15.28:0/2648334422 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa78c0a7050 con 0x7fa7840039b0 2023-11-28T19:31:59.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa79959a640 1 -- 172.21.15.28:0/2648334422 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa78c003600 con 0x7fa7840039b0 2023-11-28T19:31:59.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2648334422 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7840039b0 msgr2=0x7fa784003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa7a0d5f640 1 --2- 172.21.15.28:0/2648334422 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa7840039b0 0x7fa784003df0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa78c001780 tx=0x7fa78c01c400 comp rx=0 tx=0).stop 2023-11-28T19:31:59.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa79ad9d640 1 -- 172.21.15.28:0/2648334422 reap_dead start 2023-11-28T19:31:59.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2648334422 shutdown_connections 2023-11-28T19:31:59.312 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2648334422 >> 172.21.15.28:0/2648334422 conn(0x7fa79c06ab80 msgr2=0x7fa79c0bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:59.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2648334422 shutdown_connections 2023-11-28T19:31:59.313 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2648334422 wait complete. 2023-11-28T19:31:59.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa7a0d5f640 1 Processor -- start 2023-11-28T19:31:59.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa7a0d5f640 1 -- start start 2023-11-28T19:31:59.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa7a0d5f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7840039b0 0x7fa79c1e0940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa7a0d5f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa79c1e4a40 0x7fa79c0b56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa7a0d5f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa79c0b4680 0x7fa79c0b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa7a0d5f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c14a580 con 0x7fa79c0b4680 2023-11-28T19:31:59.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa7a0d5f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c1e45b0 con 0x7fa79c1e4a40 2023-11-28T19:31:59.315 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa7a0d5f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa79c1e3fa0 con 0x7fa7840039b0 2023-11-28T19:31:59.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa79ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa79c0b4680 0x7fa79c0b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa79ad9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa79c0b4680 0x7fa79c0b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60750/0 (socket says 172.21.15.28:60750) 2023-11-28T19:31:59.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa79ad9d640 1 -- 172.21.15.28:0/2037298694 learned_addr learned my addr 172.21.15.28:0/2037298694 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:59.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa79ad9d640 1 -- 172.21.15.28:0/2037298694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7840039b0 msgr2=0x7fa79c1e0940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa79ad9d640 1 --2- 172.21.15.28:0/2037298694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7840039b0 0x7fa79c1e0940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa79ad9d640 1 -- 172.21.15.28:0/2037298694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa79c1e4a40 msgr2=0x7fa79c0b56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa79ad9d640 1 --2- 172.21.15.28:0/2037298694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa79c1e4a40 0x7fa79c0b56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.310+0000 7fa79ad9d640 1 -- 172.21.15.28:0/2037298694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa79c147340 con 0x7fa79c0b4680 2023-11-28T19:31:59.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.314+0000 7fa79ad9d640 1 --2- 172.21.15.28:0/2037298694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa79c0b4680 0x7fa79c0b4b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa794002240 tx=0x7fa794011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:59.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.314+0000 7fa78affd640 1 -- 172.21.15.28:0/2037298694 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79400f920 con 0x7fa79c0b4680 2023-11-28T19:31:59.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.314+0000 7fa78affd640 1 -- 172.21.15.28:0/2037298694 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa79400faa0 con 0x7fa79c0b4680 2023-11-28T19:31:59.316 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.314+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2037298694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa79c1e4240 con 0x7fa79c0b4680 2023-11-28T19:31:59.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.314+0000 7fa78affd640 1 -- 172.21.15.28:0/2037298694 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa79400fe50 con 0x7fa79c0b4680 2023-11-28T19:31:59.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.314+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2037298694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa79c1452c0 con 0x7fa79c0b4680 2023-11-28T19:31:59.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.314+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2037298694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa79c067a20 con 0x7fa79c0b4680 2023-11-28T19:31:59.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.314+0000 7fa78affd640 1 -- 172.21.15.28:0/2037298694 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa79401f460 con 0x7fa79c0b4680 2023-11-28T19:31:59.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.314+0000 7fa78affd640 1 --2- 172.21.15.28:0/2037298694 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa77c066470 0x7fa77c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.314+0000 7fa78affd640 1 -- 172.21.15.28:0/2037298694 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa794086e20 con 0x7fa79c0b4680 2023-11-28T19:31:59.317 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.314+0000 7fa79a59c640 1 --2- 172.21.15.28:0/2037298694 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa77c066470 0x7fa77c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.314+0000 7fa79a59c640 1 --2- 172.21.15.28:0/2037298694 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa77c066470 0x7fa77c068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0ac000 tx=0x7fa78c001130 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:59.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.318+0000 7fa78affd640 1 -- 172.21.15.28:0/2037298694 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa794054330 con 0x7fa79c0b4680 2023-11-28T19:31:59.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.474+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2037298694 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa79c1e43d0 con 0x7fa79c0b4680 2023-11-28T19:31:59.476 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.474+0000 7fa78affd640 1 -- 172.21.15.28:0/2037298694 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa794057950 con 0x7fa79c0b4680 2023-11-28T19:31:59.476 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-28T19:31:59.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.478+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2037298694 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa77c066470 msgr2=0x7fa77c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.478+0000 7fa7a0d5f640 1 --2- 172.21.15.28:0/2037298694 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa77c066470 0x7fa77c068930 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0ac000 tx=0x7fa78c001130 comp rx=0 tx=0).stop 2023-11-28T19:31:59.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.478+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2037298694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa79c0b4680 msgr2=0x7fa79c0b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.478+0000 7fa7a0d5f640 1 --2- 172.21.15.28:0/2037298694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa79c0b4680 0x7fa79c0b4b00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa794002240 tx=0x7fa794011c20 comp rx=0 tx=0).stop 2023-11-28T19:31:59.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.478+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2037298694 shutdown_connections 2023-11-28T19:31:59.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.478+0000 7fa7a0d5f640 1 --2- 172.21.15.28:0/2037298694 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa77c066470 0x7fa77c068930 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.478+0000 7fa7a0d5f640 1 --2- 172.21.15.28:0/2037298694 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa79c0b4680 0x7fa79c0b4b00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.478+0000 7fa7a0d5f640 1 --2- 172.21.15.28:0/2037298694 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa79c1e4a40 0x7fa79c0b56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.478+0000 7fa7a0d5f640 1 --2- 172.21.15.28:0/2037298694 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa7840039b0 0x7fa79c1e0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.478+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2037298694 >> 172.21.15.28:0/2037298694 conn(0x7fa79c06ab80 msgr2=0x7fa79c0b94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:59.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.478+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2037298694 shutdown_connections 2023-11-28T19:31:59.480 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.478+0000 7fa7a0d5f640 1 -- 172.21.15.28:0/2037298694 wait complete. 2023-11-28T19:31:59.494 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:31:59.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122f16e640 1 Processor -- start 2023-11-28T19:31:59.622 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122f16e640 1 -- start start 2023-11-28T19:31:59.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122f16e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f12281498f0 0x7f122806f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122f16e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122806ec10 con 0x7f12280b5870 2023-11-28T19:31:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122f16e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f122806f010 con 0x7f1228142c90 2023-11-28T19:31:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122f16e640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f122806e2e0 con 0x7f12281498f0 2023-11-28T19:31:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122cf0a640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f12280b5870 0x7f12281491e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42412/0 (socket says 172.21.15.28:42412) 2023-11-28T19:31:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122cf0a640 1 -- 172.21.15.28:0/2805788384 learned_addr learned my addr 172.21.15.28:0/2805788384 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:31:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f1227fff640 1 --2- 172.21.15.28:0/2805788384 >> v2:172.21.15.131:3300/0 conn(0x7f12281498f0 0x7f122806f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 -- 172.21.15.28:0/2805788384 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589369260 0 0) 0x7f122806ec10 con 0x7f12280b5870 2023-11-28T19:31:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 -- 172.21.15.28:0/2805788384 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1218003530 con 0x7f12280b5870 2023-11-28T19:31:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 -- 172.21.15.28:0/2805788384 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 739607119 0 0) 0x7f1218003530 con 0x7f12280b5870 2023-11-28T19:31:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 -- 172.21.15.28:0/2805788384 >> v2:172.21.15.131:3300/0 conn(0x7f12281498f0 msgr2=0x7f122806f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:59.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 --2- 172.21.15.28:0/2805788384 >> v2:172.21.15.131:3300/0 conn(0x7f12281498f0 0x7f122806f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 -- 172.21.15.28:0/2805788384 >> v1:172.21.15.131:6789/0 conn(0x7f1228142c90 legacy=0x7f1228143120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 -- 172.21.15.28:0/2805788384 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f122806e5c0 con 0x7f12280b5870 2023-11-28T19:31:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 -- 172.21.15.28:0/2805788384 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f121c001680 con 0x7f12280b5870 2023-11-28T19:31:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 -- 172.21.15.28:0/2805788384 >> v1:172.21.15.28:6789/0 conn(0x7f12280b5870 legacy=0x7f12281491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 --2- 172.21.15.28:0/2805788384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1218003980 0x7f1218003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 --2- 172.21.15.28:0/2805788384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12180047d0 0x7f1218004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 --2- 172.21.15.28:0/2805788384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1218005190 0x7f121800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 -- 172.21.15.28:0/2805788384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122806e2e0 con 0x7f1218005190 2023-11-28T19:31:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 -- 172.21.15.28:0/2805788384 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f121800c030 con 0x7f12180047d0 2023-11-28T19:31:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f12277fe640 1 -- 172.21.15.28:0/2805788384 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f121800c1f0 con 0x7f1218003980 2023-11-28T19:31:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122d70b640 1 --2- 172.21.15.28:0/2805788384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1218005190 0x7f121800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f1227fff640 1 --2- 172.21.15.28:0/2805788384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12180047d0 0x7f1218004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122cf0a640 1 --2- 172.21.15.28:0/2805788384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1218003980 0x7f1218003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122d70b640 1 -- 172.21.15.28:0/2805788384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1218003980 msgr2=0x7f1218003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:59.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122d70b640 1 --2- 172.21.15.28:0/2805788384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1218003980 0x7f1218003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122d70b640 1 -- 172.21.15.28:0/2805788384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12180047d0 msgr2=0x7f1218004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:59.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122d70b640 1 --2- 172.21.15.28:0/2805788384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12180047d0 0x7f1218004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122d70b640 1 -- 172.21.15.28:0/2805788384 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1218003530 con 0x7f1218005190 2023-11-28T19:31:59.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f1227fff640 1 --2- 172.21.15.28:0/2805788384 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f12180047d0 0x7f1218004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:59.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.622+0000 7f122cf0a640 1 --2- 172.21.15.28:0/2805788384 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1218003980 0x7f1218003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122d70b640 1 -- 172.21.15.28:0/2805788384 reap_dead start 2023-11-28T19:31:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122d70b640 1 --2- 172.21.15.28:0/2805788384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1218005190 0x7f121800b990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1220001e70 tx=0x7f122001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573c9687b88c7b65 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f12277fe640 1 -- 172.21.15.28:0/2805788384 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1220003b80 con 0x7f1218005190 2023-11-28T19:31:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f12277fe640 1 -- 172.21.15.28:0/2805788384 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1220003d20 con 0x7f1218005190 2023-11-28T19:31:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f12277fe640 1 -- 172.21.15.28:0/2805788384 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1220005260 con 0x7f1218005190 2023-11-28T19:31:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 -- 172.21.15.28:0/2805788384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1218005190 msgr2=0x7f121800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 --2- 172.21.15.28:0/2805788384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1218005190 0x7f121800b990 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1220001e70 tx=0x7f122001c760 comp rx=0 tx=0).stop 2023-11-28T19:31:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 -- 172.21.15.28:0/2805788384 shutdown_connections 2023-11-28T19:31:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 --2- 172.21.15.28:0/2805788384 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1218005190 0x7f121800b990 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 -- 172.21.15.28:0/2805788384 >> 172.21.15.28:0/2805788384 conn(0x7f12280bb7c0 msgr2=0x7f12280bbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:59.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 -- 172.21.15.28:0/2805788384 shutdown_connections 2023-11-28T19:31:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 -- 172.21.15.28:0/2805788384 wait complete. 2023-11-28T19:31:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 Processor -- start 2023-11-28T19:31:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 -- start start 2023-11-28T19:31:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1218005190 0x7f122814a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1228143dd0 0x7f12280b8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12281e2610 0x7f1228147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12280b8f70 con 0x7f12281e2610 2023-11-28T19:31:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12281486f0 con 0x7f1218005190 2023-11-28T19:31:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122f16e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1228144730 con 0x7f1228143dd0 2023-11-28T19:31:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122d70b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12281e2610 0x7f1228147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122d70b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12281e2610 0x7f1228147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60780/0 (socket says 172.21.15.28:60780) 2023-11-28T19:31:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122d70b640 1 -- 172.21.15.28:0/2941557987 learned_addr learned my addr 172.21.15.28:0/2941557987 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:59.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122cf0a640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1218005190 0x7f122814a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f1227fff640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1228143dd0 0x7f12280b8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122d70b640 1 -- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1228143dd0 msgr2=0x7f12280b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122d70b640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1228143dd0 0x7f12280b8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122d70b640 1 -- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1218005190 msgr2=0x7f122814a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122d70b640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1218005190 0x7f122814a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122d70b640 1 -- 172.21.15.28:0/2941557987 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12281e1b30 con 0x7f12281e2610 2023-11-28T19:31:59.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.626+0000 7f122cf0a640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1218005190 0x7f122814a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:59.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.630+0000 7f122d70b640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12281e2610 0x7f1228147280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f122001cc40 tx=0x7f1218005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:59.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.630+0000 7f12257fa640 1 -- 172.21.15.28:0/2941557987 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12200ac070 con 0x7f12281e2610 2023-11-28T19:31:59.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.630+0000 7f12257fa640 1 -- 172.21.15.28:0/2941557987 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1220003e90 con 0x7f12281e2610 2023-11-28T19:31:59.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.630+0000 7f122f16e640 1 -- 172.21.15.28:0/2941557987 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12281e1e10 con 0x7f12281e2610 2023-11-28T19:31:59.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.630+0000 7f12257fa640 1 -- 172.21.15.28:0/2941557987 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1220003b80 con 0x7f12281e2610 2023-11-28T19:31:59.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.630+0000 7f122f16e640 1 -- 172.21.15.28:0/2941557987 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12281438f0 con 0x7f12281e2610 2023-11-28T19:31:59.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.630+0000 7f122f16e640 1 -- 172.21.15.28:0/2941557987 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f122806dfa0 con 0x7f12281e2610 2023-11-28T19:31:59.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.630+0000 7f12257fa640 1 -- 172.21.15.28:0/2941557987 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1220006b60 con 0x7f12281e2610 2023-11-28T19:31:59.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.630+0000 7f12257fa640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f120c0664a0 0x7f120c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.630+0000 7f12257fa640 1 -- 172.21.15.28:0/2941557987 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f122011cfa0 con 0x7f12281e2610 2023-11-28T19:31:59.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.630+0000 7f122cf0a640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f120c0664a0 0x7f120c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.630+0000 7f122cf0a640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f120c0664a0 0x7f120c068960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f121c001210 tx=0x7f121c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:59.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.634+0000 7f12257fa640 1 -- 172.21.15.28:0/2941557987 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f12200ea380 con 0x7f12281e2610 2023-11-28T19:31:59.786 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.786+0000 7f122f16e640 1 -- 172.21.15.28:0/2941557987 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1228074a90 con 0x7f12281e2610 2023-11-28T19:31:59.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.786+0000 7f12257fa640 1 -- 172.21.15.28:0/2941557987 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f12200ed9a0 con 0x7f12281e2610 2023-11-28T19:31:59.787 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-28T19:31:59.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.786+0000 7f122f16e640 1 -- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f120c0664a0 msgr2=0x7f120c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.790+0000 7f122f16e640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f120c0664a0 0x7f120c068960 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f121c001210 tx=0x7f121c009040 comp rx=0 tx=0).stop 2023-11-28T19:31:59.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.790+0000 7f122f16e640 1 -- 172.21.15.28:0/2941557987 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12281e2610 msgr2=0x7f1228147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.790+0000 7f122f16e640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12281e2610 0x7f1228147280 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f122001cc40 tx=0x7f1218005800 comp rx=0 tx=0).stop 2023-11-28T19:31:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.790+0000 7f122f16e640 1 -- 172.21.15.28:0/2941557987 shutdown_connections 2023-11-28T19:31:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.790+0000 7f122f16e640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f120c0664a0 0x7f120c068960 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.790+0000 7f122f16e640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f12281e2610 0x7f1228147280 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.790+0000 7f122f16e640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1228143dd0 0x7f12280b8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.790+0000 7f122f16e640 1 --2- 172.21.15.28:0/2941557987 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1218005190 0x7f122814a1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.790+0000 7f122f16e640 1 -- 172.21.15.28:0/2941557987 >> 172.21.15.28:0/2941557987 conn(0x7f12280bb7c0 msgr2=0x7f12280b9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.790+0000 7f122f16e640 1 -- 172.21.15.28:0/2941557987 shutdown_connections 2023-11-28T19:31:59.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.790+0000 7f122f16e640 1 -- 172.21.15.28:0/2941557987 wait complete. 2023-11-28T19:31:59.805 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:31:59.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c22fee640 1 Processor -- start 2023-11-28T19:31:59.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c22fee640 1 -- start start 2023-11-28T19:31:59.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c22fee640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1c1c0bab20 0x7f1c1c0b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c22fee640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1c1c06f540 0x7f1c1c155dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c22fee640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c0b4650 con 0x7f1c1c0b59c0 2023-11-28T19:31:59.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c22fee640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c06d440 con 0x7f1c1c06f540 2023-11-28T19:31:59.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c22fee640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c0b42e0 con 0x7f1c1c0bab20 2023-11-28T19:31:59.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c2158b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1c1c06f540 0x7f1c1c155dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c2158b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1c1c06f540 0x7f1c1c155dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60784/0 (socket says 172.21.15.28:60784) 2023-11-28T19:31:59.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c2158b640 1 -- 172.21.15.28:0/431823772 learned_addr learned my addr 172.21.15.28:0/431823772 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:59.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c20d8a640 1 --2- 172.21.15.28:0/431823772 >> v2:172.21.15.131:3300/0 conn(0x7f1c1c0bab20 0x7f1c1c0b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c2158b640 1 -- 172.21.15.28:0/431823772 >> v2:172.21.15.131:3300/0 conn(0x7f1c1c0bab20 msgr2=0x7f1c1c0b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:59.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c2158b640 1 --2- 172.21.15.28:0/431823772 >> v2:172.21.15.131:3300/0 conn(0x7f1c1c0bab20 0x7f1c1c0b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c2158b640 1 -- 172.21.15.28:0/431823772 >> v1:172.21.15.131:6789/0 conn(0x7f1c1c0b59c0 legacy=0x7f1c1c14b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:31:59.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c2158b640 1 -- 172.21.15.28:0/431823772 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c0baf00 con 0x7f1c1c06f540 2023-11-28T19:31:59.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.930+0000 7f1c20d8a640 1 --2- 172.21.15.28:0/431823772 >> v2:172.21.15.131:3300/0 conn(0x7f1c1c0bab20 0x7f1c1c0b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:31:59.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.934+0000 7f1c2158b640 1 --2- 172.21.15.28:0/431823772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c1c06f540 0x7f1c1c155dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c072400 tx=0x7f1c1401c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d068686e2ba1e00f server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:59.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.934+0000 7f1c1b7fe640 1 -- 172.21.15.28:0/431823772 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140a6470 con 0x7f1c1c06f540 2023-11-28T19:31:59.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.934+0000 7f1c1b7fe640 1 -- 172.21.15.28:0/431823772 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c140a65d0 con 0x7f1c1c06f540 2023-11-28T19:31:59.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.934+0000 7f1c1b7fe640 1 -- 172.21.15.28:0/431823772 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140a6960 con 0x7f1c1c06f540 2023-11-28T19:31:59.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.934+0000 7f1c22fee640 1 -- 172.21.15.28:0/431823772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c1c06f540 msgr2=0x7f1c1c155dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.934+0000 7f1c22fee640 1 --2- 172.21.15.28:0/431823772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c1c06f540 0x7f1c1c155dc0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c072400 tx=0x7f1c1401c8b0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.934+0000 7f1c22fee640 1 -- 172.21.15.28:0/431823772 shutdown_connections 2023-11-28T19:31:59.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.934+0000 7f1c22fee640 1 --2- 172.21.15.28:0/431823772 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c1c06f540 0x7f1c1c155dc0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.934+0000 7f1c22fee640 1 --2- 172.21.15.28:0/431823772 >> v2:172.21.15.131:3300/0 conn(0x7f1c1c0bab20 0x7f1c1c0b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.934+0000 7f1c22fee640 1 -- 172.21.15.28:0/431823772 >> 172.21.15.28:0/431823772 conn(0x7f1c1c0beaf0 msgr2=0x7f1c1c0bef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:31:59.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.934+0000 7f1c22fee640 1 -- 172.21.15.28:0/431823772 shutdown_connections 2023-11-28T19:31:59.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.934+0000 7f1c22fee640 1 -- 172.21.15.28:0/431823772 wait complete. 2023-11-28T19:31:59.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.934+0000 7f1c22fee640 1 Processor -- start 2023-11-28T19:31:59.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.934+0000 7f1c22fee640 1 -- start start 2023-11-28T19:31:59.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c22fee640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1c06f540 0x7f1c1c13fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c22fee640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c1c0b59c0 0x7f1c1c14c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c22fee640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c1c0bab20 0x7f1c1c14cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c22fee640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c1402b0 con 0x7f1c1c0bab20 2023-11-28T19:31:59.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c22fee640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c145df0 con 0x7f1c1c0b59c0 2023-11-28T19:31:59.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c22fee640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c14e800 con 0x7f1c1c06f540 2023-11-28T19:31:59.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c2158b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c1c0bab20 0x7f1c1c14cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c2158b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c1c0bab20 0x7f1c1c14cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60786/0 (socket says 172.21.15.28:60786) 2023-11-28T19:31:59.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c2158b640 1 -- 172.21.15.28:0/637200168 learned_addr learned my addr 172.21.15.28:0/637200168 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:31:59.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c20d8a640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1c06f540 0x7f1c1c13fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c1bfff640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c1c0b59c0 0x7f1c1c14c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c2158b640 1 -- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1c06f540 msgr2=0x7f1c1c13fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c2158b640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1c06f540 0x7f1c1c13fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c2158b640 1 -- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c1c0b59c0 msgr2=0x7f1c1c14c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:31:59.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c2158b640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c1c0b59c0 0x7f1c1c14c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:31:59.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c2158b640 1 -- 172.21.15.28:0/637200168 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14009b30 con 0x7f1c1c0bab20 2023-11-28T19:31:59.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c1bfff640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c1c0b59c0 0x7f1c1c14c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:59.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c20d8a640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1c06f540 0x7f1c1c13fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:31:59.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c2158b640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c1c0bab20 0x7f1c1c14cbb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c1401af60 tx=0x7f1c14019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:59.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c197fa640 1 -- 172.21.15.28:0/637200168 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140b6070 con 0x7f1c1c0bab20 2023-11-28T19:31:59.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c197fa640 1 -- 172.21.15.28:0/637200168 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c14009510 con 0x7f1c1c0bab20 2023-11-28T19:31:59.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c197fa640 1 -- 172.21.15.28:0/637200168 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140a6470 con 0x7f1c1c0bab20 2023-11-28T19:31:59.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c22fee640 1 -- 172.21.15.28:0/637200168 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c14eae0 con 0x7f1c1c0bab20 2023-11-28T19:31:59.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c22fee640 1 -- 172.21.15.28:0/637200168 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c14e4b0 con 0x7f1c1c0bab20 2023-11-28T19:31:59.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.938+0000 7f1c22fee640 1 -- 172.21.15.28:0/637200168 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c145f60 con 0x7f1c1c0bab20 2023-11-28T19:31:59.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.942+0000 7f1c197fa640 1 -- 172.21.15.28:0/637200168 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1c140ba070 con 0x7f1c1c0bab20 2023-11-28T19:31:59.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.942+0000 7f1c197fa640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1bfc0664a0 0x7f1bfc068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:31:59.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.942+0000 7f1c197fa640 1 -- 172.21.15.28:0/637200168 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c1411de30 con 0x7f1c1c0bab20 2023-11-28T19:31:59.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.942+0000 7f1c20d8a640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1bfc0664a0 0x7f1bfc068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:31:59.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.942+0000 7f1c20d8a640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1bfc0664a0 0x7f1bfc068960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0097a0 tx=0x7f1c0c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:31:59.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:31:59.942+0000 7f1c197fa640 1 -- 172.21.15.28:0/637200168 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1c140eb290 con 0x7f1c1c0bab20 2023-11-28T19:32:00.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.098+0000 7f1c22fee640 1 -- 172.21.15.28:0/637200168 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c1c145f60 con 0x7f1c1c0bab20 2023-11-28T19:32:00.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.102+0000 7f1c197fa640 1 -- 172.21.15.28:0/637200168 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c1c145f60 con 0x7f1c1c0bab20 2023-11-28T19:32:00.102 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-28T19:32:00.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.102+0000 7f1c22fee640 1 -- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1bfc0664a0 msgr2=0x7f1bfc068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.102+0000 7f1c22fee640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1bfc0664a0 0x7f1bfc068960 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c0097a0 tx=0x7f1c0c008040 comp rx=0 tx=0).stop 2023-11-28T19:32:00.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.102+0000 7f1c22fee640 1 -- 172.21.15.28:0/637200168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c1c0bab20 msgr2=0x7f1c1c14cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.102+0000 7f1c22fee640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c1c0bab20 0x7f1c1c14cbb0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1c1401af60 tx=0x7f1c14019650 comp rx=0 tx=0).stop 2023-11-28T19:32:00.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.102+0000 7f1c22fee640 1 -- 172.21.15.28:0/637200168 shutdown_connections 2023-11-28T19:32:00.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.102+0000 7f1c22fee640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1bfc0664a0 0x7f1bfc068960 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.102+0000 7f1c22fee640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1c1c0bab20 0x7f1c1c14cbb0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.102+0000 7f1c22fee640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c1c0b59c0 0x7f1c1c14c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.102+0000 7f1c22fee640 1 --2- 172.21.15.28:0/637200168 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1c1c06f540 0x7f1c1c13fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.102+0000 7f1c22fee640 1 -- 172.21.15.28:0/637200168 >> 172.21.15.28:0/637200168 conn(0x7f1c1c0beaf0 msgr2=0x7f1c1c141ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:00.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.102+0000 7f1c22fee640 1 -- 172.21.15.28:0/637200168 shutdown_connections 2023-11-28T19:32:00.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.102+0000 7f1c22fee640 1 -- 172.21.15.28:0/637200168 wait complete. 2023-11-28T19:32:00.121 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:32:00.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.242+0000 7f862be5c640 1 Processor -- start 2023-11-28T19:32:00.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f862be5c640 1 -- start start 2023-11-28T19:32:00.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f862be5c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f86240ba890 0x7f8624071580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f862be5c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86241481c0 0x7f86240b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f862be5c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86240702b0 con 0x7f86240b9a30 2023-11-28T19:32:00.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f862be5c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86240710f0 con 0x7f86240ba890 2023-11-28T19:32:00.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f862be5c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86241429a0 con 0x7f86241481c0 2023-11-28T19:32:00.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f8629bf8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f86240ba890 0x7f8624071580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f862a3f9640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f86240b9a30 0x7f8624142290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42424/0 (socket says 172.21.15.28:42424) 2023-11-28T19:32:00.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f862a3f9640 1 -- 172.21.15.28:0/2172488712 learned_addr learned my addr 172.21.15.28:0/2172488712 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:00.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f86293f7640 1 --2- 172.21.15.28:0/2172488712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86241481c0 0x7f86240b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f8629bf8640 1 -- 172.21.15.28:0/2172488712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86241481c0 msgr2=0x7f86240b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:00.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f8629bf8640 1 --2- 172.21.15.28:0/2172488712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86241481c0 0x7f86240b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f8629bf8640 1 -- 172.21.15.28:0/2172488712 >> v1:172.21.15.28:6789/0 conn(0x7f86240b9a30 legacy=0x7f8624142290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f8628bf6640 1 -- 172.21.15.28:0/2172488712 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601145899 0 0) 0x7f86240702b0 con 0x7f86240b9a30 2023-11-28T19:32:00.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f8629bf8640 1 -- 172.21.15.28:0/2172488712 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86240b9ec0 con 0x7f86240ba890 2023-11-28T19:32:00.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f8629bf8640 1 --2- 172.21.15.28:0/2172488712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86240ba890 0x7f8624071580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f86200097c0 tx=0x7f862001c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e148b581540acb8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:00.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f8628bf6640 1 -- 172.21.15.28:0/2172488712 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86200ab600 con 0x7f86240ba890 2023-11-28T19:32:00.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f8628bf6640 1 -- 172.21.15.28:0/2172488712 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86200a7050 con 0x7f86240ba890 2023-11-28T19:32:00.249 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.246+0000 7f8628bf6640 1 -- 172.21.15.28:0/2172488712 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86200ab980 con 0x7f86240ba890 2023-11-28T19:32:00.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 -- 172.21.15.28:0/2172488712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86240ba890 msgr2=0x7f8624071580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 --2- 172.21.15.28:0/2172488712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86240ba890 0x7f8624071580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f86200097c0 tx=0x7f862001c3f0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 -- 172.21.15.28:0/2172488712 shutdown_connections 2023-11-28T19:32:00.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 --2- 172.21.15.28:0/2172488712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86241481c0 0x7f86240b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 --2- 172.21.15.28:0/2172488712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86240ba890 0x7f8624071580 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 -- 172.21.15.28:0/2172488712 >> 172.21.15.28:0/2172488712 conn(0x7f862406e7f0 msgr2=0x7f862406b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:00.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 -- 172.21.15.28:0/2172488712 shutdown_connections 2023-11-28T19:32:00.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 -- 172.21.15.28:0/2172488712 wait complete. 2023-11-28T19:32:00.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 Processor -- start 2023-11-28T19:32:00.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 -- start start 2023-11-28T19:32:00.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86240b9a30 0x7f8624149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86240ba890 0x7f862406a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86241481c0 0x7f8624137880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f862406ad20 con 0x7f86240ba890 2023-11-28T19:32:00.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86241373f0 con 0x7f86240b9a30 2023-11-28T19:32:00.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f862414a3d0 con 0x7f86241481c0 2023-11-28T19:32:00.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f86293f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86240ba890 0x7f862406a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f86293f7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86240ba890 0x7f862406a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60794/0 (socket says 172.21.15.28:60794) 2023-11-28T19:32:00.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f86293f7640 1 -- 172.21.15.28:0/4142531998 learned_addr learned my addr 172.21.15.28:0/4142531998 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:00.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862a3f9640 1 --2- 172.21.15.28:0/4142531998 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86241481c0 0x7f8624137880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f8629bf8640 1 --2- 172.21.15.28:0/4142531998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86240b9a30 0x7f8624149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f86293f7640 1 -- 172.21.15.28:0/4142531998 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86241481c0 msgr2=0x7f8624137880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f86293f7640 1 --2- 172.21.15.28:0/4142531998 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86241481c0 0x7f8624137880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f86293f7640 1 -- 172.21.15.28:0/4142531998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86240b9a30 msgr2=0x7f8624149bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f86293f7640 1 --2- 172.21.15.28:0/4142531998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86240b9a30 0x7f8624149bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f86293f7640 1 -- 172.21.15.28:0/4142531998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8620009420 con 0x7f86240ba890 2023-11-28T19:32:00.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f86293f7640 1 --2- 172.21.15.28:0/4142531998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86240ba890 0x7f862406a7e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f861400d800 tx=0x7f861400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:00.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f861a7fc640 1 -- 172.21.15.28:0/4142531998 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861400b6c0 con 0x7f86240ba890 2023-11-28T19:32:00.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f861a7fc640 1 -- 172.21.15.28:0/4142531998 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f861400b820 con 0x7f86240ba890 2023-11-28T19:32:00.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 -- 172.21.15.28:0/4142531998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f862414a6b0 con 0x7f86240ba890 2023-11-28T19:32:00.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f861a7fc640 1 -- 172.21.15.28:0/4142531998 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f861400bb90 con 0x7f86240ba890 2023-11-28T19:32:00.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.250+0000 7f862be5c640 1 -- 172.21.15.28:0/4142531998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8624149720 con 0x7f86240ba890 2023-11-28T19:32:00.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.254+0000 7f862be5c640 1 -- 172.21.15.28:0/4142531998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8624137580 con 0x7f86240ba890 2023-11-28T19:32:00.255 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.254+0000 7f861a7fc640 1 -- 172.21.15.28:0/4142531998 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f861400bcf0 con 0x7f86240ba890 2023-11-28T19:32:00.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.254+0000 7f861a7fc640 1 --2- 172.21.15.28:0/4142531998 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f86080664a0 0x7f8608068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.254+0000 7f861a7fc640 1 -- 172.21.15.28:0/4142531998 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8614084320 con 0x7f86240ba890 2023-11-28T19:32:00.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.254+0000 7f8629bf8640 1 --2- 172.21.15.28:0/4142531998 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f86080664a0 0x7f8608068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.254+0000 7f8629bf8640 1 --2- 172.21.15.28:0/4142531998 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f86080664a0 0x7f8608068960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f86200ad000 tx=0x7f8620008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:00.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.258+0000 7f861a7fc640 1 -- 172.21.15.28:0/4142531998 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8614051830 con 0x7f86240ba890 2023-11-28T19:32:00.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.418+0000 7f862be5c640 1 -- 172.21.15.28:0/4142531998 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8624074a90 con 0x7f86240ba890 2023-11-28T19:32:00.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.418+0000 7f861a7fc640 1 -- 172.21.15.28:0/4142531998 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f8614054e50 con 0x7f86240ba890 2023-11-28T19:32:00.419 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:00.420 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:32:00.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.418+0000 7f862be5c640 1 -- 172.21.15.28:0/4142531998 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f86080664a0 msgr2=0x7f8608068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.418+0000 7f862be5c640 1 --2- 172.21.15.28:0/4142531998 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f86080664a0 0x7f8608068960 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f86200ad000 tx=0x7f8620008040 comp rx=0 tx=0).stop 2023-11-28T19:32:00.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.422+0000 7f862be5c640 1 -- 172.21.15.28:0/4142531998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86240ba890 msgr2=0x7f862406a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.422+0000 7f862be5c640 1 --2- 172.21.15.28:0/4142531998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86240ba890 0x7f862406a7e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f861400d800 tx=0x7f861400dcc0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.422+0000 7f862be5c640 1 -- 172.21.15.28:0/4142531998 shutdown_connections 2023-11-28T19:32:00.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.422+0000 7f862be5c640 1 --2- 172.21.15.28:0/4142531998 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f86080664a0 0x7f8608068960 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.422+0000 7f862be5c640 1 --2- 172.21.15.28:0/4142531998 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f86241481c0 0x7f8624137880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.422+0000 7f862be5c640 1 --2- 172.21.15.28:0/4142531998 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f86240ba890 0x7f862406a7e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.422+0000 7f862be5c640 1 --2- 172.21.15.28:0/4142531998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f86240b9a30 0x7f8624149bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.422+0000 7f862be5c640 1 -- 172.21.15.28:0/4142531998 >> 172.21.15.28:0/4142531998 conn(0x7f862406e7f0 msgr2=0x7f8624147210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:00.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.422+0000 7f862be5c640 1 -- 172.21.15.28:0/4142531998 shutdown_connections 2023-11-28T19:32:00.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.422+0000 7f862be5c640 1 -- 172.21.15.28:0/4142531998 wait complete. 2023-11-28T19:32:00.439 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:31:33.212362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:31:42.810956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:31:43.579438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T19:32:00.439 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:32:00.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.566+0000 7faff6cb5640 1 Processor -- start 2023-11-28T19:32:00.569 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.566+0000 7faff6cb5640 1 -- start start 2023-11-28T19:32:00.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7faff6cb5640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faff00728c0 0x7faff00b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7faff6cb5640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff00b6e90 con 0x7faff00bc4d0 2023-11-28T19:32:00.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7faff6cb5640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faff00b6560 con 0x7faff00bd340 2023-11-28T19:32:00.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7faff6cb5640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faff00b6840 con 0x7faff00728c0 2023-11-28T19:32:00.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7fafeffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faff00728c0 0x7faff00b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7fafeffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7faff00728c0 0x7faff00b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60806/0 (socket says 172.21.15.28:60806) 2023-11-28T19:32:00.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7faff5252640 1 --1- 172.21.15.28:0/1103270815 >> v1:172.21.15.28:6789/0 conn(0x7faff00bc4d0 0x7faff0152a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42438/0 (socket says 172.21.15.28:42438) 2023-11-28T19:32:00.570 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7fafeffff640 1 -- 172.21.15.28:0/1103270815 learned_addr learned my addr 172.21.15.28:0/1103270815 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:00.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7fafeffff640 1 -- 172.21.15.28:0/1103270815 >> v1:172.21.15.131:6789/0 conn(0x7faff00bd340 legacy=0x7faff0142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7fafeffff640 1 -- 172.21.15.28:0/1103270815 >> v1:172.21.15.28:6789/0 conn(0x7faff00bc4d0 legacy=0x7faff0152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7fafeffff640 1 -- 172.21.15.28:0/1103270815 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff00b6b20 con 0x7faff00728c0 2023-11-28T19:32:00.571 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7fafef7fe640 1 -- 172.21.15.28:0/1103270815 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 859108462 0 0) 0x7faff00b6e90 con 0x7faff00bc4d0 2023-11-28T19:32:00.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7fafeffff640 1 --2- 172.21.15.28:0/1103270815 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faff00728c0 0x7faff00b4450 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009870 tx=0x7fafe401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=537aa083e1974e62 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:00.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7fafef7fe640 1 -- 172.21.15.28:0/1103270815 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40ab620 con 0x7faff00728c0 2023-11-28T19:32:00.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7fafef7fe640 1 -- 172.21.15.28:0/1103270815 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe40ab780 con 0x7faff00728c0 2023-11-28T19:32:00.573 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.570+0000 7fafef7fe640 1 -- 172.21.15.28:0/1103270815 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40abb10 con 0x7faff00728c0 2023-11-28T19:32:00.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 -- 172.21.15.28:0/1103270815 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faff00728c0 msgr2=0x7faff00b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 --2- 172.21.15.28:0/1103270815 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faff00728c0 0x7faff00b4450 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fafe4009870 tx=0x7fafe401c540 comp rx=0 tx=0).stop 2023-11-28T19:32:00.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 -- 172.21.15.28:0/1103270815 shutdown_connections 2023-11-28T19:32:00.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 --2- 172.21.15.28:0/1103270815 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faff00728c0 0x7faff00b4450 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 -- 172.21.15.28:0/1103270815 >> 172.21.15.28:0/1103270815 conn(0x7faff006ab80 msgr2=0x7faff00bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:00.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 -- 172.21.15.28:0/1103270815 shutdown_connections 2023-11-28T19:32:00.574 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 -- 172.21.15.28:0/1103270815 wait complete. 2023-11-28T19:32:00.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 Processor -- start 2023-11-28T19:32:00.575 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 -- start start 2023-11-28T19:32:00.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff00728c0 0x7faff0071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faff00bc4d0 0x7faff006f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.576 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faff00bd340 0x7faff013bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff0070c40 con 0x7faff00bc4d0 2023-11-28T19:32:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faff0139d60 con 0x7faff00728c0 2023-11-28T19:32:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faff0072020 con 0x7faff00bd340 2023-11-28T19:32:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7fafeffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faff00bc4d0 0x7faff006f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7fafeffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faff00bc4d0 0x7faff006f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60808/0 (socket says 172.21.15.28:60808) 2023-11-28T19:32:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7fafeffff640 1 -- 172.21.15.28:0/697488425 learned_addr learned my addr 172.21.15.28:0/697488425 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff5252640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faff00bd340 0x7faff013bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff4a51640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff00728c0 0x7faff0071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7fafeffff640 1 -- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faff00bd340 msgr2=0x7faff013bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7fafeffff640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faff00bd340 0x7faff013bcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7fafeffff640 1 -- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff00728c0 msgr2=0x7faff0071ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7fafeffff640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff00728c0 0x7faff0071ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.577 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7fafeffff640 1 -- 172.21.15.28:0/697488425 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe40094d0 con 0x7faff00bc4d0 2023-11-28T19:32:00.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff4a51640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff00728c0 0x7faff0071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:00.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7fafeffff640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faff00bc4d0 0x7faff006f1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fafe40ad040 tx=0x7fafe401ad80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:00.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7fafed7fa640 1 -- 172.21.15.28:0/697488425 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40be3f0 con 0x7faff00bc4d0 2023-11-28T19:32:00.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7fafed7fa640 1 -- 172.21.15.28:0/697488425 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe40be550 con 0x7faff00bc4d0 2023-11-28T19:32:00.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 -- 172.21.15.28:0/697488425 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faff013d1c0 con 0x7faff00bc4d0 2023-11-28T19:32:00.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7fafed7fa640 1 -- 172.21.15.28:0/697488425 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe40be900 con 0x7faff00bc4d0 2023-11-28T19:32:00.578 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.574+0000 7faff6cb5640 1 -- 172.21.15.28:0/697488425 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faff013d650 con 0x7faff00bc4d0 2023-11-28T19:32:00.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.578+0000 7faff6cb5640 1 -- 172.21.15.28:0/697488425 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faff0074a90 con 0x7faff00bc4d0 2023-11-28T19:32:00.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.578+0000 7fafed7fa640 1 -- 172.21.15.28:0/697488425 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fafe40b43f0 con 0x7faff00bc4d0 2023-11-28T19:32:00.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.578+0000 7fafed7fa640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fafdc066470 0x7fafdc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.578+0000 7fafed7fa640 1 -- 172.21.15.28:0/697488425 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fafe411e1a0 con 0x7faff00bc4d0 2023-11-28T19:32:00.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.578+0000 7faff4a51640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fafdc066470 0x7fafdc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.579 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.578+0000 7faff4a51640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fafdc066470 0x7fafdc068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fafe0000f70 tx=0x7fafe0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:00.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.582+0000 7fafed7fa640 1 -- 172.21.15.28:0/697488425 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fafe40eb760 con 0x7faff00bc4d0 2023-11-28T19:32:00.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.738+0000 7faff6cb5640 1 -- 172.21.15.28:0/697488425 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faff0140b10 con 0x7faff00bc4d0 2023-11-28T19:32:00.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.738+0000 7fafed7fa640 1 -- 172.21.15.28:0/697488425 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7fafe40eed80 con 0x7faff00bc4d0 2023-11-28T19:32:00.741 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-28T19:32:00.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.742+0000 7faff6cb5640 1 -- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fafdc066470 msgr2=0x7fafdc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.742+0000 7faff6cb5640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fafdc066470 0x7fafdc068930 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fafe0000f70 tx=0x7fafe0009040 comp rx=0 tx=0).stop 2023-11-28T19:32:00.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.742+0000 7faff6cb5640 1 -- 172.21.15.28:0/697488425 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faff00bc4d0 msgr2=0x7faff006f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.742+0000 7faff6cb5640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faff00bc4d0 0x7faff006f1a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fafe40ad040 tx=0x7fafe401ad80 comp rx=0 tx=0).stop 2023-11-28T19:32:00.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.742+0000 7faff6cb5640 1 -- 172.21.15.28:0/697488425 shutdown_connections 2023-11-28T19:32:00.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.742+0000 7faff6cb5640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fafdc066470 0x7fafdc068930 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.742+0000 7faff6cb5640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faff00bd340 0x7faff013bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.742+0000 7faff6cb5640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faff00bc4d0 0x7faff006f1a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.742+0000 7faff6cb5640 1 --2- 172.21.15.28:0/697488425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faff00728c0 0x7faff0071ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.742+0000 7faff6cb5640 1 -- 172.21.15.28:0/697488425 >> 172.21.15.28:0/697488425 conn(0x7faff006ab80 msgr2=0x7faff00b7640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:00.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.742+0000 7faff6cb5640 1 -- 172.21.15.28:0/697488425 shutdown_connections 2023-11-28T19:32:00.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.742+0000 7faff6cb5640 1 -- 172.21.15.28:0/697488425 wait complete. 2023-11-28T19:32:00.760 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:32:00.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.878+0000 7fdbc667e640 1 Processor -- start 2023-11-28T19:32:00.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.878+0000 7fdbc667e640 1 -- start start 2023-11-28T19:32:00.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbc667e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdbc00bc120 0x7fdbc00bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbc667e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdbc00a2d60 0x7fdbc014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbc667e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc0143b60 con 0x7fdbc0072940 2023-11-28T19:32:00.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbc667e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc00b6f30 con 0x7fdbc00a2d60 2023-11-28T19:32:00.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbc667e640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc00b7aa0 con 0x7fdbc00bc120 2023-11-28T19:32:00.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbbf7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdbc00a2d60 0x7fdbc014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbbf7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdbc00a2d60 0x7fdbc014c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60810/0 (socket says 172.21.15.28:60810) 2023-11-28T19:32:00.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbbf7fe640 1 -- 172.21.15.28:0/1561003408 learned_addr learned my addr 172.21.15.28:0/1561003408 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:00.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbbffff640 1 --2- 172.21.15.28:0/1561003408 >> v2:172.21.15.131:3300/0 conn(0x7fdbc00bc120 0x7fdbc00bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbbf7fe640 1 -- 172.21.15.28:0/1561003408 >> v2:172.21.15.131:3300/0 conn(0x7fdbc00bc120 msgr2=0x7fdbc00bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:00.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbbf7fe640 1 --2- 172.21.15.28:0/1561003408 >> v2:172.21.15.131:3300/0 conn(0x7fdbc00bc120 0x7fdbc00bd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbbf7fe640 1 -- 172.21.15.28:0/1561003408 >> v1:172.21.15.131:6789/0 conn(0x7fdbc0072940 legacy=0x7fdbc0149410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:00.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbbf7fe640 1 -- 172.21.15.28:0/1561003408 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc00b7d60 con 0x7fdbc00a2d60 2023-11-28T19:32:00.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbbf7fe640 1 --2- 172.21.15.28:0/1561003408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc00a2d60 0x7fdbc014c9a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdbc006d940 tx=0x7fdbb401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=395ab494fea13033 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:00.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbbeffd640 1 -- 172.21.15.28:0/1561003408 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40a89b0 con 0x7fdbc00a2d60 2023-11-28T19:32:00.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbbeffd640 1 -- 172.21.15.28:0/1561003408 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb40a8b10 con 0x7fdbc00a2d60 2023-11-28T19:32:00.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbbeffd640 1 -- 172.21.15.28:0/1561003408 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb40a8ea0 con 0x7fdbc00a2d60 2023-11-28T19:32:00.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbc667e640 1 -- 172.21.15.28:0/1561003408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc00a2d60 msgr2=0x7fdbc014c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbc667e640 1 --2- 172.21.15.28:0/1561003408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc00a2d60 0x7fdbc014c9a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fdbc006d940 tx=0x7fdbb401ecb0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbc667e640 1 -- 172.21.15.28:0/1561003408 shutdown_connections 2023-11-28T19:32:00.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbc667e640 1 --2- 172.21.15.28:0/1561003408 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc00a2d60 0x7fdbc014c9a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbc667e640 1 --2- 172.21.15.28:0/1561003408 >> v2:172.21.15.131:3300/0 conn(0x7fdbc00bc120 0x7fdbc00bd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbc667e640 1 -- 172.21.15.28:0/1561003408 >> 172.21.15.28:0/1561003408 conn(0x7fdbc006ab80 msgr2=0x7fdbc00bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:00.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbc667e640 1 -- 172.21.15.28:0/1561003408 shutdown_connections 2023-11-28T19:32:00.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.882+0000 7fdbc667e640 1 -- 172.21.15.28:0/1561003408 wait complete. 2023-11-28T19:32:00.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbc667e640 1 Processor -- start 2023-11-28T19:32:00.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbc667e640 1 -- start start 2023-11-28T19:32:00.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbc667e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc0072940 0x7fdbc0071140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbc667e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbc00a2d60 0x7fdbc0148850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbc667e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbc00bc120 0x7fdbc0149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbc667e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc01496f0 con 0x7fdbc0072940 2023-11-28T19:32:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbc667e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc01481b0 con 0x7fdbc00bc120 2023-11-28T19:32:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbc667e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc0147910 con 0x7fdbc00a2d60 2023-11-28T19:32:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbbffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc0072940 0x7fdbc0071140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbbffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc0072940 0x7fdbc0071140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60822/0 (socket says 172.21.15.28:60822) 2023-11-28T19:32:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbbffff640 1 -- 172.21.15.28:0/1584255310 learned_addr learned my addr 172.21.15.28:0/1584255310 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbbf7fe640 1 --2- 172.21.15.28:0/1584255310 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbc00a2d60 0x7fdbc0148850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbc4c1b640 1 --2- 172.21.15.28:0/1584255310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbc00bc120 0x7fdbc0149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbbffff640 1 -- 172.21.15.28:0/1584255310 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbc00a2d60 msgr2=0x7fdbc0148850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbbffff640 1 --2- 172.21.15.28:0/1584255310 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbc00a2d60 0x7fdbc0148850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbbffff640 1 -- 172.21.15.28:0/1584255310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbc00bc120 msgr2=0x7fdbc0149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbbffff640 1 --2- 172.21.15.28:0/1584255310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbc00bc120 0x7fdbc0149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbbffff640 1 -- 172.21.15.28:0/1584255310 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb40094d0 con 0x7fdbc0072940 2023-11-28T19:32:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbbffff640 1 --2- 172.21.15.28:0/1584255310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc0072940 0x7fdbc0071140 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000c7f0 tx=0x7fdbb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbbcff9640 1 -- 172.21.15.28:0/1584255310 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0007820 con 0x7fdbc0072940 2023-11-28T19:32:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbbcff9640 1 -- 172.21.15.28:0/1584255310 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb0007980 con 0x7fdbc0072940 2023-11-28T19:32:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbc667e640 1 -- 172.21.15.28:0/1584255310 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc0147bf0 con 0x7fdbc0072940 2023-11-28T19:32:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbbcff9640 1 -- 172.21.15.28:0/1584255310 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0007d30 con 0x7fdbc0072940 2023-11-28T19:32:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbc667e640 1 -- 172.21.15.28:0/1584255310 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc0147f80 con 0x7fdbc0072940 2023-11-28T19:32:00.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.886+0000 7fdbc667e640 1 -- 172.21.15.28:0/1584255310 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc0149b10 con 0x7fdbc0072940 2023-11-28T19:32:00.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.890+0000 7fdbbcff9640 1 -- 172.21.15.28:0/1584255310 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdbb00113f0 con 0x7fdbc0072940 2023-11-28T19:32:00.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.890+0000 7fdbbcff9640 1 --2- 172.21.15.28:0/1584255310 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdbac066470 0x7fdbac068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:00.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.890+0000 7fdbbcff9640 1 -- 172.21.15.28:0/1584255310 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbb00840e0 con 0x7fdbc0072940 2023-11-28T19:32:00.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.890+0000 7fdbbf7fe640 1 --2- 172.21.15.28:0/1584255310 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdbac066470 0x7fdbac068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:00.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.890+0000 7fdbbf7fe640 1 --2- 172.21.15.28:0/1584255310 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdbac066470 0x7fdbac068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40b2000 tx=0x7fdbb40aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:00.894 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:00.894+0000 7fdbbcff9640 1 -- 172.21.15.28:0/1584255310 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdbc0149b10 con 0x7fdbc0072940 2023-11-28T19:32:00.897 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:32:00.899 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:32:00.902 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:32:01.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.046+0000 7fdbc667e640 1 -- 172.21.15.28:0/1584255310 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdbc0149b10 con 0x7fdbc0072940 2023-11-28T19:32:01.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.046+0000 7fdbbcff9640 1 -- 172.21.15.28:0/1584255310 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdbc0149b10 con 0x7fdbc0072940 2023-11-28T19:32:01.049 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-28T19:32:01.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.050+0000 7fdbc667e640 1 -- 172.21.15.28:0/1584255310 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdbac066470 msgr2=0x7fdbac068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.050+0000 7fdbc667e640 1 --2- 172.21.15.28:0/1584255310 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdbac066470 0x7fdbac068930 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdbb40b2000 tx=0x7fdbb40aa070 comp rx=0 tx=0).stop 2023-11-28T19:32:01.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.050+0000 7fdbc667e640 1 -- 172.21.15.28:0/1584255310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc0072940 msgr2=0x7fdbc0071140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.050+0000 7fdbc667e640 1 --2- 172.21.15.28:0/1584255310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc0072940 0x7fdbc0071140 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdbb000c7f0 tx=0x7fdbb000ccb0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.050+0000 7fdbc667e640 1 -- 172.21.15.28:0/1584255310 shutdown_connections 2023-11-28T19:32:01.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.050+0000 7fdbc667e640 1 --2- 172.21.15.28:0/1584255310 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdbac066470 0x7fdbac068930 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.050+0000 7fdbc667e640 1 --2- 172.21.15.28:0/1584255310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdbc00bc120 0x7fdbc0149df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.050+0000 7fdbc667e640 1 --2- 172.21.15.28:0/1584255310 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdbc00a2d60 0x7fdbc0148850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.050+0000 7fdbc667e640 1 --2- 172.21.15.28:0/1584255310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdbc0072940 0x7fdbc0071140 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.050+0000 7fdbc667e640 1 -- 172.21.15.28:0/1584255310 >> 172.21.15.28:0/1584255310 conn(0x7fdbc006ab80 msgr2=0x7fdbc014c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:01.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.050+0000 7fdbc667e640 1 -- 172.21.15.28:0/1584255310 shutdown_connections 2023-11-28T19:32:01.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.050+0000 7fdbc667e640 1 -- 172.21.15.28:0/1584255310 wait complete. 2023-11-28T19:32:01.069 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:32:01.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.194+0000 7fdafb950640 1 Processor -- start 2023-11-28T19:32:01.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.194+0000 7fdafb950640 1 -- start start 2023-11-28T19:32:01.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.194+0000 7fdafb950640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdaf40b5ad0 0x7fdaf40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.194+0000 7fdafb950640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaf4150210 0x7fdaf4152600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.194+0000 7fdafb950640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf4145600 con 0x7fdaf4145220 2023-11-28T19:32:01.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.194+0000 7fdafb950640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdaf40b4d30 con 0x7fdaf40b5ad0 2023-11-28T19:32:01.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.194+0000 7fdafb950640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf40baee0 con 0x7fdaf4150210 2023-11-28T19:32:01.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdaf8eeb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdaf40b5ad0 0x7fdaf40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:01.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdaf8eeb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fdaf40b5ad0 0x7fdaf40b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60830/0 (socket says 172.21.15.28:60830) 2023-11-28T19:32:01.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdaf8eeb640 1 -- 172.21.15.28:0/707430850 learned_addr learned my addr 172.21.15.28:0/707430850 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:01.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdaf9eed640 1 --2- 172.21.15.28:0/707430850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaf4150210 0x7fdaf4152600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:01.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdaf8eeb640 1 -- 172.21.15.28:0/707430850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaf4150210 msgr2=0x7fdaf4152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:01.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdaf8eeb640 1 --2- 172.21.15.28:0/707430850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaf4150210 0x7fdaf4152600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdaf8eeb640 1 -- 172.21.15.28:0/707430850 >> v1:172.21.15.131:6789/0 conn(0x7fdaf4145220 legacy=0x7fdaf40ba7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.199 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdaf8eeb640 1 -- 172.21.15.28:0/707430850 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf40b9270 con 0x7fdaf40b5ad0 2023-11-28T19:32:01.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdaf8eeb640 1 --2- 172.21.15.28:0/707430850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaf40b5ad0 0x7fdaf40b5f40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009870 tx=0x7fdae401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dd183e7d5113fe5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:01.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdaebfff640 1 -- 172.21.15.28:0/707430850 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae40ab600 con 0x7fdaf40b5ad0 2023-11-28T19:32:01.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdaebfff640 1 -- 172.21.15.28:0/707430850 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae40ab760 con 0x7fdaf40b5ad0 2023-11-28T19:32:01.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdaebfff640 1 -- 172.21.15.28:0/707430850 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae40abaf0 con 0x7fdaf40b5ad0 2023-11-28T19:32:01.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdafb950640 1 -- 172.21.15.28:0/707430850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaf40b5ad0 msgr2=0x7fdaf40b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdafb950640 1 --2- 172.21.15.28:0/707430850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaf40b5ad0 0x7fdaf40b5f40 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdae4009870 tx=0x7fdae401c480 comp rx=0 tx=0).stop 2023-11-28T19:32:01.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdafb950640 1 -- 172.21.15.28:0/707430850 shutdown_connections 2023-11-28T19:32:01.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdafb950640 1 --2- 172.21.15.28:0/707430850 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaf4150210 0x7fdaf4152600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdafb950640 1 --2- 172.21.15.28:0/707430850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaf40b5ad0 0x7fdaf40b5f40 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdafb950640 1 -- 172.21.15.28:0/707430850 >> 172.21.15.28:0/707430850 conn(0x7fdaf406ab80 msgr2=0x7fdaf40bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:01.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdafb950640 1 -- 172.21.15.28:0/707430850 shutdown_connections 2023-11-28T19:32:01.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.198+0000 7fdafb950640 1 -- 172.21.15.28:0/707430850 wait complete. 2023-11-28T19:32:01.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdafb950640 1 Processor -- start 2023-11-28T19:32:01.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdafb950640 1 -- start start 2023-11-28T19:32:01.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdafb950640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf40b5ad0 0x7fdaf41462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdafb950640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaf4145220 0x7fdaf4070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdafb950640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaf4150210 0x7fdaf41399e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdafb950640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf414bd60 con 0x7fdaf4150210 2023-11-28T19:32:01.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdafb950640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf4071130 con 0x7fdaf40b5ad0 2023-11-28T19:32:01.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdafb950640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf4146980 con 0x7fdaf4145220 2023-11-28T19:32:01.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdaf9eed640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaf4150210 0x7fdaf41399e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:01.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdaf9eed640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaf4150210 0x7fdaf41399e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60836/0 (socket says 172.21.15.28:60836) 2023-11-28T19:32:01.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdaf9eed640 1 -- 172.21.15.28:0/3268657017 learned_addr learned my addr 172.21.15.28:0/3268657017 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:01.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdaf8eeb640 1 --2- 172.21.15.28:0/3268657017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaf4145220 0x7fdaf4070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:01.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdaf96ec640 1 --2- 172.21.15.28:0/3268657017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf40b5ad0 0x7fdaf41462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:01.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdaf9eed640 1 -- 172.21.15.28:0/3268657017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaf4145220 msgr2=0x7fdaf4070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdaf9eed640 1 --2- 172.21.15.28:0/3268657017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaf4145220 0x7fdaf4070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdaf9eed640 1 -- 172.21.15.28:0/3268657017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf40b5ad0 msgr2=0x7fdaf41462e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdaf9eed640 1 --2- 172.21.15.28:0/3268657017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf40b5ad0 0x7fdaf41462e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdaf9eed640 1 -- 172.21.15.28:0/3268657017 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae40094d0 con 0x7fdaf4150210 2023-11-28T19:32:01.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdaf9eed640 1 --2- 172.21.15.28:0/3268657017 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaf4150210 0x7fdaf41399e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdaec007e60 tx=0x7fdaec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:01.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdae9ffb640 1 -- 172.21.15.28:0/3268657017 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec013470 con 0x7fdaf4150210 2023-11-28T19:32:01.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdae9ffb640 1 -- 172.21.15.28:0/3268657017 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec0135f0 con 0x7fdaf4150210 2023-11-28T19:32:01.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdafb950640 1 -- 172.21.15.28:0/3268657017 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf40715d0 con 0x7fdaf4150210 2023-11-28T19:32:01.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdae9ffb640 1 -- 172.21.15.28:0/3268657017 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec0139a0 con 0x7fdaf4150210 2023-11-28T19:32:01.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdafb950640 1 -- 172.21.15.28:0/3268657017 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf414b9f0 con 0x7fdaf4150210 2023-11-28T19:32:01.207 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdafb950640 1 -- 172.21.15.28:0/3268657017 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf40b6e20 con 0x7fdaf4150210 2023-11-28T19:32:01.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdae9ffb640 1 -- 172.21.15.28:0/3268657017 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdaec013b00 con 0x7fdaf4150210 2023-11-28T19:32:01.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdae9ffb640 1 --2- 172.21.15.28:0/3268657017 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdad8066470 0x7fdad8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.202+0000 7fdae9ffb640 1 -- 172.21.15.28:0/3268657017 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdaec086550 con 0x7fdaf4150210 2023-11-28T19:32:01.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.206+0000 7fdaf96ec640 1 --2- 172.21.15.28:0/3268657017 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdad8066470 0x7fdad8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:01.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.206+0000 7fdaf96ec640 1 --2- 172.21.15.28:0/3268657017 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdad8066470 0x7fdad8068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0000f70 tx=0x7fdaf0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:01.209 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.206+0000 7fdae9ffb640 1 -- 172.21.15.28:0/3268657017 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdaec053a60 con 0x7fdaf4150210 2023-11-28T19:32:01.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.362+0000 7fdafb950640 1 -- 172.21.15.28:0/3268657017 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdaf4074a90 con 0x7fdaf4150210 2023-11-28T19:32:01.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.362+0000 7fdae9ffb640 1 -- 172.21.15.28:0/3268657017 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdaec057080 con 0x7fdaf4150210 2023-11-28T19:32:01.363 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-28T19:32:01.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.362+0000 7fdafb950640 1 -- 172.21.15.28:0/3268657017 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdad8066470 msgr2=0x7fdad8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.362+0000 7fdafb950640 1 --2- 172.21.15.28:0/3268657017 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdad8066470 0x7fdad8068930 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdaf0000f70 tx=0x7fdaf0009040 comp rx=0 tx=0).stop 2023-11-28T19:32:01.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.362+0000 7fdafb950640 1 -- 172.21.15.28:0/3268657017 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaf4150210 msgr2=0x7fdaf41399e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.362+0000 7fdafb950640 1 --2- 172.21.15.28:0/3268657017 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaf4150210 0x7fdaf41399e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdaec007e60 tx=0x7fdaec00e4b0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.362+0000 7fdafb950640 1 -- 172.21.15.28:0/3268657017 shutdown_connections 2023-11-28T19:32:01.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.362+0000 7fdafb950640 1 --2- 172.21.15.28:0/3268657017 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdad8066470 0x7fdad8068930 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.365 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.362+0000 7fdafb950640 1 --2- 172.21.15.28:0/3268657017 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdaf4150210 0x7fdaf41399e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.362+0000 7fdafb950640 1 --2- 172.21.15.28:0/3268657017 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdaf4145220 0x7fdaf4070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.362+0000 7fdafb950640 1 --2- 172.21.15.28:0/3268657017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdaf40b5ad0 0x7fdaf41462e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.362+0000 7fdafb950640 1 -- 172.21.15.28:0/3268657017 >> 172.21.15.28:0/3268657017 conn(0x7fdaf406ab80 msgr2=0x7fdaf40b2130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:01.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.362+0000 7fdafb950640 1 -- 172.21.15.28:0/3268657017 shutdown_connections 2023-11-28T19:32:01.366 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.362+0000 7fdafb950640 1 -- 172.21.15.28:0/3268657017 wait complete. 2023-11-28T19:32:01.381 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:32:01.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.502+0000 7f4cfe610640 1 Processor -- start 2023-11-28T19:32:01.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.502+0000 7f4cfe610640 1 -- start start 2023-11-28T19:32:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.502+0000 7f4cfe610640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4cf8142560 0x7f4cf80b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.502+0000 7f4cfe610640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4cf80b5dd0 0x7f4cf80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.502+0000 7f4cfe610640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf8142940 con 0x7f4cf80b6470 2023-11-28T19:32:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.502+0000 7f4cfe610640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf806f950 con 0x7f4cf8142560 2023-11-28T19:32:01.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.502+0000 7f4cfe610640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf814bb40 con 0x7f4cf80b5dd0 2023-11-28T19:32:01.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.502+0000 7f4cf7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4cf8142560 0x7f4cf80b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:01.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.502+0000 7f4cf7fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4cf8142560 0x7f4cf80b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60846/0 (socket says 172.21.15.28:60846) 2023-11-28T19:32:01.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.502+0000 7f4cf7fff640 1 -- 172.21.15.28:0/3135301801 learned_addr learned my addr 172.21.15.28:0/3135301801 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:01.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.502+0000 7f4cf7fff640 1 -- 172.21.15.28:0/3135301801 >> v2:172.21.15.131:3300/0 conn(0x7f4cf80b5dd0 msgr2=0x7f4cf80b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:01.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.502+0000 7f4cf7fff640 1 --2- 172.21.15.28:0/3135301801 >> v2:172.21.15.131:3300/0 conn(0x7f4cf80b5dd0 0x7f4cf80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.502+0000 7f4cf7fff640 1 -- 172.21.15.28:0/3135301801 >> v1:172.21.15.131:6789/0 conn(0x7f4cf80b6470 legacy=0x7f4cf80b68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:01.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.502+0000 7f4cf7fff640 1 -- 172.21.15.28:0/3135301801 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf814be20 con 0x7f4cf8142560 2023-11-28T19:32:01.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cf7fff640 1 --2- 172.21.15.28:0/3135301801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cf8142560 0x7f4cf80b40d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4cf806ce00 tx=0x7f4cec021380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc86dd414237ec21 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:01.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cf6ffd640 1 -- 172.21.15.28:0/3135301801 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec0b1600 con 0x7f4cf8142560 2023-11-28T19:32:01.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cf6ffd640 1 -- 172.21.15.28:0/3135301801 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec0ad050 con 0x7f4cf8142560 2023-11-28T19:32:01.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cf6ffd640 1 -- 172.21.15.28:0/3135301801 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec0b1980 con 0x7f4cf8142560 2023-11-28T19:32:01.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 -- 172.21.15.28:0/3135301801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cf8142560 msgr2=0x7f4cf80b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 --2- 172.21.15.28:0/3135301801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cf8142560 0x7f4cf80b40d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4cf806ce00 tx=0x7f4cec021380 comp rx=0 tx=0).stop 2023-11-28T19:32:01.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 -- 172.21.15.28:0/3135301801 shutdown_connections 2023-11-28T19:32:01.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 --2- 172.21.15.28:0/3135301801 >> v2:172.21.15.131:3300/0 conn(0x7f4cf80b5dd0 0x7f4cf80b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 --2- 172.21.15.28:0/3135301801 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cf8142560 0x7f4cf80b40d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 -- 172.21.15.28:0/3135301801 >> 172.21.15.28:0/3135301801 conn(0x7f4cf80bcb40 msgr2=0x7f4cf80bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:01.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 -- 172.21.15.28:0/3135301801 shutdown_connections 2023-11-28T19:32:01.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 -- 172.21.15.28:0/3135301801 wait complete. 2023-11-28T19:32:01.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 Processor -- start 2023-11-28T19:32:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 -- start start 2023-11-28T19:32:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cf80b5dd0 0x7f4cf81417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4cf80b6470 0x7f4cf8140a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4cf8142560 0x7f4cf8071010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf8141cf0 con 0x7f4cf80b5dd0 2023-11-28T19:32:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf81405a0 con 0x7f4cf8142560 2023-11-28T19:32:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cfe610640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf8072500 con 0x7f4cf80b6470 2023-11-28T19:32:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cf7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cf80b5dd0 0x7f4cf81417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cf7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cf80b5dd0 0x7f4cf81417b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60860/0 (socket says 172.21.15.28:60860) 2023-11-28T19:32:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cf7fff640 1 -- 172.21.15.28:0/406289132 learned_addr learned my addr 172.21.15.28:0/406289132 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:01.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cf7fff640 1 -- 172.21.15.28:0/406289132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4cf80b6470 msgr2=0x7f4cf8140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cf7fff640 1 --2- 172.21.15.28:0/406289132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4cf80b6470 0x7f4cf8140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cf7fff640 1 -- 172.21.15.28:0/406289132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4cf8142560 msgr2=0x7f4cf8071010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cf7fff640 1 --2- 172.21.15.28:0/406289132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4cf8142560 0x7f4cf8071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.506+0000 7f4cf7fff640 1 -- 172.21.15.28:0/406289132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cec00b770 con 0x7f4cf80b5dd0 2023-11-28T19:32:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.510+0000 7f4cf7fff640 1 --2- 172.21.15.28:0/406289132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cf80b5dd0 0x7f4cf81417b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00b2c0 tx=0x7f4cec01e120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.510+0000 7f4cf4ff9640 1 -- 172.21.15.28:0/406289132 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec006ee0 con 0x7f4cf80b5dd0 2023-11-28T19:32:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.510+0000 7f4cf4ff9640 1 -- 172.21.15.28:0/406289132 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec0bc680 con 0x7f4cf80b5dd0 2023-11-28T19:32:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.510+0000 7f4cfe610640 1 -- 172.21.15.28:0/406289132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf813ff50 con 0x7f4cf80b5dd0 2023-11-28T19:32:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.510+0000 7f4cf4ff9640 1 -- 172.21.15.28:0/406289132 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec0bca30 con 0x7f4cf80b5dd0 2023-11-28T19:32:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.510+0000 7f4cfe610640 1 -- 172.21.15.28:0/406289132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf8137a60 con 0x7f4cf80b5dd0 2023-11-28T19:32:01.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.510+0000 7f4cfe610640 1 -- 172.21.15.28:0/406289132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf8074a90 con 0x7f4cf80b5dd0 2023-11-28T19:32:01.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.510+0000 7f4cf4ff9640 1 -- 172.21.15.28:0/406289132 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4cec0b8040 con 0x7f4cf80b5dd0 2023-11-28T19:32:01.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.510+0000 7f4cf4ff9640 1 --2- 172.21.15.28:0/406289132 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4ce4066470 0x7f4ce4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.510+0000 7f4cf4ff9640 1 -- 172.21.15.28:0/406289132 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cec124a10 con 0x7f4cf80b5dd0 2023-11-28T19:32:01.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.510+0000 7f4cf77fe640 1 --2- 172.21.15.28:0/406289132 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4ce4066470 0x7f4ce4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:01.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.510+0000 7f4cf77fe640 1 --2- 172.21.15.28:0/406289132 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4ce4066470 0x7f4ce4068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8072d70 tx=0x7f4ce8009250 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:01.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.514+0000 7f4cf4ff9640 1 -- 172.21.15.28:0/406289132 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4cec0f1e80 con 0x7f4cf80b5dd0 2023-11-28T19:32:01.672 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.670+0000 7f4cfe610640 1 -- 172.21.15.28:0/406289132 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4cf80b9220 con 0x7f4cf80b5dd0 2023-11-28T19:32:01.673 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.674+0000 7f4cf4ff9640 1 -- 172.21.15.28:0/406289132 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f4cec0cc090 con 0x7f4cf80b5dd0 2023-11-28T19:32:01.674 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:01.674 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:32:01.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.674+0000 7f4cfe610640 1 -- 172.21.15.28:0/406289132 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4ce4066470 msgr2=0x7f4ce4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.674+0000 7f4cfe610640 1 --2- 172.21.15.28:0/406289132 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4ce4066470 0x7f4ce4068930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4cf8072d70 tx=0x7f4ce8009250 comp rx=0 tx=0).stop 2023-11-28T19:32:01.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.674+0000 7f4cfe610640 1 -- 172.21.15.28:0/406289132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cf80b5dd0 msgr2=0x7f4cf81417b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.674+0000 7f4cfe610640 1 --2- 172.21.15.28:0/406289132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cf80b5dd0 0x7f4cf81417b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00b2c0 tx=0x7f4cec01e120 comp rx=0 tx=0).stop 2023-11-28T19:32:01.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.674+0000 7f4cfe610640 1 -- 172.21.15.28:0/406289132 shutdown_connections 2023-11-28T19:32:01.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.674+0000 7f4cfe610640 1 --2- 172.21.15.28:0/406289132 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4ce4066470 0x7f4ce4068930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.674+0000 7f4cfe610640 1 --2- 172.21.15.28:0/406289132 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4cf8142560 0x7f4cf8071010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.674+0000 7f4cfe610640 1 --2- 172.21.15.28:0/406289132 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4cf80b6470 0x7f4cf8140a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.674+0000 7f4cfe610640 1 --2- 172.21.15.28:0/406289132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4cf80b5dd0 0x7f4cf81417b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.674+0000 7f4cfe610640 1 -- 172.21.15.28:0/406289132 >> 172.21.15.28:0/406289132 conn(0x7f4cf80bcb40 msgr2=0x7f4cf80b4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:01.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.674+0000 7f4cfe610640 1 -- 172.21.15.28:0/406289132 shutdown_connections 2023-11-28T19:32:01.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.674+0000 7f4cfe610640 1 -- 172.21.15.28:0/406289132 wait complete. 2023-11-28T19:32:01.693 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:31:33.212362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:31:42.810956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:31:43.579438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T19:32:01.694 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:32:01.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.818+0000 7f993daf8640 1 Processor -- start 2023-11-28T19:32:01.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.818+0000 7f993daf8640 1 -- start start 2023-11-28T19:32:01.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.818+0000 7f993daf8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f993814b5a0 0x7f99380b7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.818+0000 7f993daf8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99380bd7f0 con 0x7f99380b6970 2023-11-28T19:32:01.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.818+0000 7f993daf8640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99380b8d20 con 0x7f99380728a0 2023-11-28T19:32:01.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.818+0000 7f993daf8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99380b92e0 con 0x7f993814b5a0 2023-11-28T19:32:01.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.818+0000 7f9936ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f993814b5a0 0x7f99380b7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:01.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.818+0000 7f99377fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f99380b6970 0x7f99380bd0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42450/0 (socket says 172.21.15.28:42450) 2023-11-28T19:32:01.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.818+0000 7f99377fe640 1 -- 172.21.15.28:0/1085912218 learned_addr learned my addr 172.21.15.28:0/1085912218 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:01.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.818+0000 7f9936ffd640 1 -- 172.21.15.28:0/1085912218 >> v1:172.21.15.131:6789/0 conn(0x7f99380728a0 legacy=0x7f9938155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:01.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.818+0000 7f9936ffd640 1 -- 172.21.15.28:0/1085912218 >> v1:172.21.15.28:6789/0 conn(0x7f99380b6970 legacy=0x7f99380bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.818+0000 7f9936ffd640 1 -- 172.21.15.28:0/1085912218 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99380b9000 con 0x7f993814b5a0 2023-11-28T19:32:01.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f9936ffd640 1 --2- 172.21.15.28:0/1085912218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f993814b5a0 0x7f99380b7a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f992c0097c0 tx=0x7f992c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3979553033ab2fc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:01.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f99367fc640 1 -- 172.21.15.28:0/1085912218 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c0ab600 con 0x7f993814b5a0 2023-11-28T19:32:01.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f99367fc640 1 -- 172.21.15.28:0/1085912218 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c0a7050 con 0x7f993814b5a0 2023-11-28T19:32:01.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f99367fc640 1 -- 172.21.15.28:0/1085912218 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c0ab980 con 0x7f993814b5a0 2023-11-28T19:32:01.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 -- 172.21.15.28:0/1085912218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f993814b5a0 msgr2=0x7f99380b7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 --2- 172.21.15.28:0/1085912218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f993814b5a0 0x7f99380b7a20 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f992c0097c0 tx=0x7f992c01c440 comp rx=0 tx=0).stop 2023-11-28T19:32:01.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 -- 172.21.15.28:0/1085912218 shutdown_connections 2023-11-28T19:32:01.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 --2- 172.21.15.28:0/1085912218 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f993814b5a0 0x7f99380b7a20 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 -- 172.21.15.28:0/1085912218 >> 172.21.15.28:0/1085912218 conn(0x7f993806ab80 msgr2=0x7f99380bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:01.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 -- 172.21.15.28:0/1085912218 shutdown_connections 2023-11-28T19:32:01.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 -- 172.21.15.28:0/1085912218 wait complete. 2023-11-28T19:32:01.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 Processor -- start 2023-11-28T19:32:01.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 -- start start 2023-11-28T19:32:01.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99380728a0 0x7f993806f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99380b6970 0x7f99380b3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f993814b5a0 0x7f9938070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99380b3c50 con 0x7f99380b6970 2023-11-28T19:32:01.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9938071d70 con 0x7f99380728a0 2023-11-28T19:32:01.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99381e7490 con 0x7f993814b5a0 2023-11-28T19:32:01.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f9936ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99380b6970 0x7f99380b3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:01.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f9936ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99380b6970 0x7f99380b3710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60868/0 (socket says 172.21.15.28:60868) 2023-11-28T19:32:01.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f9936ffd640 1 -- 172.21.15.28:0/3820241662 learned_addr learned my addr 172.21.15.28:0/3820241662 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:01.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f99377fe640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99380728a0 0x7f993806f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:01.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f9937fff640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f993814b5a0 0x7f9938070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:01.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f9936ffd640 1 -- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f993814b5a0 msgr2=0x7f9938070740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f9936ffd640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f993814b5a0 0x7f9938070740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f9936ffd640 1 -- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99380728a0 msgr2=0x7f993806f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f9936ffd640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99380728a0 0x7f993806f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f9936ffd640 1 -- 172.21.15.28:0/3820241662 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f992c009420 con 0x7f99380b6970 2023-11-28T19:32:01.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f99377fe640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99380728a0 0x7f993806f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:01.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f9936ffd640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99380b6970 0x7f99380b3710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f992c0097c0 tx=0x7f992c0191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:01.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f991ffff640 1 -- 172.21.15.28:0/3820241662 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c0b4840 con 0x7f99380b6970 2023-11-28T19:32:01.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f991ffff640 1 -- 172.21.15.28:0/3820241662 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f992c0b49c0 con 0x7f99380b6970 2023-11-28T19:32:01.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 -- 172.21.15.28:0/3820241662 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f993806f7c0 con 0x7f99380b6970 2023-11-28T19:32:01.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f991ffff640 1 -- 172.21.15.28:0/3820241662 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f992c0b4d70 con 0x7f99380b6970 2023-11-28T19:32:01.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.822+0000 7f993daf8640 1 -- 172.21.15.28:0/3820241662 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9938070220 con 0x7f99380b6970 2023-11-28T19:32:01.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.826+0000 7f993daf8640 1 -- 172.21.15.28:0/3820241662 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f993806fce0 con 0x7f99380b6970 2023-11-28T19:32:01.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.826+0000 7f991ffff640 1 -- 172.21.15.28:0/3820241662 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f992c0b2040 con 0x7f99380b6970 2023-11-28T19:32:01.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.826+0000 7f991ffff640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f99240664a0 0x7f9924068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:01.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.826+0000 7f991ffff640 1 -- 172.21.15.28:0/3820241662 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f992c11e1e0 con 0x7f99380b6970 2023-11-28T19:32:01.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.826+0000 7f99377fe640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f99240664a0 0x7f9924068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:01.829 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.826+0000 7f99377fe640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f99240664a0 0x7f9924068960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9928005890 tx=0x7f9928009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:01.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.830+0000 7f991ffff640 1 -- 172.21.15.28:0/3820241662 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f992c0eb6f0 con 0x7f99380b6970 2023-11-28T19:32:01.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.978+0000 7f993daf8640 1 -- 172.21.15.28:0/3820241662 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9938070410 con 0x7f99380b6970 2023-11-28T19:32:01.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.982+0000 7f991ffff640 1 -- 172.21.15.28:0/3820241662 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f992c0eed10 con 0x7f99380b6970 2023-11-28T19:32:01.982 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-28T19:32:01.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.982+0000 7f993daf8640 1 -- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f99240664a0 msgr2=0x7f9924068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.982+0000 7f993daf8640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f99240664a0 0x7f9924068960 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9928005890 tx=0x7f9928009040 comp rx=0 tx=0).stop 2023-11-28T19:32:01.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.982+0000 7f993daf8640 1 -- 172.21.15.28:0/3820241662 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99380b6970 msgr2=0x7f99380b3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:01.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.982+0000 7f993daf8640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99380b6970 0x7f99380b3710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f992c0097c0 tx=0x7f992c0191e0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.982+0000 7f993daf8640 1 -- 172.21.15.28:0/3820241662 shutdown_connections 2023-11-28T19:32:01.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.982+0000 7f993daf8640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f99240664a0 0x7f9924068960 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.984 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.982+0000 7f993daf8640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f993814b5a0 0x7f9938070740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.982+0000 7f993daf8640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f99380b6970 0x7f99380b3710 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.982+0000 7f993daf8640 1 --2- 172.21.15.28:0/3820241662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f99380728a0 0x7f993806f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:01.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.982+0000 7f993daf8640 1 -- 172.21.15.28:0/3820241662 >> 172.21.15.28:0/3820241662 conn(0x7f993806ab80 msgr2=0x7f9938149430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:01.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.982+0000 7f993daf8640 1 -- 172.21.15.28:0/3820241662 shutdown_connections 2023-11-28T19:32:01.985 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:01.982+0000 7f993daf8640 1 -- 172.21.15.28:0/3820241662 wait complete. 2023-11-28T19:32:01.999 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:32:02.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f68963b6640 1 Processor -- start 2023-11-28T19:32:02.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f68963b6640 1 -- start start 2023-11-28T19:32:02.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f68963b6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f68900a2d60 0x7f689014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f68963b6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6890072940 0x7f689014cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f68963b6640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6890143b60 con 0x7f68900bc120 2023-11-28T19:32:02.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f68963b6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68900b6f30 con 0x7f68900a2d60 2023-11-28T19:32:02.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f68963b6640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68900bd7f0 con 0x7f6890072940 2023-11-28T19:32:02.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f688f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f68900a2d60 0x7f689014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f688f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f68900a2d60 0x7f689014c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60880/0 (socket says 172.21.15.28:60880) 2023-11-28T19:32:02.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f688f7fe640 1 -- 172.21.15.28:0/2211261958 learned_addr learned my addr 172.21.15.28:0/2211261958 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:02.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f6894953640 1 --2- 172.21.15.28:0/2211261958 >> v2:172.21.15.131:3300/0 conn(0x7f6890072940 0x7f689014cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f688f7fe640 1 -- 172.21.15.28:0/2211261958 >> v2:172.21.15.131:3300/0 conn(0x7f6890072940 msgr2=0x7f689014cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:02.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f688f7fe640 1 --2- 172.21.15.28:0/2211261958 >> v2:172.21.15.131:3300/0 conn(0x7f6890072940 0x7f689014cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f688f7fe640 1 -- 172.21.15.28:0/2211261958 >> v1:172.21.15.131:6789/0 conn(0x7f68900bc120 legacy=0x7f68900bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:02.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f688f7fe640 1 -- 172.21.15.28:0/2211261958 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68900b7aa0 con 0x7f68900a2d60 2023-11-28T19:32:02.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.126+0000 7f6894953640 1 --2- 172.21.15.28:0/2211261958 >> v2:172.21.15.131:3300/0 conn(0x7f6890072940 0x7f689014cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:02.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688f7fe640 1 --2- 172.21.15.28:0/2211261958 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f68900a2d60 0x7f689014c9a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f68900b6460 tx=0x7f688401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=173169f67d821e32 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:02.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688effd640 1 -- 172.21.15.28:0/2211261958 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840a89b0 con 0x7f68900a2d60 2023-11-28T19:32:02.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688effd640 1 -- 172.21.15.28:0/2211261958 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68840a8b10 con 0x7f68900a2d60 2023-11-28T19:32:02.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688effd640 1 -- 172.21.15.28:0/2211261958 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840a8ea0 con 0x7f68900a2d60 2023-11-28T19:32:02.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 -- 172.21.15.28:0/2211261958 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f68900a2d60 msgr2=0x7f689014c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 --2- 172.21.15.28:0/2211261958 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f68900a2d60 0x7f689014c9a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f68900b6460 tx=0x7f688401ecb0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 -- 172.21.15.28:0/2211261958 shutdown_connections 2023-11-28T19:32:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 --2- 172.21.15.28:0/2211261958 >> v2:172.21.15.131:3300/0 conn(0x7f6890072940 0x7f689014cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 --2- 172.21.15.28:0/2211261958 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f68900a2d60 0x7f689014c9a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 -- 172.21.15.28:0/2211261958 >> 172.21.15.28:0/2211261958 conn(0x7f689006ab80 msgr2=0x7f68900bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:02.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 -- 172.21.15.28:0/2211261958 shutdown_connections 2023-11-28T19:32:02.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 -- 172.21.15.28:0/2211261958 wait complete. 2023-11-28T19:32:02.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 Processor -- start 2023-11-28T19:32:02.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 -- start start 2023-11-28T19:32:02.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6890072940 0x7f68901468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f68900a2d60 0x7f68901e2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68900bc120 0x7f68901e2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6890146df0 con 0x7f6890072940 2023-11-28T19:32:02.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6890144f00 con 0x7f68900bc120 2023-11-28T19:32:02.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6890146130 con 0x7f68900a2d60 2023-11-28T19:32:02.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6890072940 0x7f68901468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6890072940 0x7f68901468b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60892/0 (socket says 172.21.15.28:60892) 2023-11-28T19:32:02.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688ffff640 1 -- 172.21.15.28:0/1928719917 learned_addr learned my addr 172.21.15.28:0/1928719917 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:02.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688ffff640 1 -- 172.21.15.28:0/1928719917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f68900a2d60 msgr2=0x7f68901e2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688f7fe640 1 --2- 172.21.15.28:0/1928719917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f68900a2d60 0x7f68901e2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f6894953640 1 --2- 172.21.15.28:0/1928719917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68900bc120 0x7f68901e2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688ffff640 1 --2- 172.21.15.28:0/1928719917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f68900a2d60 0x7f68901e2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688ffff640 1 -- 172.21.15.28:0/1928719917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68900bc120 msgr2=0x7f68901e2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688ffff640 1 --2- 172.21.15.28:0/1928719917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68900bc120 0x7f68901e2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688ffff640 1 -- 172.21.15.28:0/1928719917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68840094d0 con 0x7f6890072940 2023-11-28T19:32:02.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688ffff640 1 --2- 172.21.15.28:0/1928719917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6890072940 0x7f68901468b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f688000b410 tx=0x7f688000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:02.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688cff9640 1 -- 172.21.15.28:0/1928719917 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880004020 con 0x7f6890072940 2023-11-28T19:32:02.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688cff9640 1 -- 172.21.15.28:0/1928719917 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6880004180 con 0x7f6890072940 2023-11-28T19:32:02.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 -- 172.21.15.28:0/1928719917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68901445d0 con 0x7f6890072940 2023-11-28T19:32:02.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f688cff9640 1 -- 172.21.15.28:0/1928719917 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6880011630 con 0x7f6890072940 2023-11-28T19:32:02.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.130+0000 7f68963b6640 1 -- 172.21.15.28:0/1928719917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6890144b90 con 0x7f6890072940 2023-11-28T19:32:02.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.134+0000 7f68963b6640 1 -- 172.21.15.28:0/1928719917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6890074a90 con 0x7f6890072940 2023-11-28T19:32:02.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.134+0000 7f688cff9640 1 -- 172.21.15.28:0/1928719917 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6880011790 con 0x7f6890072940 2023-11-28T19:32:02.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.134+0000 7f688cff9640 1 --2- 172.21.15.28:0/1928719917 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f687c066470 0x7f687c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.134+0000 7f688cff9640 1 -- 172.21.15.28:0/1928719917 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6880083bb0 con 0x7f6890072940 2023-11-28T19:32:02.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.134+0000 7f688f7fe640 1 --2- 172.21.15.28:0/1928719917 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f687c066470 0x7f687c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.134+0000 7f688f7fe640 1 --2- 172.21.15.28:0/1928719917 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f687c066470 0x7f687c068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f68840b2000 tx=0x7f68840aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:02.141 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.138+0000 7f688cff9640 1 -- 172.21.15.28:0/1928719917 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f68800510c0 con 0x7f6890072940 2023-11-28T19:32:02.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.290+0000 7f68963b6640 1 -- 172.21.15.28:0/1928719917 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68901429a0 con 0x7f6890072940 2023-11-28T19:32:02.292 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.290+0000 7f688cff9640 1 -- 172.21.15.28:0/1928719917 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f68800546e0 con 0x7f6890072940 2023-11-28T19:32:02.292 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-28T19:32:02.294 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.294+0000 7f68963b6640 1 -- 172.21.15.28:0/1928719917 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f687c066470 msgr2=0x7f687c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.295 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.294+0000 7f68963b6640 1 --2- 172.21.15.28:0/1928719917 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f687c066470 0x7f687c068930 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f68840b2000 tx=0x7f68840aa070 comp rx=0 tx=0).stop 2023-11-28T19:32:02.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.294+0000 7f68963b6640 1 -- 172.21.15.28:0/1928719917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6890072940 msgr2=0x7f68901468b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.294+0000 7f68963b6640 1 --2- 172.21.15.28:0/1928719917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6890072940 0x7f68901468b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f688000b410 tx=0x7f688000b8d0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.294+0000 7f68963b6640 1 -- 172.21.15.28:0/1928719917 shutdown_connections 2023-11-28T19:32:02.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.294+0000 7f68963b6640 1 --2- 172.21.15.28:0/1928719917 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f687c066470 0x7f687c068930 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.297 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.294+0000 7f68963b6640 1 --2- 172.21.15.28:0/1928719917 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68900bc120 0x7f68901e2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.294+0000 7f68963b6640 1 --2- 172.21.15.28:0/1928719917 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f68900a2d60 0x7f68901e2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.294+0000 7f68963b6640 1 --2- 172.21.15.28:0/1928719917 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6890072940 0x7f68901468b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.294+0000 7f68963b6640 1 -- 172.21.15.28:0/1928719917 >> 172.21.15.28:0/1928719917 conn(0x7f689006ab80 msgr2=0x7f689006f510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:02.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.294+0000 7f68963b6640 1 -- 172.21.15.28:0/1928719917 shutdown_connections 2023-11-28T19:32:02.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.294+0000 7f68963b6640 1 -- 172.21.15.28:0/1928719917 wait complete. 2023-11-28T19:32:02.310 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:32:02.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.422+0000 7f21aab73640 1 Processor -- start 2023-11-28T19:32:02.425 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.422+0000 7f21aab73640 1 -- start start 2023-11-28T19:32:02.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21aab73640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a406ab60 0x7f21a414b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21aab73640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f21a406af40 0x7f21a4155e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21aab73640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21a40bce60 con 0x7f21a40bbad0 2023-11-28T19:32:02.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21aab73640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21a40bd5d0 con 0x7f21a406af40 2023-11-28T19:32:02.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21aab73640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40a6b70 con 0x7f21a406ab60 2023-11-28T19:32:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a3fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f21a40bbad0 0x7f21a40a6040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42454/0 (socket says 172.21.15.28:42454) 2023-11-28T19:32:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a3fff640 1 -- 172.21.15.28:0/431120044 learned_addr learned my addr 172.21.15.28:0/431120044 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a9110640 1 --2- 172.21.15.28:0/431120044 >> v2:172.21.15.131:3300/0 conn(0x7f21a406af40 0x7f21a4155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a890f640 1 --2- 172.21.15.28:0/431120044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a406ab60 0x7f21a414b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 -- 172.21.15.28:0/431120044 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2140742394 0 0) 0x7f21a40bce60 con 0x7f21a40bbad0 2023-11-28T19:32:02.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 -- 172.21.15.28:0/431120044 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f218c003530 con 0x7f21a40bbad0 2023-11-28T19:32:02.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 -- 172.21.15.28:0/431120044 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4128660051 0 0) 0x7f218c003530 con 0x7f21a40bbad0 2023-11-28T19:32:02.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 -- 172.21.15.28:0/431120044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a406ab60 msgr2=0x7f21a414b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:02.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 --2- 172.21.15.28:0/431120044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a406ab60 0x7f21a414b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 -- 172.21.15.28:0/431120044 >> v2:172.21.15.131:3300/0 conn(0x7f21a406af40 msgr2=0x7f21a4155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:02.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 --2- 172.21.15.28:0/431120044 >> v2:172.21.15.131:3300/0 conn(0x7f21a406af40 0x7f21a4155e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 -- 172.21.15.28:0/431120044 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a40bff70 con 0x7f21a40bbad0 2023-11-28T19:32:02.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 -- 172.21.15.28:0/431120044 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f2194001680 con 0x7f21a40bbad0 2023-11-28T19:32:02.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 -- 172.21.15.28:0/431120044 >> v1:172.21.15.28:6789/0 conn(0x7f21a40bbad0 legacy=0x7f21a40a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 --2- 172.21.15.28:0/431120044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c003980 0x7f218c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 --2- 172.21.15.28:0/431120044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f218c0047d0 0x7f218c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 --2- 172.21.15.28:0/431120044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a406ab60 0x7f218c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 -- 172.21.15.28:0/431120044 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40bd5d0 con 0x7f218c0047d0 2023-11-28T19:32:02.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 -- 172.21.15.28:0/431120044 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40a6b70 con 0x7f218c003980 2023-11-28T19:32:02.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 -- 172.21.15.28:0/431120044 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f218c00b990 con 0x7f21a406ab60 2023-11-28T19:32:02.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a3fff640 1 --2- 172.21.15.28:0/431120044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f218c0047d0 0x7f218c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a9110640 1 --2- 172.21.15.28:0/431120044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a406ab60 0x7f218c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a3fff640 1 -- 172.21.15.28:0/431120044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a406ab60 msgr2=0x7f218c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:02.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a890f640 1 --2- 172.21.15.28:0/431120044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c003980 0x7f218c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a3fff640 1 --2- 172.21.15.28:0/431120044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a406ab60 0x7f218c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a3fff640 1 -- 172.21.15.28:0/431120044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c003980 msgr2=0x7f218c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:02.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a3fff640 1 --2- 172.21.15.28:0/431120044 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c003980 0x7f218c003da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a3fff640 1 -- 172.21.15.28:0/431120044 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f218c003530 con 0x7f218c0047d0 2023-11-28T19:32:02.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a9110640 1 --2- 172.21.15.28:0/431120044 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a406ab60 0x7f218c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:02.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a3fff640 1 --2- 172.21.15.28:0/431120044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f218c0047d0 0x7f218c004c50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f219400c210 tx=0x7f219401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab4000f7411a8ad server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:02.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 -- 172.21.15.28:0/431120044 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21940a8ce0 con 0x7f218c0047d0 2023-11-28T19:32:02.435 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 -- 172.21.15.28:0/431120044 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21940a8e40 con 0x7f218c0047d0 2023-11-28T19:32:02.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.426+0000 7f21a37fe640 1 -- 172.21.15.28:0/431120044 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194005b00 con 0x7f218c0047d0 2023-11-28T19:32:02.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 -- 172.21.15.28:0/431120044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f218c0047d0 msgr2=0x7f218c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 --2- 172.21.15.28:0/431120044 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f218c0047d0 0x7f218c004c50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f219400c210 tx=0x7f219401f3b0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a9110640 1 -- 172.21.15.28:0/431120044 reap_dead start 2023-11-28T19:32:02.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 -- 172.21.15.28:0/431120044 shutdown_connections 2023-11-28T19:32:02.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 -- 172.21.15.28:0/431120044 >> 172.21.15.28:0/431120044 conn(0x7f21a40c0c90 msgr2=0x7f21a40c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:02.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 -- 172.21.15.28:0/431120044 shutdown_connections 2023-11-28T19:32:02.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 -- 172.21.15.28:0/431120044 wait complete. 2023-11-28T19:32:02.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 Processor -- start 2023-11-28T19:32:02.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 -- start start 2023-11-28T19:32:02.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c0047d0 0x7f21a40ba7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21a40bad30 0x7f21a41e0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a41e1420 0x7f21a4143f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40b83d0 con 0x7f21a40bad30 2023-11-28T19:32:02.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a41e18a0 con 0x7f218c0047d0 2023-11-28T19:32:02.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21a40b85e0 con 0x7f21a41e1420 2023-11-28T19:32:02.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21a40bad30 0x7f21a41e0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a3fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21a40bad30 0x7f21a41e0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60908/0 (socket says 172.21.15.28:60908) 2023-11-28T19:32:02.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a3fff640 1 -- 172.21.15.28:0/467560818 learned_addr learned my addr 172.21.15.28:0/467560818 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:02.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a890f640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c0047d0 0x7f21a40ba7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a9110640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a41e1420 0x7f21a4143f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a3fff640 1 -- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a41e1420 msgr2=0x7f21a4143f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a3fff640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a41e1420 0x7f21a4143f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a3fff640 1 -- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c0047d0 msgr2=0x7f21a40ba7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a3fff640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c0047d0 0x7f21a40ba7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a3fff640 1 -- 172.21.15.28:0/467560818 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a40b88c0 con 0x7f21a40bad30 2023-11-28T19:32:02.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a890f640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c0047d0 0x7f21a40ba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:02.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a9110640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a41e1420 0x7f21a4143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:02.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a3fff640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21a40bad30 0x7f21a41e0ee0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f219400c210 tx=0x7f218c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:02.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a17fa640 1 -- 172.21.15.28:0/467560818 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21940049f0 con 0x7f21a40bad30 2023-11-28T19:32:02.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a17fa640 1 -- 172.21.15.28:0/467560818 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21940b6070 con 0x7f21a40bad30 2023-11-28T19:32:02.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21a17fa640 1 -- 172.21.15.28:0/467560818 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2194004d70 con 0x7f21a40bad30 2023-11-28T19:32:02.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 -- 172.21.15.28:0/467560818 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a40b8ba0 con 0x7f21a40bad30 2023-11-28T19:32:02.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 -- 172.21.15.28:0/467560818 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a40b9d90 con 0x7f21a40bad30 2023-11-28T19:32:02.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.430+0000 7f21aab73640 1 -- 172.21.15.28:0/467560818 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a40c1ae0 con 0x7f21a40bad30 2023-11-28T19:32:02.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.434+0000 7f21a17fa640 1 -- 172.21.15.28:0/467560818 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2194007070 con 0x7f21a40bad30 2023-11-28T19:32:02.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.434+0000 7f21a17fa640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f21900664a0 0x7f2190068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.434+0000 7f21a17fa640 1 -- 172.21.15.28:0/467560818 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21940b8070 con 0x7f21a40bad30 2023-11-28T19:32:02.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.434+0000 7f21a890f640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f21900664a0 0x7f2190068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.434+0000 7f21a890f640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f21900664a0 0x7f2190068960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2198009930 tx=0x7f2198008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:02.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.438+0000 7f21a17fa640 1 -- 172.21.15.28:0/467560818 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f21a40c1ae0 con 0x7f21a40bad30 2023-11-28T19:32:02.588 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.586+0000 7f21aab73640 1 -- 172.21.15.28:0/467560818 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f21a40c1ae0 con 0x7f21a40bad30 2023-11-28T19:32:02.589 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.586+0000 7f21a17fa640 1 -- 172.21.15.28:0/467560818 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f21a40c1ae0 con 0x7f21a40bad30 2023-11-28T19:32:02.589 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-28T19:32:02.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.590+0000 7f21aab73640 1 -- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f21900664a0 msgr2=0x7f2190068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.590+0000 7f21aab73640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f21900664a0 0x7f2190068960 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2198009930 tx=0x7f2198008040 comp rx=0 tx=0).stop 2023-11-28T19:32:02.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.590+0000 7f21aab73640 1 -- 172.21.15.28:0/467560818 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21a40bad30 msgr2=0x7f21a41e0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.590+0000 7f21aab73640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21a40bad30 0x7f21a41e0ee0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f219400c210 tx=0x7f218c005800 comp rx=0 tx=0).stop 2023-11-28T19:32:02.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.590+0000 7f21aab73640 1 -- 172.21.15.28:0/467560818 shutdown_connections 2023-11-28T19:32:02.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.590+0000 7f21aab73640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f21900664a0 0x7f2190068960 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.590+0000 7f21aab73640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21a41e1420 0x7f21a4143f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.590+0000 7f21aab73640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21a40bad30 0x7f21a41e0ee0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.590+0000 7f21aab73640 1 --2- 172.21.15.28:0/467560818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f218c0047d0 0x7f21a40ba7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.590+0000 7f21aab73640 1 -- 172.21.15.28:0/467560818 >> 172.21.15.28:0/467560818 conn(0x7f21a40c0c90 msgr2=0x7f21a40a0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:02.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.590+0000 7f21aab73640 1 -- 172.21.15.28:0/467560818 shutdown_connections 2023-11-28T19:32:02.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.590+0000 7f21aab73640 1 -- 172.21.15.28:0/467560818 wait complete. 2023-11-28T19:32:02.607 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:32:02.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.714+0000 7f21ebc92640 1 Processor -- start 2023-11-28T19:32:02.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.714+0000 7f21ebc92640 1 -- start start 2023-11-28T19:32:02.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21ebc92640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f21e4142560 0x7f21e40b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21ebc92640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e40b4a80 con 0x7f21e40b4610 2023-11-28T19:32:02.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21ebc92640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21e4142940 con 0x7f21e40b5dd0 2023-11-28T19:32:02.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21ebc92640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21e406f950 con 0x7f21e4142560 2023-11-28T19:32:02.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21ea22f640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f21e40b4610 0x7f21e4152b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42462/0 (socket says 172.21.15.28:42462) 2023-11-28T19:32:02.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21ea22f640 1 -- 172.21.15.28:0/4103296751 learned_addr learned my addr 172.21.15.28:0/4103296751 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:02.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e9a2e640 1 --2- 172.21.15.28:0/4103296751 >> v2:172.21.15.131:3300/0 conn(0x7f21e4142560 0x7f21e40b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 -- 172.21.15.28:0/4103296751 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2065176941 0 0) 0x7f21e40b4a80 con 0x7f21e40b4610 2023-11-28T19:32:02.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 -- 172.21.15.28:0/4103296751 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f21d0003530 con 0x7f21e40b4610 2023-11-28T19:32:02.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 -- 172.21.15.28:0/4103296751 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2724850559 0 0) 0x7f21d0003530 con 0x7f21e40b4610 2023-11-28T19:32:02.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 -- 172.21.15.28:0/4103296751 >> v2:172.21.15.131:3300/0 conn(0x7f21e4142560 msgr2=0x7f21e40b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:02.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 --2- 172.21.15.28:0/4103296751 >> v2:172.21.15.131:3300/0 conn(0x7f21e4142560 0x7f21e40b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 -- 172.21.15.28:0/4103296751 >> v1:172.21.15.131:6789/0 conn(0x7f21e40b5dd0 legacy=0x7f21e40b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 -- 172.21.15.28:0/4103296751 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e414bb40 con 0x7f21e40b4610 2023-11-28T19:32:02.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 -- 172.21.15.28:0/4103296751 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f21dc001680 con 0x7f21e40b4610 2023-11-28T19:32:02.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 -- 172.21.15.28:0/4103296751 >> v1:172.21.15.28:6789/0 conn(0x7f21e40b4610 legacy=0x7f21e4152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 --2- 172.21.15.28:0/4103296751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21d0003980 0x7f21d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 --2- 172.21.15.28:0/4103296751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21d00047d0 0x7f21d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 --2- 172.21.15.28:0/4103296751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21d0005190 0x7f21d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 -- 172.21.15.28:0/4103296751 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e406f950 con 0x7f21d0003980 2023-11-28T19:32:02.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 -- 172.21.15.28:0/4103296751 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d000c040 con 0x7f21d00047d0 2023-11-28T19:32:02.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 -- 172.21.15.28:0/4103296751 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d000c200 con 0x7f21d0005190 2023-11-28T19:32:02.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e9a2e640 1 --2- 172.21.15.28:0/4103296751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21d0003980 0x7f21d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e9a2e640 1 -- 172.21.15.28:0/4103296751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21d0005190 msgr2=0x7f21d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:02.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e9a2e640 1 --2- 172.21.15.28:0/4103296751 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21d0005190 0x7f21d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e9a2e640 1 -- 172.21.15.28:0/4103296751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21d00047d0 msgr2=0x7f21d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:02.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e9a2e640 1 --2- 172.21.15.28:0/4103296751 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21d00047d0 0x7f21d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e9a2e640 1 -- 172.21.15.28:0/4103296751 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d0003530 con 0x7f21d0003980 2023-11-28T19:32:02.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21ea22f640 1 -- 172.21.15.28:0/4103296751 reap_dead start 2023-11-28T19:32:02.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e9a2e640 1 --2- 172.21.15.28:0/4103296751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21d0003980 0x7f21d0003da0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f21d800bd80 tx=0x7f21d801f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=765fc8e33b7e3dee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:02.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 -- 172.21.15.28:0/4103296751 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d80ae610 con 0x7f21d0003980 2023-11-28T19:32:02.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 -- 172.21.15.28:0/4103296751 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d80ae770 con 0x7f21d0003980 2023-11-28T19:32:02.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.718+0000 7f21e8a2c640 1 -- 172.21.15.28:0/4103296751 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d80aeb20 con 0x7f21d0003980 2023-11-28T19:32:02.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 -- 172.21.15.28:0/4103296751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21d0003980 msgr2=0x7f21d0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 --2- 172.21.15.28:0/4103296751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21d0003980 0x7f21d0003da0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f21d800bd80 tx=0x7f21d801f3c0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 -- 172.21.15.28:0/4103296751 shutdown_connections 2023-11-28T19:32:02.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 --2- 172.21.15.28:0/4103296751 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21d0003980 0x7f21d0003da0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 -- 172.21.15.28:0/4103296751 >> 172.21.15.28:0/4103296751 conn(0x7f21e40bcb40 msgr2=0x7f21e40bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:02.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 -- 172.21.15.28:0/4103296751 shutdown_connections 2023-11-28T19:32:02.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 -- 172.21.15.28:0/4103296751 wait complete. 2023-11-28T19:32:02.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 Processor -- start 2023-11-28T19:32:02.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 -- start start 2023-11-28T19:32:02.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21d0003980 0x7f21e40bbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21e41dff60 0x7f21e4071930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21e40708b0 0x7f21e4136b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e40bc130 con 0x7f21d0003980 2023-11-28T19:32:02.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21e413ed60 con 0x7f21e40708b0 2023-11-28T19:32:02.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21e4071e70 con 0x7f21e41dff60 2023-11-28T19:32:02.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21e9a2e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21d0003980 0x7f21e40bbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21e9a2e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21d0003980 0x7f21e40bbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60918/0 (socket says 172.21.15.28:60918) 2023-11-28T19:32:02.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21e9a2e640 1 -- 172.21.15.28:0/3840396146 learned_addr learned my addr 172.21.15.28:0/3840396146 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:02.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ea22f640 1 --2- 172.21.15.28:0/3840396146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21e40708b0 0x7f21e4136b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21e9a2e640 1 -- 172.21.15.28:0/3840396146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21e41dff60 msgr2=0x7f21e4071930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21e9a2e640 1 --2- 172.21.15.28:0/3840396146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21e41dff60 0x7f21e4071930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21e9a2e640 1 -- 172.21.15.28:0/3840396146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21e40708b0 msgr2=0x7f21e4136b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21e9a2e640 1 --2- 172.21.15.28:0/3840396146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21e40708b0 0x7f21e4136b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21e9a2e640 1 -- 172.21.15.28:0/3840396146 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e413e7a0 con 0x7f21d0003980 2023-11-28T19:32:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21e9a2e640 1 --2- 172.21.15.28:0/3840396146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21d0003980 0x7f21e40bbbf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f21d80b0040 tx=0x7f21d0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21d67fc640 1 -- 172.21.15.28:0/3840396146 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d80aeae0 con 0x7f21d0003980 2023-11-28T19:32:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21d67fc640 1 -- 172.21.15.28:0/3840396146 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21d80bd070 con 0x7f21d0003980 2023-11-28T19:32:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21d67fc640 1 -- 172.21.15.28:0/3840396146 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21d80aee40 con 0x7f21d0003980 2023-11-28T19:32:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 -- 172.21.15.28:0/3840396146 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21e413ea80 con 0x7f21d0003980 2023-11-28T19:32:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.722+0000 7f21ebc92640 1 -- 172.21.15.28:0/3840396146 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21e413e430 con 0x7f21d0003980 2023-11-28T19:32:02.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.726+0000 7f21ebc92640 1 -- 172.21.15.28:0/3840396146 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21e4074a90 con 0x7f21d0003980 2023-11-28T19:32:02.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.726+0000 7f21d67fc640 1 -- 172.21.15.28:0/3840396146 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f21d80bf030 con 0x7f21d0003980 2023-11-28T19:32:02.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.726+0000 7f21d67fc640 1 --2- 172.21.15.28:0/3840396146 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f21c80664a0 0x7f21c8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:02.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.726+0000 7f21d67fc640 1 -- 172.21.15.28:0/3840396146 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21d8121b40 con 0x7f21d0003980 2023-11-28T19:32:02.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.726+0000 7f21e922d640 1 --2- 172.21.15.28:0/3840396146 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f21c80664a0 0x7f21c8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:02.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.726+0000 7f21e922d640 1 --2- 172.21.15.28:0/3840396146 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f21c80664a0 0x7f21c8068960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f21e41e0340 tx=0x7f21e0007d20 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:02.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.730+0000 7f21d67fc640 1 -- 172.21.15.28:0/3840396146 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f21d80ef170 con 0x7f21d0003980 2023-11-28T19:32:02.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.878+0000 7f21ebc92640 1 -- 172.21.15.28:0/3840396146 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21e40b3d80 con 0x7f21d0003980 2023-11-28T19:32:02.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.882+0000 7f21d67fc640 1 -- 172.21.15.28:0/3840396146 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7f21d80ae5d0 con 0x7f21d0003980 2023-11-28T19:32:02.882 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:02.882 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:32:02.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.882+0000 7f21ebc92640 1 -- 172.21.15.28:0/3840396146 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f21c80664a0 msgr2=0x7f21c8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.882+0000 7f21ebc92640 1 --2- 172.21.15.28:0/3840396146 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f21c80664a0 0x7f21c8068960 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f21e41e0340 tx=0x7f21e0007d20 comp rx=0 tx=0).stop 2023-11-28T19:32:02.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.882+0000 7f21ebc92640 1 -- 172.21.15.28:0/3840396146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21d0003980 msgr2=0x7f21e40bbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:02.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.882+0000 7f21ebc92640 1 --2- 172.21.15.28:0/3840396146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21d0003980 0x7f21e40bbbf0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f21d80b0040 tx=0x7f21d0005800 comp rx=0 tx=0).stop 2023-11-28T19:32:02.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.882+0000 7f21ebc92640 1 -- 172.21.15.28:0/3840396146 shutdown_connections 2023-11-28T19:32:02.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.882+0000 7f21ebc92640 1 --2- 172.21.15.28:0/3840396146 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f21c80664a0 0x7f21c8068960 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.882+0000 7f21ebc92640 1 --2- 172.21.15.28:0/3840396146 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21e40708b0 0x7f21e4136b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.882+0000 7f21ebc92640 1 --2- 172.21.15.28:0/3840396146 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f21e41dff60 0x7f21e4071930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.882+0000 7f21ebc92640 1 --2- 172.21.15.28:0/3840396146 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f21d0003980 0x7f21e40bbbf0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:02.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.882+0000 7f21ebc92640 1 -- 172.21.15.28:0/3840396146 >> 172.21.15.28:0/3840396146 conn(0x7f21e40bcb40 msgr2=0x7f21e4139d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:02.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.882+0000 7f21ebc92640 1 -- 172.21.15.28:0/3840396146 shutdown_connections 2023-11-28T19:32:02.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:02.882+0000 7f21ebc92640 1 -- 172.21.15.28:0/3840396146 wait complete. 2023-11-28T19:32:02.900 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:31:33.212362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:31:42.810956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:31:43.579438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T19:32:02.901 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:32:03.014 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f692a628640 1 Processor -- start 2023-11-28T19:32:03.015 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f692a628640 1 -- start start 2023-11-28T19:32:03.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f692a628640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f692406aaf0 0x7f692406aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.017 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f692a628640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69240bd5e0 con 0x7f692414ac70 2023-11-28T19:32:03.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f692a628640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f692406bca0 con 0x7f692414bdf0 2023-11-28T19:32:03.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f692a628640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69240bc1c0 con 0x7f692406aaf0 2023-11-28T19:32:03.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f69237fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f692414ac70 0x7f692414b6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42478/0 (socket says 172.21.15.28:42478) 2023-11-28T19:32:03.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f69237fe640 1 -- 172.21.15.28:0/3816010707 learned_addr learned my addr 172.21.15.28:0/3816010707 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:03.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 -- 172.21.15.28:0/3816010707 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2894539870 0 0) 0x7f69240bd5e0 con 0x7f692414ac70 2023-11-28T19:32:03.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6923fff640 1 --2- 172.21.15.28:0/3816010707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f692406aaf0 0x7f692406aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 -- 172.21.15.28:0/3816010707 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f690c003530 con 0x7f692414ac70 2023-11-28T19:32:03.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 -- 172.21.15.28:0/3816010707 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 778645171 0 0) 0x7f690c003530 con 0x7f692414ac70 2023-11-28T19:32:03.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 -- 172.21.15.28:0/3816010707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f692406aaf0 msgr2=0x7f692406aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:03.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 --2- 172.21.15.28:0/3816010707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f692406aaf0 0x7f692406aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 -- 172.21.15.28:0/3816010707 >> v1:172.21.15.131:6789/0 conn(0x7f692414bdf0 legacy=0x7f6924155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 -- 172.21.15.28:0/3816010707 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692406b7a0 con 0x7f692414ac70 2023-11-28T19:32:03.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 -- 172.21.15.28:0/3816010707 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f6918001680 con 0x7f692414ac70 2023-11-28T19:32:03.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6923fff640 1 --2- 172.21.15.28:0/3816010707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f692406aaf0 0x7f692406aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:03.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 -- 172.21.15.28:0/3816010707 >> v1:172.21.15.28:6789/0 conn(0x7f692414ac70 legacy=0x7f692414b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 --2- 172.21.15.28:0/3816010707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f690c0039b0 0x7f690c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 --2- 172.21.15.28:0/3816010707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f690c0047d0 0x7f690c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 --2- 172.21.15.28:0/3816010707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f692406aaf0 0x7f690c0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 -- 172.21.15.28:0/3816010707 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c00bb20 con 0x7f690c0047d0 2023-11-28T19:32:03.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 -- 172.21.15.28:0/3816010707 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f690c00bc60 con 0x7f690c0039b0 2023-11-28T19:32:03.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6922ffd640 1 -- 172.21.15.28:0/3816010707 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690c00bdd0 con 0x7f692406aaf0 2023-11-28T19:32:03.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f69237fe640 1 --2- 172.21.15.28:0/3816010707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f690c0047d0 0x7f690c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6923fff640 1 --2- 172.21.15.28:0/3816010707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f690c0039b0 0x7f690c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f6928bc5640 1 --2- 172.21.15.28:0/3816010707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f692406aaf0 0x7f690c0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f69237fe640 1 -- 172.21.15.28:0/3816010707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f692406aaf0 msgr2=0x7f690c0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:03.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f69237fe640 1 --2- 172.21.15.28:0/3816010707 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f692406aaf0 0x7f690c0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f69237fe640 1 -- 172.21.15.28:0/3816010707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f690c0039b0 msgr2=0x7f690c003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:03.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f69237fe640 1 --2- 172.21.15.28:0/3816010707 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f690c0039b0 0x7f690c003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.014+0000 7f69237fe640 1 -- 172.21.15.28:0/3816010707 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f690c003530 con 0x7f690c0047d0 2023-11-28T19:32:03.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.018+0000 7f69237fe640 1 --2- 172.21.15.28:0/3816010707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f690c0047d0 0x7f690c004c50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f691800c110 tx=0x7f691801f2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53ce647b57159ac3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:03.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.018+0000 7f6922ffd640 1 -- 172.21.15.28:0/3816010707 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69180058e0 con 0x7f690c0047d0 2023-11-28T19:32:03.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.018+0000 7f6922ffd640 1 -- 172.21.15.28:0/3816010707 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6918005a40 con 0x7f690c0047d0 2023-11-28T19:32:03.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.018+0000 7f6922ffd640 1 -- 172.21.15.28:0/3816010707 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6918005df0 con 0x7f690c0047d0 2023-11-28T19:32:03.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.018+0000 7f692a628640 1 -- 172.21.15.28:0/3816010707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f690c0047d0 msgr2=0x7f690c004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.018+0000 7f692a628640 1 --2- 172.21.15.28:0/3816010707 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f690c0047d0 0x7f690c004c50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f691800c110 tx=0x7f691801f2b0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.018+0000 7f6928bc5640 1 -- 172.21.15.28:0/3816010707 reap_dead start 2023-11-28T19:32:03.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.018+0000 7f692a628640 1 -- 172.21.15.28:0/3816010707 shutdown_connections 2023-11-28T19:32:03.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.018+0000 7f692a628640 1 -- 172.21.15.28:0/3816010707 >> 172.21.15.28:0/3816010707 conn(0x7f69240bd790 msgr2=0x7f69240bdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:03.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.018+0000 7f692a628640 1 -- 172.21.15.28:0/3816010707 shutdown_connections 2023-11-28T19:32:03.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.018+0000 7f692a628640 1 -- 172.21.15.28:0/3816010707 wait complete. 2023-11-28T19:32:03.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.018+0000 7f692a628640 1 Processor -- start 2023-11-28T19:32:03.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.018+0000 7f692a628640 1 -- start start 2023-11-28T19:32:03.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f692a628640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f690c0047d0 0x7f6924141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f692a628640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69241424a0 0x7f69241430a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f692a628640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69241435e0 0x7f69241e2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f692a628640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69241476c0 con 0x7f690c0047d0 2023-11-28T19:32:03.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f692a628640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69241e24c0 con 0x7f69241424a0 2023-11-28T19:32:03.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f692a628640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69241473e0 con 0x7f69241435e0 2023-11-28T19:32:03.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6923fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f690c0047d0 0x7f6924141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6923fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f690c0047d0 0x7f6924141f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60926/0 (socket says 172.21.15.28:60926) 2023-11-28T19:32:03.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6923fff640 1 -- 172.21.15.28:0/443194067 learned_addr learned my addr 172.21.15.28:0/443194067 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:03.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6923fff640 1 -- 172.21.15.28:0/443194067 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69241435e0 msgr2=0x7f69241e2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6923fff640 1 --2- 172.21.15.28:0/443194067 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69241435e0 0x7f69241e2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6923fff640 1 -- 172.21.15.28:0/443194067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69241424a0 msgr2=0x7f69241430a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6923fff640 1 --2- 172.21.15.28:0/443194067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69241424a0 0x7f69241430a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6923fff640 1 -- 172.21.15.28:0/443194067 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69241e2150 con 0x7f690c0047d0 2023-11-28T19:32:03.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6923fff640 1 --2- 172.21.15.28:0/443194067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f690c0047d0 0x7f6924141f60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6914010890 tx=0x7f6914010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:03.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6920ff9640 1 -- 172.21.15.28:0/443194067 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691400cae0 con 0x7f690c0047d0 2023-11-28T19:32:03.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6920ff9640 1 -- 172.21.15.28:0/443194067 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691400cc40 con 0x7f690c0047d0 2023-11-28T19:32:03.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f692a628640 1 -- 172.21.15.28:0/443194067 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69240ba4f0 con 0x7f690c0047d0 2023-11-28T19:32:03.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6920ff9640 1 -- 172.21.15.28:0/443194067 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6914010e80 con 0x7f690c0047d0 2023-11-28T19:32:03.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f692a628640 1 -- 172.21.15.28:0/443194067 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69241e3060 con 0x7f690c0047d0 2023-11-28T19:32:03.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f692a628640 1 -- 172.21.15.28:0/443194067 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69241e1fb0 con 0x7f690c0047d0 2023-11-28T19:32:03.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6920ff9640 1 -- 172.21.15.28:0/443194067 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6914015470 con 0x7f690c0047d0 2023-11-28T19:32:03.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6920ff9640 1 --2- 172.21.15.28:0/443194067 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6910066470 0x7f6910068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f6920ff9640 1 -- 172.21.15.28:0/443194067 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6914084460 con 0x7f690c0047d0 2023-11-28T19:32:03.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f69237fe640 1 --2- 172.21.15.28:0/443194067 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6910066470 0x7f6910068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.022+0000 7f69237fe640 1 --2- 172.21.15.28:0/443194067 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6910066470 0x7f6910068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f69180ae000 tx=0x7f69240b7b50 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:03.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.026+0000 7f6920ff9640 1 -- 172.21.15.28:0/443194067 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f69241e1fb0 con 0x7f690c0047d0 2023-11-28T19:32:03.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.178+0000 7f692a628640 1 -- 172.21.15.28:0/443194067 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f69241e1fb0 con 0x7f690c0047d0 2023-11-28T19:32:03.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.178+0000 7f6920ff9640 1 -- 172.21.15.28:0/443194067 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f69241e1fb0 con 0x7f690c0047d0 2023-11-28T19:32:03.180 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-28T19:32:03.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.182+0000 7f692a628640 1 -- 172.21.15.28:0/443194067 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6910066470 msgr2=0x7f6910068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.182+0000 7f692a628640 1 --2- 172.21.15.28:0/443194067 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6910066470 0x7f6910068930 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f69180ae000 tx=0x7f69240b7b50 comp rx=0 tx=0).stop 2023-11-28T19:32:03.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.182+0000 7f692a628640 1 -- 172.21.15.28:0/443194067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f690c0047d0 msgr2=0x7f6924141f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.182+0000 7f692a628640 1 --2- 172.21.15.28:0/443194067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f690c0047d0 0x7f6924141f60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6914010890 tx=0x7f6914010d50 comp rx=0 tx=0).stop 2023-11-28T19:32:03.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.182+0000 7f692a628640 1 -- 172.21.15.28:0/443194067 shutdown_connections 2023-11-28T19:32:03.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.182+0000 7f692a628640 1 --2- 172.21.15.28:0/443194067 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6910066470 0x7f6910068930 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.182+0000 7f692a628640 1 --2- 172.21.15.28:0/443194067 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f69241435e0 0x7f69241e2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.182+0000 7f692a628640 1 --2- 172.21.15.28:0/443194067 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f69241424a0 0x7f69241430a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.182+0000 7f692a628640 1 --2- 172.21.15.28:0/443194067 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f690c0047d0 0x7f6924141f60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.182+0000 7f692a628640 1 -- 172.21.15.28:0/443194067 >> 172.21.15.28:0/443194067 conn(0x7f69240bd790 msgr2=0x7f6924149690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:03.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.182+0000 7f692a628640 1 -- 172.21.15.28:0/443194067 shutdown_connections 2023-11-28T19:32:03.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.182+0000 7f692a628640 1 -- 172.21.15.28:0/443194067 wait complete. 2023-11-28T19:32:03.198 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:32:03.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17b58be640 1 Processor -- start 2023-11-28T19:32:03.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17b58be640 1 -- start start 2023-11-28T19:32:03.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17b58be640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f17b00bd340 0x7f17b0142120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17b58be640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17b00728c0 0x7f17b00b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17b58be640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f17b0142660 0x7f17b00b4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17b58be640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b00b6e90 con 0x7f17b0142660 2023-11-28T19:32:03.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17b58be640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b00b6560 con 0x7f17b00bd340 2023-11-28T19:32:03.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17b58be640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b00b6840 con 0x7f17b00728c0 2023-11-28T19:32:03.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17af7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f17b0142660 0x7f17b00b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17af7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f17b0142660 0x7f17b00b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60940/0 (socket says 172.21.15.28:60940) 2023-11-28T19:32:03.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17af7fe640 1 -- 172.21.15.28:0/2742536008 learned_addr learned my addr 172.21.15.28:0/2742536008 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:03.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17aeffd640 1 --2- 172.21.15.28:0/2742536008 >> v2:172.21.15.131:3300/0 conn(0x7f17b00bd340 0x7f17b0142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17a67fc640 1 --2- 172.21.15.28:0/2742536008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17b00728c0 0x7f17b00b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17af7fe640 1 -- 172.21.15.28:0/2742536008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17b00728c0 msgr2=0x7f17b00b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:03.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17af7fe640 1 --2- 172.21.15.28:0/2742536008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17b00728c0 0x7f17b00b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17af7fe640 1 -- 172.21.15.28:0/2742536008 >> v2:172.21.15.131:3300/0 conn(0x7f17b00bd340 msgr2=0x7f17b0142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:03.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17af7fe640 1 --2- 172.21.15.28:0/2742536008 >> v2:172.21.15.131:3300/0 conn(0x7f17b00bd340 0x7f17b0142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17af7fe640 1 -- 172.21.15.28:0/2742536008 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b00b6b20 con 0x7f17b0142660 2023-11-28T19:32:03.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.322+0000 7f17a67fc640 1 --2- 172.21.15.28:0/2742536008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17b00728c0 0x7f17b00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:03.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17af7fe640 1 --2- 172.21.15.28:0/2742536008 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17b0142660 0x7f17b00b4990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f17a8009870 tx=0x7f17a801ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4173ccb72d67b3e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:03.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17ae7fc640 1 -- 172.21.15.28:0/2742536008 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a80a89b0 con 0x7f17b0142660 2023-11-28T19:32:03.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17ae7fc640 1 -- 172.21.15.28:0/2742536008 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a80a8b10 con 0x7f17b0142660 2023-11-28T19:32:03.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17ae7fc640 1 -- 172.21.15.28:0/2742536008 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a80a8ea0 con 0x7f17b0142660 2023-11-28T19:32:03.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 -- 172.21.15.28:0/2742536008 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17b0142660 msgr2=0x7f17b00b4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 --2- 172.21.15.28:0/2742536008 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17b0142660 0x7f17b00b4990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f17a8009870 tx=0x7f17a801ecf0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 -- 172.21.15.28:0/2742536008 shutdown_connections 2023-11-28T19:32:03.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 --2- 172.21.15.28:0/2742536008 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17b0142660 0x7f17b00b4990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 --2- 172.21.15.28:0/2742536008 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17b00728c0 0x7f17b00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 --2- 172.21.15.28:0/2742536008 >> v2:172.21.15.131:3300/0 conn(0x7f17b00bd340 0x7f17b0142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 -- 172.21.15.28:0/2742536008 >> 172.21.15.28:0/2742536008 conn(0x7f17b006ab80 msgr2=0x7f17b00bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:03.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 -- 172.21.15.28:0/2742536008 shutdown_connections 2023-11-28T19:32:03.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 -- 172.21.15.28:0/2742536008 wait complete. 2023-11-28T19:32:03.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 Processor -- start 2023-11-28T19:32:03.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 -- start start 2023-11-28T19:32:03.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17b00728c0 0x7f17b0071820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17b00bd340 0x7f17b00707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.332 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17b0142660 0x7f17b01ce3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b0071d60 con 0x7f17b00bd340 2023-11-28T19:32:03.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b0144160 con 0x7f17b0142660 2023-11-28T19:32:03.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b0070340 con 0x7f17b00728c0 2023-11-28T19:32:03.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17a67fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17b00bd340 0x7f17b00707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17a67fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17b00bd340 0x7f17b00707d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60942/0 (socket says 172.21.15.28:60942) 2023-11-28T19:32:03.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17a67fc640 1 -- 172.21.15.28:0/3483734728 learned_addr learned my addr 172.21.15.28:0/3483734728 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:03.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17af7fe640 1 --2- 172.21.15.28:0/3483734728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17b0142660 0x7f17b01ce3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17a67fc640 1 -- 172.21.15.28:0/3483734728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17b00728c0 msgr2=0x7f17b0071820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17a67fc640 1 --2- 172.21.15.28:0/3483734728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17b00728c0 0x7f17b0071820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17a67fc640 1 -- 172.21.15.28:0/3483734728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17b0142660 msgr2=0x7f17b01ce3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17a67fc640 1 --2- 172.21.15.28:0/3483734728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17b0142660 0x7f17b01ce3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17a67fc640 1 -- 172.21.15.28:0/3483734728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a80094d0 con 0x7f17b00bd340 2023-11-28T19:32:03.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17a67fc640 1 --2- 172.21.15.28:0/3483734728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17b00bd340 0x7f17b00707d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f179800c7f0 tx=0x7f179800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:03.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17acff9640 1 -- 172.21.15.28:0/3483734728 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798007820 con 0x7f17b00bd340 2023-11-28T19:32:03.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17acff9640 1 -- 172.21.15.28:0/3483734728 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1798007980 con 0x7f17b00bd340 2023-11-28T19:32:03.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 -- 172.21.15.28:0/3483734728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b00b9000 con 0x7f17b00bd340 2023-11-28T19:32:03.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17acff9640 1 -- 172.21.15.28:0/3483734728 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1798007d10 con 0x7f17b00bd340 2023-11-28T19:32:03.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.326+0000 7f17b58be640 1 -- 172.21.15.28:0/3483734728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b0072230 con 0x7f17b00bd340 2023-11-28T19:32:03.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.330+0000 7f17b58be640 1 -- 172.21.15.28:0/3483734728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b0074a90 con 0x7f17b00bd340 2023-11-28T19:32:03.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.330+0000 7f17acff9640 1 -- 172.21.15.28:0/3483734728 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f17980113f0 con 0x7f17b00bd340 2023-11-28T19:32:03.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.330+0000 7f17acff9640 1 --2- 172.21.15.28:0/3483734728 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1790066470 0x7f1790068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.334 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.330+0000 7f17acff9640 1 -- 172.21.15.28:0/3483734728 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f17980840d0 con 0x7f17b00bd340 2023-11-28T19:32:03.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.330+0000 7f17aeffd640 1 --2- 172.21.15.28:0/3483734728 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1790066470 0x7f1790068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.330+0000 7f17aeffd640 1 --2- 172.21.15.28:0/3483734728 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1790066470 0x7f1790068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f17a00070b0 tx=0x7f17a0007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:03.335 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.334+0000 7f17acff9640 1 -- 172.21.15.28:0/3483734728 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f17980515e0 con 0x7f17b00bd340 2023-11-28T19:32:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.490+0000 7f17b58be640 1 -- 172.21.15.28:0/3483734728 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17b00b83a0 con 0x7f17b00bd340 2023-11-28T19:32:03.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.490+0000 7f17acff9640 1 -- 172.21.15.28:0/3483734728 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1798054c00 con 0x7f17b00bd340 2023-11-28T19:32:03.492 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-28T19:32:03.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.494+0000 7f17b58be640 1 -- 172.21.15.28:0/3483734728 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1790066470 msgr2=0x7f1790068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.494+0000 7f17b58be640 1 --2- 172.21.15.28:0/3483734728 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1790066470 0x7f1790068930 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f17a00070b0 tx=0x7f17a0007040 comp rx=0 tx=0).stop 2023-11-28T19:32:03.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.494+0000 7f17b58be640 1 -- 172.21.15.28:0/3483734728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17b00bd340 msgr2=0x7f17b00707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.494+0000 7f17b58be640 1 --2- 172.21.15.28:0/3483734728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17b00bd340 0x7f17b00707d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f179800c7f0 tx=0x7f179800ccb0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.494+0000 7f17b58be640 1 -- 172.21.15.28:0/3483734728 shutdown_connections 2023-11-28T19:32:03.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.494+0000 7f17b58be640 1 --2- 172.21.15.28:0/3483734728 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1790066470 0x7f1790068930 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.494+0000 7f17b58be640 1 --2- 172.21.15.28:0/3483734728 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17b0142660 0x7f17b01ce3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.494+0000 7f17b58be640 1 --2- 172.21.15.28:0/3483734728 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f17b00bd340 0x7f17b00707d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.494+0000 7f17b58be640 1 --2- 172.21.15.28:0/3483734728 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f17b00728c0 0x7f17b0071820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.494+0000 7f17b58be640 1 -- 172.21.15.28:0/3483734728 >> 172.21.15.28:0/3483734728 conn(0x7f17b006ab80 msgr2=0x7f17b0148a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.494+0000 7f17b58be640 1 -- 172.21.15.28:0/3483734728 shutdown_connections 2023-11-28T19:32:03.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.494+0000 7f17b58be640 1 -- 172.21.15.28:0/3483734728 wait complete. 2023-11-28T19:32:03.511 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:32:03.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.630+0000 7fc2d99fb640 1 Processor -- start 2023-11-28T19:32:03.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d99fb640 1 -- start start 2023-11-28T19:32:03.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d99fb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc2d40b4b60 0x7fc2d4153aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d99fb640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d40b6e90 con 0x7fc2d40bd340 2023-11-28T19:32:03.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d99fb640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d40b6560 con 0x7fc2d40728c0 2023-11-28T19:32:03.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d99fb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d40b6840 con 0x7fc2d40b4b60 2023-11-28T19:32:03.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc2d40b4b60 0x7fc2d4153aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d2ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc2d40bd340 0x7fc2d4142120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42480/0 (socket says 172.21.15.28:42480) 2023-11-28T19:32:03.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d2ffd640 1 -- 172.21.15.28:0/3036126057 learned_addr learned my addr 172.21.15.28:0/3036126057 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:03.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d37fe640 1 -- 172.21.15.28:0/3036126057 >> v1:172.21.15.131:6789/0 conn(0x7fc2d40728c0 legacy=0x7fc2d40b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:03.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d37fe640 1 -- 172.21.15.28:0/3036126057 >> v1:172.21.15.28:6789/0 conn(0x7fc2d40bd340 legacy=0x7fc2d4142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d37fe640 1 -- 172.21.15.28:0/3036126057 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d40b6b20 con 0x7fc2d40b4b60 2023-11-28T19:32:03.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d37fe640 1 --2- 172.21.15.28:0/3036126057 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d40b4b60 0x7fc2d4153aa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400ba60 tx=0x7fc2c401eb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c77ccb8a867dee server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:03.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d1ffb640 1 -- 172.21.15.28:0/3036126057 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40a7a00 con 0x7fc2d40b4b60 2023-11-28T19:32:03.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d1ffb640 1 -- 172.21.15.28:0/3036126057 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c40a7b60 con 0x7fc2d40b4b60 2023-11-28T19:32:03.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.634+0000 7fc2d1ffb640 1 -- 172.21.15.28:0/3036126057 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c40af440 con 0x7fc2d40b4b60 2023-11-28T19:32:03.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 -- 172.21.15.28:0/3036126057 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d40b4b60 msgr2=0x7fc2d4153aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 --2- 172.21.15.28:0/3036126057 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d40b4b60 0x7fc2d4153aa0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fc2c400ba60 tx=0x7fc2c401eb10 comp rx=0 tx=0).stop 2023-11-28T19:32:03.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 -- 172.21.15.28:0/3036126057 shutdown_connections 2023-11-28T19:32:03.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 --2- 172.21.15.28:0/3036126057 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d40b4b60 0x7fc2d4153aa0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 -- 172.21.15.28:0/3036126057 >> 172.21.15.28:0/3036126057 conn(0x7fc2d406ab80 msgr2=0x7fc2d40bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:03.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 -- 172.21.15.28:0/3036126057 shutdown_connections 2023-11-28T19:32:03.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 -- 172.21.15.28:0/3036126057 wait complete. 2023-11-28T19:32:03.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 Processor -- start 2023-11-28T19:32:03.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 -- start start 2023-11-28T19:32:03.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2d40728c0 0x7fc2d406f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d40b4b60 0x7fc2d4137370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2d40bd340 0x7fc2d4133b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d406fde0 con 0x7fc2d40b4b60 2023-11-28T19:32:03.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d41378b0 con 0x7fc2d40bd340 2023-11-28T19:32:03.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d4070ab0 con 0x7fc2d40728c0 2023-11-28T19:32:03.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d27fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d40b4b60 0x7fc2d4137370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d27fc640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d40b4b60 0x7fc2d4137370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60952/0 (socket says 172.21.15.28:60952) 2023-11-28T19:32:03.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d27fc640 1 -- 172.21.15.28:0/933158229 learned_addr learned my addr 172.21.15.28:0/933158229 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:03.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d37fe640 1 --2- 172.21.15.28:0/933158229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2d40bd340 0x7fc2d4133b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d2ffd640 1 --2- 172.21.15.28:0/933158229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2d40728c0 0x7fc2d406f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d27fc640 1 -- 172.21.15.28:0/933158229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2d40728c0 msgr2=0x7fc2d406f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d27fc640 1 --2- 172.21.15.28:0/933158229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2d40728c0 0x7fc2d406f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d27fc640 1 -- 172.21.15.28:0/933158229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2d40bd340 msgr2=0x7fc2d4133b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d27fc640 1 --2- 172.21.15.28:0/933158229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2d40bd340 0x7fc2d4133b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d27fc640 1 -- 172.21.15.28:0/933158229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c400b6c0 con 0x7fc2d40b4b60 2023-11-28T19:32:03.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d27fc640 1 --2- 172.21.15.28:0/933158229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d40b4b60 0x7fc2d4137370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800c410 tx=0x7fc2c800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:03.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2bbfff640 1 -- 172.21.15.28:0/933158229 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8011790 con 0x7fc2d40b4b60 2023-11-28T19:32:03.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2bbfff640 1 -- 172.21.15.28:0/933158229 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c80118f0 con 0x7fc2d40b4b60 2023-11-28T19:32:03.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 -- 172.21.15.28:0/933158229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d4136020 con 0x7fc2d40b4b60 2023-11-28T19:32:03.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2bbfff640 1 -- 172.21.15.28:0/933158229 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8011ca0 con 0x7fc2d40b4b60 2023-11-28T19:32:03.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 -- 172.21.15.28:0/933158229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d41365e0 con 0x7fc2d40b4b60 2023-11-28T19:32:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.638+0000 7fc2d99fb640 1 -- 172.21.15.28:0/933158229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d4074a90 con 0x7fc2d40b4b60 2023-11-28T19:32:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.642+0000 7fc2bbfff640 1 -- 172.21.15.28:0/933158229 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc2c801c460 con 0x7fc2d40b4b60 2023-11-28T19:32:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.642+0000 7fc2bbfff640 1 --2- 172.21.15.28:0/933158229 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc2c0066470 0x7fc2c0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:03.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.642+0000 7fc2bbfff640 1 -- 172.21.15.28:0/933158229 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2c8083d40 con 0x7fc2d40b4b60 2023-11-28T19:32:03.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.642+0000 7fc2d2ffd640 1 --2- 172.21.15.28:0/933158229 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc2c0066470 0x7fc2c0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:03.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.642+0000 7fc2d2ffd640 1 --2- 172.21.15.28:0/933158229 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc2c0066470 0x7fc2c0068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc005c10 tx=0x7fc2cc009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:03.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.646+0000 7fc2bbfff640 1 -- 172.21.15.28:0/933158229 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc2c8051250 con 0x7fc2d40b4b60 2023-11-28T19:32:03.801 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.798+0000 7fc2d99fb640 1 -- 172.21.15.28:0/933158229 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc2d4141950 con 0x7fc2d40b4b60 2023-11-28T19:32:03.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.802+0000 7fc2bbfff640 1 -- 172.21.15.28:0/933158229 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc2c8054870 con 0x7fc2d40b4b60 2023-11-28T19:32:03.803 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-28T19:32:03.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.802+0000 7fc2d99fb640 1 -- 172.21.15.28:0/933158229 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc2c0066470 msgr2=0x7fc2c0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.802+0000 7fc2d99fb640 1 --2- 172.21.15.28:0/933158229 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc2c0066470 0x7fc2c0068930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc005c10 tx=0x7fc2cc009040 comp rx=0 tx=0).stop 2023-11-28T19:32:03.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.802+0000 7fc2d99fb640 1 -- 172.21.15.28:0/933158229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d40b4b60 msgr2=0x7fc2d4137370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:03.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.802+0000 7fc2d99fb640 1 --2- 172.21.15.28:0/933158229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d40b4b60 0x7fc2d4137370 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800c410 tx=0x7fc2c800c8d0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.802+0000 7fc2d99fb640 1 -- 172.21.15.28:0/933158229 shutdown_connections 2023-11-28T19:32:03.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.802+0000 7fc2d99fb640 1 --2- 172.21.15.28:0/933158229 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc2c0066470 0x7fc2c0068930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.802+0000 7fc2d99fb640 1 --2- 172.21.15.28:0/933158229 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2d40bd340 0x7fc2d4133b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.802+0000 7fc2d99fb640 1 --2- 172.21.15.28:0/933158229 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc2d40b4b60 0x7fc2d4137370 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.802+0000 7fc2d99fb640 1 --2- 172.21.15.28:0/933158229 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc2d40728c0 0x7fc2d406f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:03.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.802+0000 7fc2d99fb640 1 -- 172.21.15.28:0/933158229 >> 172.21.15.28:0/933158229 conn(0x7fc2d406ab80 msgr2=0x7fc2d40b38e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:03.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.802+0000 7fc2d99fb640 1 -- 172.21.15.28:0/933158229 shutdown_connections 2023-11-28T19:32:03.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:03.802+0000 7fc2d99fb640 1 -- 172.21.15.28:0/933158229 wait complete. 2023-11-28T19:32:03.880 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-11-28T19:32:03.881 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:32:04.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd6b819640 1 Processor -- start 2023-11-28T19:32:04.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd6b819640 1 -- start start 2023-11-28T19:32:04.002 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd6b819640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd64142560 0x7efd640b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd6b819640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efd640b4610 0x7efd640b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd6b819640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd640b4aa0 con 0x7efd640b5dd0 2023-11-28T19:32:04.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd6b819640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6406f950 con 0x7efd640b4610 2023-11-28T19:32:04.003 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd6b819640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd640b70c0 con 0x7efd64142560 2023-11-28T19:32:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd695b5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd64142560 0x7efd640b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd695b5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd64142560 0x7efd640b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:36562/0 (socket says 172.21.15.28:36562) 2023-11-28T19:32:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd69db6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7efd640b4610 0x7efd640b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd695b5640 1 -- 172.21.15.28:0/2972300699 learned_addr learned my addr 172.21.15.28:0/2972300699 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd695b5640 1 -- 172.21.15.28:0/2972300699 >> v2:172.21.15.131:3300/0 conn(0x7efd640b4610 msgr2=0x7efd640b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd695b5640 1 --2- 172.21.15.28:0/2972300699 >> v2:172.21.15.131:3300/0 conn(0x7efd640b4610 0x7efd640b6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd695b5640 1 -- 172.21.15.28:0/2972300699 >> v1:172.21.15.131:6789/0 conn(0x7efd640b5dd0 legacy=0x7efd640b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.004 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.002+0000 7efd695b5640 1 -- 172.21.15.28:0/2972300699 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd64142940 con 0x7efd64142560 2023-11-28T19:32:04.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd695b5640 1 --2- 172.21.15.28:0/2972300699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd64142560 0x7efd640b40d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efd60009870 tx=0x7efd6001ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a0ca85a61d04c37 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:04.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd5bfff640 1 -- 172.21.15.28:0/2972300699 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600a8a30 con 0x7efd64142560 2023-11-28T19:32:04.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd5bfff640 1 -- 172.21.15.28:0/2972300699 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd600a8b90 con 0x7efd64142560 2023-11-28T19:32:04.006 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd5bfff640 1 -- 172.21.15.28:0/2972300699 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd600b0440 con 0x7efd64142560 2023-11-28T19:32:04.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 -- 172.21.15.28:0/2972300699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd64142560 msgr2=0x7efd640b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 --2- 172.21.15.28:0/2972300699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd64142560 0x7efd640b40d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efd60009870 tx=0x7efd6001ed30 comp rx=0 tx=0).stop 2023-11-28T19:32:04.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 -- 172.21.15.28:0/2972300699 shutdown_connections 2023-11-28T19:32:04.007 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 --2- 172.21.15.28:0/2972300699 >> v2:172.21.15.131:3300/0 conn(0x7efd640b4610 0x7efd640b6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 --2- 172.21.15.28:0/2972300699 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd64142560 0x7efd640b40d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 -- 172.21.15.28:0/2972300699 >> 172.21.15.28:0/2972300699 conn(0x7efd640bcb40 msgr2=0x7efd640bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 -- 172.21.15.28:0/2972300699 shutdown_connections 2023-11-28T19:32:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 -- 172.21.15.28:0/2972300699 wait complete. 2023-11-28T19:32:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 Processor -- start 2023-11-28T19:32:04.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 -- start start 2023-11-28T19:32:04.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd640b4610 0x7efd64146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd640b5dd0 0x7efd641e46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd64142560 0x7efd641e4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6413bed0 con 0x7efd640b5dd0 2023-11-28T19:32:04.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd64072500 con 0x7efd640b4610 2023-11-28T19:32:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd6b819640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd640727a0 con 0x7efd64142560 2023-11-28T19:32:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd68db4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd640b5dd0 0x7efd641e46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd68db4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd640b5dd0 0x7efd641e46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60956/0 (socket says 172.21.15.28:60956) 2023-11-28T19:32:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.006+0000 7efd68db4640 1 -- 172.21.15.28:0/4282807486 learned_addr learned my addr 172.21.15.28:0/4282807486 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd695b5640 1 --2- 172.21.15.28:0/4282807486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd640b4610 0x7efd64146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd69db6640 1 --2- 172.21.15.28:0/4282807486 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd64142560 0x7efd641e4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd68db4640 1 -- 172.21.15.28:0/4282807486 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd64142560 msgr2=0x7efd641e4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd68db4640 1 --2- 172.21.15.28:0/4282807486 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd64142560 0x7efd641e4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd68db4640 1 -- 172.21.15.28:0/4282807486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd640b4610 msgr2=0x7efd64146e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd68db4640 1 --2- 172.21.15.28:0/4282807486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd640b4610 0x7efd64146e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd68db4640 1 -- 172.21.15.28:0/4282807486 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd600094d0 con 0x7efd640b5dd0 2023-11-28T19:32:04.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd68db4640 1 --2- 172.21.15.28:0/4282807486 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd640b5dd0 0x7efd641e46d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c4d0 tx=0x7efd5400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd59ffb640 1 -- 172.21.15.28:0/4282807486 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd540052d0 con 0x7efd640b5dd0 2023-11-28T19:32:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd59ffb640 1 -- 172.21.15.28:0/4282807486 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd54005430 con 0x7efd640b5dd0 2023-11-28T19:32:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd6b819640 1 -- 172.21.15.28:0/4282807486 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd641e5210 con 0x7efd640b5dd0 2023-11-28T19:32:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd59ffb640 1 -- 172.21.15.28:0/4282807486 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd54012830 con 0x7efd640b5dd0 2023-11-28T19:32:04.012 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd6b819640 1 -- 172.21.15.28:0/4282807486 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6413c070 con 0x7efd640b5dd0 2023-11-28T19:32:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd6b819640 1 -- 172.21.15.28:0/4282807486 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd64074a90 con 0x7efd640b5dd0 2023-11-28T19:32:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd59ffb640 1 -- 172.21.15.28:0/4282807486 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efd54012990 con 0x7efd640b5dd0 2023-11-28T19:32:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd59ffb640 1 --2- 172.21.15.28:0/4282807486 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efd48066470 0x7efd48068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd59ffb640 1 -- 172.21.15.28:0/4282807486 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd540838c0 con 0x7efd640b5dd0 2023-11-28T19:32:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd695b5640 1 --2- 172.21.15.28:0/4282807486 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efd48066470 0x7efd48068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.013 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.010+0000 7efd695b5640 1 --2- 172.21.15.28:0/4282807486 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efd48066470 0x7efd48068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efd600b2000 tx=0x7efd60008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:04.016 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.014+0000 7efd59ffb640 1 -- 172.21.15.28:0/4282807486 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd54050dd0 con 0x7efd640b5dd0 2023-11-28T19:32:04.172 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.170+0000 7efd6b819640 1 -- 172.21.15.28:0/4282807486 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd640b9220 con 0x7efd640b5dd0 2023-11-28T19:32:04.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.174+0000 7efd59ffb640 1 -- 172.21.15.28:0/4282807486 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7efd540543f0 con 0x7efd640b5dd0 2023-11-28T19:32:04.175 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:04.175 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:32:04.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.174+0000 7efd6b819640 1 -- 172.21.15.28:0/4282807486 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efd48066470 msgr2=0x7efd48068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.174+0000 7efd6b819640 1 --2- 172.21.15.28:0/4282807486 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efd48066470 0x7efd48068930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7efd600b2000 tx=0x7efd60008040 comp rx=0 tx=0).stop 2023-11-28T19:32:04.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.174+0000 7efd6b819640 1 -- 172.21.15.28:0/4282807486 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd640b5dd0 msgr2=0x7efd641e46d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.174+0000 7efd6b819640 1 --2- 172.21.15.28:0/4282807486 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd640b5dd0 0x7efd641e46d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efd5400c4d0 tx=0x7efd5400c990 comp rx=0 tx=0).stop 2023-11-28T19:32:04.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.174+0000 7efd6b819640 1 -- 172.21.15.28:0/4282807486 shutdown_connections 2023-11-28T19:32:04.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.174+0000 7efd6b819640 1 --2- 172.21.15.28:0/4282807486 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efd48066470 0x7efd48068930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.174+0000 7efd6b819640 1 --2- 172.21.15.28:0/4282807486 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd64142560 0x7efd641e4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.174+0000 7efd6b819640 1 --2- 172.21.15.28:0/4282807486 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd640b5dd0 0x7efd641e46d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.174+0000 7efd6b819640 1 --2- 172.21.15.28:0/4282807486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd640b4610 0x7efd64146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.174+0000 7efd6b819640 1 -- 172.21.15.28:0/4282807486 >> 172.21.15.28:0/4282807486 conn(0x7efd640bcb40 msgr2=0x7efd6413dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:04.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.174+0000 7efd6b819640 1 -- 172.21.15.28:0/4282807486 shutdown_connections 2023-11-28T19:32:04.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.178+0000 7efd6b819640 1 -- 172.21.15.28:0/4282807486 wait complete. 2023-11-28T19:32:04.194 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:31:33.212362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:31:42.810956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:31:43.579438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T19:32:04.194 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:32:04.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffae0adb640 1 Processor -- start 2023-11-28T19:32:04.318 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffae0adb640 1 -- start start 2023-11-28T19:32:04.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffae0adb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffadc0bd340 0x7ffadc142120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.319 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffae0adb640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffadc0b4b60 0x7ffadc152a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffae0adb640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffadc0b6e90 con 0x7ffadc0728c0 2023-11-28T19:32:04.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffae0adb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffadc0b6560 con 0x7ffadc0bd340 2023-11-28T19:32:04.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffae0adb640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc0b6840 con 0x7ffadc0b4b60 2023-11-28T19:32:04.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffada59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffadc0bd340 0x7ffadc142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffada59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffadc0bd340 0x7ffadc142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60958/0 (socket says 172.21.15.28:60958) 2023-11-28T19:32:04.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffada59c640 1 -- 172.21.15.28:0/1365062816 learned_addr learned my addr 172.21.15.28:0/1365062816 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:04.320 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffadad9d640 1 --2- 172.21.15.28:0/1365062816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffadc0b4b60 0x7ffadc152a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffada59c640 1 -- 172.21.15.28:0/1365062816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffadc0b4b60 msgr2=0x7ffadc152a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:04.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffada59c640 1 --2- 172.21.15.28:0/1365062816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffadc0b4b60 0x7ffadc152a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffada59c640 1 -- 172.21.15.28:0/1365062816 >> v1:172.21.15.131:6789/0 conn(0x7ffadc0728c0 legacy=0x7ffadc0b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffada59c640 1 -- 172.21.15.28:0/1365062816 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc0b6b20 con 0x7ffadc0bd340 2023-11-28T19:32:04.321 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.318+0000 7ffadad9d640 1 --2- 172.21.15.28:0/1365062816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffadc0b4b60 0x7ffadc152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:04.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffada59c640 1 --2- 172.21.15.28:0/1365062816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffadc0bd340 0x7ffadc142120 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009870 tx=0x7ffacc01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0b2629b5c09dc7b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:04.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffad959a640 1 -- 172.21.15.28:0/1365062816 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0a8a30 con 0x7ffadc0bd340 2023-11-28T19:32:04.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffad959a640 1 -- 172.21.15.28:0/1365062816 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffacc0a8b90 con 0x7ffadc0bd340 2023-11-28T19:32:04.322 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffad959a640 1 -- 172.21.15.28:0/1365062816 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffacc0b0440 con 0x7ffadc0bd340 2023-11-28T19:32:04.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 -- 172.21.15.28:0/1365062816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffadc0bd340 msgr2=0x7ffadc142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 --2- 172.21.15.28:0/1365062816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffadc0bd340 0x7ffadc142120 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ffacc009870 tx=0x7ffacc01ed30 comp rx=0 tx=0).stop 2023-11-28T19:32:04.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 -- 172.21.15.28:0/1365062816 shutdown_connections 2023-11-28T19:32:04.323 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 --2- 172.21.15.28:0/1365062816 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffadc0b4b60 0x7ffadc152a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 --2- 172.21.15.28:0/1365062816 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffadc0bd340 0x7ffadc142120 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 -- 172.21.15.28:0/1365062816 >> 172.21.15.28:0/1365062816 conn(0x7ffadc06ab80 msgr2=0x7ffadc0bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:04.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 -- 172.21.15.28:0/1365062816 shutdown_connections 2023-11-28T19:32:04.324 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 -- 172.21.15.28:0/1365062816 wait complete. 2023-11-28T19:32:04.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 Processor -- start 2023-11-28T19:32:04.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 -- start start 2023-11-28T19:32:04.326 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffadc0728c0 0x7ffadc1d28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffadc0b4b60 0x7ffadc1e4be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffadc0bd340 0x7ffadc138b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc1d2e20 con 0x7ffadc0b4b60 2023-11-28T19:32:04.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc1e4750 con 0x7ffadc0bd340 2023-11-28T19:32:04.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffae0adb640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffadc146100 con 0x7ffadc0728c0 2023-11-28T19:32:04.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffad9d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffadc0b4b60 0x7ffadc1e4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffad9d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffadc0b4b60 0x7ffadc1e4be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60962/0 (socket says 172.21.15.28:60962) 2023-11-28T19:32:04.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffad9d9b640 1 -- 172.21.15.28:0/2409718777 learned_addr learned my addr 172.21.15.28:0/2409718777 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:04.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffada59c640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffadc0728c0 0x7ffadc1d28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.322+0000 7ffadad9d640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffadc0bd340 0x7ffadc138b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffad9d9b640 1 -- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffadc0728c0 msgr2=0x7ffadc1d28e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffad9d9b640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffadc0728c0 0x7ffadc1d28e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffad9d9b640 1 -- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffadc0bd340 msgr2=0x7ffadc138b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffad9d9b640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffadc0bd340 0x7ffadc138b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.328 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffad9d9b640 1 -- 172.21.15.28:0/2409718777 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffacc0094d0 con 0x7ffadc0b4b60 2023-11-28T19:32:04.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffada59c640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffadc0728c0 0x7ffadc1d28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:04.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffad9d9b640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffadc0b4b60 0x7ffadc1e4be0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffad000c4d0 tx=0x7ffad000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:04.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffacaffd640 1 -- 172.21.15.28:0/2409718777 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad00052d0 con 0x7ffadc0b4b60 2023-11-28T19:32:04.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffacaffd640 1 -- 172.21.15.28:0/2409718777 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffad0005430 con 0x7ffadc0b4b60 2023-11-28T19:32:04.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffacaffd640 1 -- 172.21.15.28:0/2409718777 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad0012830 con 0x7ffadc0b4b60 2023-11-28T19:32:04.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffae0adb640 1 -- 172.21.15.28:0/2409718777 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffadc0b9000 con 0x7ffadc0b4b60 2023-11-28T19:32:04.329 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffae0adb640 1 -- 172.21.15.28:0/2409718777 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffadc1e5120 con 0x7ffadc0b4b60 2023-11-28T19:32:04.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffae0adb640 1 -- 172.21.15.28:0/2409718777 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffadc074a90 con 0x7ffadc0b4b60 2023-11-28T19:32:04.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffacaffd640 1 -- 172.21.15.28:0/2409718777 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffad0012990 con 0x7ffadc0b4b60 2023-11-28T19:32:04.330 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffacaffd640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ffabc066470 0x7ffabc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffacaffd640 1 -- 172.21.15.28:0/2409718777 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffad0083a50 con 0x7ffadc0b4b60 2023-11-28T19:32:04.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffada59c640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ffabc066470 0x7ffabc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.331 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.326+0000 7ffada59c640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ffabc066470 0x7ffabc068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0b2000 tx=0x7ffacc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:04.333 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.330+0000 7ffacaffd640 1 -- 172.21.15.28:0/2409718777 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffad0050e30 con 0x7ffadc0b4b60 2023-11-28T19:32:04.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.486+0000 7ffae0adb640 1 -- 172.21.15.28:0/2409718777 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffadc13c830 con 0x7ffadc0b4b60 2023-11-28T19:32:04.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.490+0000 7ffacaffd640 1 -- 172.21.15.28:0/2409718777 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffad0054450 con 0x7ffadc0b4b60 2023-11-28T19:32:04.490 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-28T19:32:04.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.490+0000 7ffae0adb640 1 -- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ffabc066470 msgr2=0x7ffabc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.490+0000 7ffae0adb640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ffabc066470 0x7ffabc068930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ffacc0b2000 tx=0x7ffacc008040 comp rx=0 tx=0).stop 2023-11-28T19:32:04.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.490+0000 7ffae0adb640 1 -- 172.21.15.28:0/2409718777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffadc0b4b60 msgr2=0x7ffadc1e4be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.490+0000 7ffae0adb640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffadc0b4b60 0x7ffadc1e4be0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ffad000c4d0 tx=0x7ffad000c990 comp rx=0 tx=0).stop 2023-11-28T19:32:04.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.490+0000 7ffae0adb640 1 -- 172.21.15.28:0/2409718777 shutdown_connections 2023-11-28T19:32:04.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.490+0000 7ffae0adb640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ffabc066470 0x7ffabc068930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.490+0000 7ffae0adb640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffadc0bd340 0x7ffadc138b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.490+0000 7ffae0adb640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffadc0b4b60 0x7ffadc1e4be0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.490+0000 7ffae0adb640 1 --2- 172.21.15.28:0/2409718777 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffadc0728c0 0x7ffadc1d28e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.490+0000 7ffae0adb640 1 -- 172.21.15.28:0/2409718777 >> 172.21.15.28:0/2409718777 conn(0x7ffadc06ab80 msgr2=0x7ffadc0b8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:04.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.490+0000 7ffae0adb640 1 -- 172.21.15.28:0/2409718777 shutdown_connections 2023-11-28T19:32:04.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.490+0000 7ffae0adb640 1 -- 172.21.15.28:0/2409718777 wait complete. 2023-11-28T19:32:04.508 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:32:04.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.622+0000 7f8864fd4640 1 Processor -- start 2023-11-28T19:32:04.625 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.622+0000 7f8864fd4640 1 -- start start 2023-11-28T19:32:04.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f8864fd4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f886006ab60 0x7f886014b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.626 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f8864fd4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88600bbad0 0x7f88600a6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f8864fd4640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88600bce60 con 0x7f886006af40 2023-11-28T19:32:04.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f8864fd4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88600bd5d0 con 0x7f886006ab60 2023-11-28T19:32:04.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f8864fd4640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88600a6b70 con 0x7f88600bbad0 2023-11-28T19:32:04.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f885e59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f886006ab60 0x7f886014b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f885e59c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f886006ab60 0x7f886014b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60978/0 (socket says 172.21.15.28:60978) 2023-11-28T19:32:04.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f885e59c640 1 -- 172.21.15.28:0/1702664792 learned_addr learned my addr 172.21.15.28:0/1702664792 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:04.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f885dd9b640 1 --2- 172.21.15.28:0/1702664792 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88600bbad0 0x7f88600a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f885e59c640 1 -- 172.21.15.28:0/1702664792 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88600bbad0 msgr2=0x7f88600a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:04.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f885e59c640 1 --2- 172.21.15.28:0/1702664792 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88600bbad0 0x7f88600a6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f885e59c640 1 -- 172.21.15.28:0/1702664792 >> v1:172.21.15.131:6789/0 conn(0x7f886006af40 legacy=0x7f886014eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.627 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f885e59c640 1 -- 172.21.15.28:0/1702664792 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88600bff70 con 0x7f886006ab60 2023-11-28T19:32:04.628 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f885dd9b640 1 --2- 172.21.15.28:0/1702664792 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88600bbad0 0x7f88600a6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:04.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f885e59c640 1 --2- 172.21.15.28:0/1702664792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f886006ab60 0x7f886014b5f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8854009870 tx=0x7f885401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c43e5df8a4281cf server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:04.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f885d59a640 1 -- 172.21.15.28:0/1702664792 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88540ab620 con 0x7f886006ab60 2023-11-28T19:32:04.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f885d59a640 1 -- 172.21.15.28:0/1702664792 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88540ab780 con 0x7f886006ab60 2023-11-28T19:32:04.629 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.626+0000 7f885d59a640 1 -- 172.21.15.28:0/1702664792 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88540abb10 con 0x7f886006ab60 2023-11-28T19:32:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 -- 172.21.15.28:0/1702664792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f886006ab60 msgr2=0x7f886014b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 --2- 172.21.15.28:0/1702664792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f886006ab60 0x7f886014b5f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f8854009870 tx=0x7f885401c510 comp rx=0 tx=0).stop 2023-11-28T19:32:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 -- 172.21.15.28:0/1702664792 shutdown_connections 2023-11-28T19:32:04.630 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 --2- 172.21.15.28:0/1702664792 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f88600bbad0 0x7f88600a6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 --2- 172.21.15.28:0/1702664792 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f886006ab60 0x7f886014b5f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 -- 172.21.15.28:0/1702664792 >> 172.21.15.28:0/1702664792 conn(0x7f88600c0c90 msgr2=0x7f88600c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:04.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 -- 172.21.15.28:0/1702664792 shutdown_connections 2023-11-28T19:32:04.631 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 -- 172.21.15.28:0/1702664792 wait complete. 2023-11-28T19:32:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 Processor -- start 2023-11-28T19:32:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 -- start start 2023-11-28T19:32:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f886006ab60 0x7f8860147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f886006af40 0x7f88601e80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88600bbad0 0x7f8860142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8860147f40 con 0x7f886006ab60 2023-11-28T19:32:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88601e7950 con 0x7f88600bbad0 2023-11-28T19:32:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8860149a90 con 0x7f886006af40 2023-11-28T19:32:04.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f885e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f886006ab60 0x7f8860147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f885e59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f886006ab60 0x7f8860147a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60982/0 (socket says 172.21.15.28:60982) 2023-11-28T19:32:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f885e59c640 1 -- 172.21.15.28:0/3039160522 learned_addr learned my addr 172.21.15.28:0/3039160522 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f885dd9b640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f886006af40 0x7f88601e80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f885ed9d640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88600bbad0 0x7f8860142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f885e59c640 1 -- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f886006af40 msgr2=0x7f88601e80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f885e59c640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f886006af40 0x7f88601e80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f885e59c640 1 -- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88600bbad0 msgr2=0x7f8860142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f885e59c640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88600bbad0 0x7f8860142b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f885e59c640 1 -- 172.21.15.28:0/3039160522 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88540094d0 con 0x7f886006ab60 2023-11-28T19:32:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f885dd9b640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f886006af40 0x7f88601e80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:04.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f885e59c640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f886006ab60 0x7f8860147a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f885401a140 tx=0x7f885401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f884effd640 1 -- 172.21.15.28:0/3039160522 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88540be3f0 con 0x7f886006ab60 2023-11-28T19:32:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f884effd640 1 -- 172.21.15.28:0/3039160522 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88540be570 con 0x7f886006ab60 2023-11-28T19:32:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 -- 172.21.15.28:0/3039160522 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88601e7bc0 con 0x7f886006ab60 2023-11-28T19:32:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f884effd640 1 -- 172.21.15.28:0/3039160522 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88540be920 con 0x7f886006ab60 2023-11-28T19:32:04.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.630+0000 7f8864fd4640 1 -- 172.21.15.28:0/3039160522 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8860143ba0 con 0x7f886006ab60 2023-11-28T19:32:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.634+0000 7f8864fd4640 1 -- 172.21.15.28:0/3039160522 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88601e7e00 con 0x7f886006ab60 2023-11-28T19:32:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.634+0000 7f884effd640 1 -- 172.21.15.28:0/3039160522 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f88540b43f0 con 0x7f886006ab60 2023-11-28T19:32:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.634+0000 7f884effd640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8840066470 0x7f8840068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.634+0000 7f884effd640 1 -- 172.21.15.28:0/3039160522 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f885411e560 con 0x7f886006ab60 2023-11-28T19:32:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.634+0000 7f885dd9b640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8840066470 0x7f8840068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.634+0000 7f885dd9b640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8840066470 0x7f8840068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8860149280 tx=0x7f8850008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:04.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.638+0000 7f884effd640 1 -- 172.21.15.28:0/3039160522 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f88540eb9e0 con 0x7f886006ab60 2023-11-28T19:32:04.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.786+0000 7f8864fd4640 1 -- 172.21.15.28:0/3039160522 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8860074a90 con 0x7f886006ab60 2023-11-28T19:32:04.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.786+0000 7f884effd640 1 -- 172.21.15.28:0/3039160522 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88540ef000 con 0x7f886006ab60 2023-11-28T19:32:04.788 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-28T19:32:04.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.790+0000 7f8864fd4640 1 -- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8840066470 msgr2=0x7f8840068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.790+0000 7f8864fd4640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8840066470 0x7f8840068930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8860149280 tx=0x7f8850008040 comp rx=0 tx=0).stop 2023-11-28T19:32:04.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.790+0000 7f8864fd4640 1 -- 172.21.15.28:0/3039160522 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f886006ab60 msgr2=0x7f8860147a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.790+0000 7f8864fd4640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f886006ab60 0x7f8860147a00 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f885401a140 tx=0x7f885401ad50 comp rx=0 tx=0).stop 2023-11-28T19:32:04.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.790+0000 7f8864fd4640 1 -- 172.21.15.28:0/3039160522 shutdown_connections 2023-11-28T19:32:04.790 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.790+0000 7f8864fd4640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8840066470 0x7f8840068930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.790+0000 7f8864fd4640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f88600bbad0 0x7f8860142b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.790+0000 7f8864fd4640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f886006af40 0x7f88601e80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.790+0000 7f8864fd4640 1 --2- 172.21.15.28:0/3039160522 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f886006ab60 0x7f8860147a00 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.790+0000 7f8864fd4640 1 -- 172.21.15.28:0/3039160522 >> 172.21.15.28:0/3039160522 conn(0x7f88600c0c90 msgr2=0x7f88600a1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:04.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.790+0000 7f8864fd4640 1 -- 172.21.15.28:0/3039160522 shutdown_connections 2023-11-28T19:32:04.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.790+0000 7f8864fd4640 1 -- 172.21.15.28:0/3039160522 wait complete. 2023-11-28T19:32:04.805 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:32:04.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc03a51e640 1 Processor -- start 2023-11-28T19:32:04.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc03a51e640 1 -- start start 2023-11-28T19:32:04.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc03a51e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc0340baa30 0x7fc0340bb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc03a51e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc034071f20 0x7fc03406f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc03a51e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc034072340 con 0x7fc03406fb40 2023-11-28T19:32:04.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc03a51e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc03406f1e0 con 0x7fc0340baa30 2023-11-28T19:32:04.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc03a51e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0341491d0 con 0x7fc034071f20 2023-11-28T19:32:04.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc033fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc0340baa30 0x7fc0340bb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc033fff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc0340baa30 0x7fc0340bb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60986/0 (socket says 172.21.15.28:60986) 2023-11-28T19:32:04.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc033fff640 1 -- 172.21.15.28:0/383311914 learned_addr learned my addr 172.21.15.28:0/383311914 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:04.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc0337fe640 1 --2- 172.21.15.28:0/383311914 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc034071f20 0x7fc03406f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc033fff640 1 -- 172.21.15.28:0/383311914 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc034071f20 msgr2=0x7fc03406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:04.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc033fff640 1 --2- 172.21.15.28:0/383311914 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc034071f20 0x7fc03406f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc033fff640 1 -- 172.21.15.28:0/383311914 >> v1:172.21.15.131:6789/0 conn(0x7fc03406fb40 legacy=0x7fc034143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc033fff640 1 -- 172.21.15.28:0/383311914 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0340b5830 con 0x7fc0340baa30 2023-11-28T19:32:04.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc033fff640 1 --2- 172.21.15.28:0/383311914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0340baa30 0x7fc0340bb2d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc024009870 tx=0x7fc02401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1953dd7f3cccfe8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:04.937 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.934+0000 7fc032ffd640 1 -- 172.21.15.28:0/383311914 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0240a8a30 con 0x7fc0340baa30 2023-11-28T19:32:04.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc032ffd640 1 -- 172.21.15.28:0/383311914 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0240a8b90 con 0x7fc0340baa30 2023-11-28T19:32:04.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc032ffd640 1 -- 172.21.15.28:0/383311914 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0240b0440 con 0x7fc0340baa30 2023-11-28T19:32:04.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 -- 172.21.15.28:0/383311914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0340baa30 msgr2=0x7fc0340bb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 --2- 172.21.15.28:0/383311914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0340baa30 0x7fc0340bb2d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc024009870 tx=0x7fc02401ed30 comp rx=0 tx=0).stop 2023-11-28T19:32:04.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 -- 172.21.15.28:0/383311914 shutdown_connections 2023-11-28T19:32:04.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 --2- 172.21.15.28:0/383311914 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc034071f20 0x7fc03406f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 --2- 172.21.15.28:0/383311914 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc0340baa30 0x7fc0340bb2d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 -- 172.21.15.28:0/383311914 >> 172.21.15.28:0/383311914 conn(0x7fc034071400 msgr2=0x7fc034071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:04.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 -- 172.21.15.28:0/383311914 shutdown_connections 2023-11-28T19:32:04.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 -- 172.21.15.28:0/383311914 wait complete. 2023-11-28T19:32:04.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 Processor -- start 2023-11-28T19:32:04.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 -- start start 2023-11-28T19:32:04.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc03406fb40 0x7fc03413e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc034071f20 0x7fc03406b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0340baa30 0x7fc034145a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03413e6b0 con 0x7fc034071f20 2023-11-28T19:32:04.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc03406d700 con 0x7fc0340baa30 2023-11-28T19:32:04.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0340b7d30 con 0x7fc03406fb40 2023-11-28T19:32:04.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc0337fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc034071f20 0x7fc03406b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc0337fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc034071f20 0x7fc03406b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60994/0 (socket says 172.21.15.28:60994) 2023-11-28T19:32:04.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc0337fe640 1 -- 172.21.15.28:0/1076186217 learned_addr learned my addr 172.21.15.28:0/1076186217 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:04.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc038abb640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0340baa30 0x7fc034145a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc033fff640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc03406fb40 0x7fc03413e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc0337fe640 1 -- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc03406fb40 msgr2=0x7fc03413e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc0337fe640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc03406fb40 0x7fc03413e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc0337fe640 1 -- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0340baa30 msgr2=0x7fc034145a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:04.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc0337fe640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0340baa30 0x7fc034145a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:04.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc0337fe640 1 -- 172.21.15.28:0/1076186217 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0240094d0 con 0x7fc034071f20 2023-11-28T19:32:04.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc038abb640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0340baa30 0x7fc034145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:04.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc0337fe640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc034071f20 0x7fc03406b690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc02800d830 tx=0x7fc02800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:04.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc030ff9640 1 -- 172.21.15.28:0/1076186217 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02800b6c0 con 0x7fc034071f20 2023-11-28T19:32:04.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc030ff9640 1 -- 172.21.15.28:0/1076186217 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc02800b860 con 0x7fc034071f20 2023-11-28T19:32:04.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 -- 172.21.15.28:0/1076186217 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc03406cfb0 con 0x7fc034071f20 2023-11-28T19:32:04.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc030ff9640 1 -- 172.21.15.28:0/1076186217 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc02800bc10 con 0x7fc034071f20 2023-11-28T19:32:04.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.938+0000 7fc03a51e640 1 -- 172.21.15.28:0/1076186217 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0341e0da0 con 0x7fc034071f20 2023-11-28T19:32:04.944 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.942+0000 7fc03a51e640 1 -- 172.21.15.28:0/1076186217 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc034074a90 con 0x7fc034071f20 2023-11-28T19:32:04.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.942+0000 7fc030ff9640 1 -- 172.21.15.28:0/1076186217 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc02801e460 con 0x7fc034071f20 2023-11-28T19:32:04.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.942+0000 7fc030ff9640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc020066470 0x7fc020068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:04.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.942+0000 7fc030ff9640 1 -- 172.21.15.28:0/1076186217 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0280851a0 con 0x7fc034071f20 2023-11-28T19:32:04.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.942+0000 7fc033fff640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc020066470 0x7fc020068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:04.945 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.942+0000 7fc033fff640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc020066470 0x7fc020068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc0240b2000 tx=0x7fc024008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:04.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:04.946+0000 7fc030ff9640 1 -- 172.21.15.28:0/1076186217 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc0280525f0 con 0x7fc034071f20 2023-11-28T19:32:05.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.102+0000 7fc03a51e640 1 -- 172.21.15.28:0/1076186217 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc034146b80 con 0x7fc034071f20 2023-11-28T19:32:05.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.102+0000 7fc030ff9640 1 -- 172.21.15.28:0/1076186217 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc028055c10 con 0x7fc034071f20 2023-11-28T19:32:05.102 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-28T19:32:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.102+0000 7fc03a51e640 1 -- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc020066470 msgr2=0x7fc020068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.102+0000 7fc03a51e640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc020066470 0x7fc020068930 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fc0240b2000 tx=0x7fc024008040 comp rx=0 tx=0).stop 2023-11-28T19:32:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.102+0000 7fc03a51e640 1 -- 172.21.15.28:0/1076186217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc034071f20 msgr2=0x7fc03406b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.102+0000 7fc03a51e640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc034071f20 0x7fc03406b690 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc02800d830 tx=0x7fc02800dcf0 comp rx=0 tx=0).stop 2023-11-28T19:32:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.102+0000 7fc03a51e640 1 -- 172.21.15.28:0/1076186217 shutdown_connections 2023-11-28T19:32:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.102+0000 7fc03a51e640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc020066470 0x7fc020068930 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.102+0000 7fc03a51e640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0340baa30 0x7fc034145a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.102+0000 7fc03a51e640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc034071f20 0x7fc03406b690 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.102+0000 7fc03a51e640 1 --2- 172.21.15.28:0/1076186217 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc03406fb40 0x7fc03413e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:05.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.102+0000 7fc03a51e640 1 -- 172.21.15.28:0/1076186217 >> 172.21.15.28:0/1076186217 conn(0x7fc034071400 msgr2=0x7fc0340bb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:05.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.102+0000 7fc03a51e640 1 -- 172.21.15.28:0/1076186217 shutdown_connections 2023-11-28T19:32:05.106 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.102+0000 7fc03a51e640 1 -- 172.21.15.28:0/1076186217 wait complete. 2023-11-28T19:32:05.123 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-11-28T19:32:05.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b5dbb8640 1 Processor -- start 2023-11-28T19:32:05.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b5dbb8640 1 -- start start 2023-11-28T19:32:05.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b5dbb8640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0b5806aaf0 0x7f0b5806aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:05.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b5dbb8640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0b5814ac70 0x7f0b5814b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:05.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b5dbb8640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b580bd5e0 con 0x7f0b5814b0b0 2023-11-28T19:32:05.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b5dbb8640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b580bc1c0 con 0x7f0b5814ac70 2023-11-28T19:32:05.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b5dbb8640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b5806bca0 con 0x7f0b5806aaf0 2023-11-28T19:32:05.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b56ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f0b5814ac70 0x7f0b5814b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:05.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b57fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0b5814b0b0 0x7f0b5814ea70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:42484/0 (socket says 172.21.15.28:42484) 2023-11-28T19:32:05.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b57fff640 1 -- 172.21.15.28:0/2769368791 learned_addr learned my addr 172.21.15.28:0/2769368791 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:05.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b577fe640 1 --2- 172.21.15.28:0/2769368791 >> v2:172.21.15.131:3300/0 conn(0x7f0b5806aaf0 0x7f0b5806aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:05.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b56ffd640 1 -- 172.21.15.28:0/2769368791 >> v2:172.21.15.131:3300/0 conn(0x7f0b5806aaf0 msgr2=0x7f0b5806aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:05.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b56ffd640 1 --2- 172.21.15.28:0/2769368791 >> v2:172.21.15.131:3300/0 conn(0x7f0b5806aaf0 0x7f0b5806aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:05.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b56ffd640 1 -- 172.21.15.28:0/2769368791 >> v1:172.21.15.28:6789/0 conn(0x7f0b5814b0b0 legacy=0x7f0b5814ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:05.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b56ffd640 1 -- 172.21.15.28:0/2769368791 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5806b7a0 con 0x7f0b5814ac70 2023-11-28T19:32:05.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b567fc640 1 -- 172.21.15.28:0/2769368791 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020118513 0 0) 0x7f0b580bd5e0 con 0x7f0b5814b0b0 2023-11-28T19:32:05.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b577fe640 1 --2- 172.21.15.28:0/2769368791 >> v2:172.21.15.131:3300/0 conn(0x7f0b5806aaf0 0x7f0b5806aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:05.245 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.242+0000 7f0b56ffd640 1 --2- 172.21.15.28:0/2769368791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b5814ac70 0x7f0b5814b6e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0b5804f2b0 tx=0x7f0b4c01c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2904be65c8cda736 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:05.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b567fc640 1 -- 172.21.15.28:0/2769368791 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0ab610 con 0x7f0b5814ac70 2023-11-28T19:32:05.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b567fc640 1 -- 172.21.15.28:0/2769368791 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b4c0ab770 con 0x7f0b5814ac70 2023-11-28T19:32:05.246 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b567fc640 1 -- 172.21.15.28:0/2769368791 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b4c0abb00 con 0x7f0b5814ac70 2023-11-28T19:32:05.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2769368791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b5814ac70 msgr2=0x7f0b5814b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:05.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 --2- 172.21.15.28:0/2769368791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b5814ac70 0x7f0b5814b6e0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0b5804f2b0 tx=0x7f0b4c01c430 comp rx=0 tx=0).stop 2023-11-28T19:32:05.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2769368791 shutdown_connections 2023-11-28T19:32:05.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 --2- 172.21.15.28:0/2769368791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b5814ac70 0x7f0b5814b6e0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:05.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 --2- 172.21.15.28:0/2769368791 >> v2:172.21.15.131:3300/0 conn(0x7f0b5806aaf0 0x7f0b5806aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:05.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2769368791 >> 172.21.15.28:0/2769368791 conn(0x7f0b580bd790 msgr2=0x7f0b580bdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:05.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2769368791 shutdown_connections 2023-11-28T19:32:05.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2769368791 wait complete. 2023-11-28T19:32:05.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 Processor -- start 2023-11-28T19:32:05.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 -- start start 2023-11-28T19:32:05.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b5806aaf0 0x7f0b581e7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:05.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b5814ac70 0x7f0b581480a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:05.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b5814b0b0 0x7f0b58141f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:05.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b581e3ef0 con 0x7f0b5814b0b0 2023-11-28T19:32:05.250 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b581485e0 con 0x7f0b5806aaf0 2023-11-28T19:32:05.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b581424a0 con 0x7f0b5814ac70 2023-11-28T19:32:05.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b5814b0b0 0x7f0b58141f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:05.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b5814b0b0 0x7f0b58141f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:32776/0 (socket says 172.21.15.28:32776) 2023-11-28T19:32:05.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b57fff640 1 -- 172.21.15.28:0/2863902820 learned_addr learned my addr 172.21.15.28:0/2863902820 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:05.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b56ffd640 1 --2- 172.21.15.28:0/2863902820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b5814ac70 0x7f0b581480a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:05.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b577fe640 1 --2- 172.21.15.28:0/2863902820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b5806aaf0 0x7f0b581e7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:05.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b57fff640 1 -- 172.21.15.28:0/2863902820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b5814ac70 msgr2=0x7f0b581480a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:05.251 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b57fff640 1 --2- 172.21.15.28:0/2863902820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b5814ac70 0x7f0b581480a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:05.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b57fff640 1 -- 172.21.15.28:0/2863902820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b5806aaf0 msgr2=0x7f0b581e7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:05.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b57fff640 1 --2- 172.21.15.28:0/2863902820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b5806aaf0 0x7f0b581e7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:05.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b57fff640 1 -- 172.21.15.28:0/2863902820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b4c009420 con 0x7f0b5814b0b0 2023-11-28T19:32:05.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b57fff640 1 --2- 172.21.15.28:0/2863902820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b5814b0b0 0x7f0b58141f60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000c780 tx=0x7f0b5000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:05.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b3ffff640 1 -- 172.21.15.28:0/2863902820 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5000ce90 con 0x7f0b5814b0b0 2023-11-28T19:32:05.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b3ffff640 1 -- 172.21.15.28:0/2863902820 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b5000a5e0 con 0x7f0b5814b0b0 2023-11-28T19:32:05.252 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b3ffff640 1 -- 172.21.15.28:0/2863902820 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5000a950 con 0x7f0b5814b0b0 2023-11-28T19:32:05.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2863902820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b581e3ba0 con 0x7f0b5814b0b0 2023-11-28T19:32:05.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.246+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2863902820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b581e7e20 con 0x7f0b5814b0b0 2023-11-28T19:32:05.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.250+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2863902820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b581e4030 con 0x7f0b5814b0b0 2023-11-28T19:32:05.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.250+0000 7f0b3ffff640 1 -- 172.21.15.28:0/2863902820 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0b5000aab0 con 0x7f0b5814b0b0 2023-11-28T19:32:05.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.250+0000 7f0b3ffff640 1 --2- 172.21.15.28:0/2863902820 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0b44066470 0x7f0b44068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:05.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.250+0000 7f0b3ffff640 1 -- 172.21.15.28:0/2863902820 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b50083280 con 0x7f0b5814b0b0 2023-11-28T19:32:05.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.250+0000 7f0b577fe640 1 --2- 172.21.15.28:0/2863902820 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0b44066470 0x7f0b44068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:05.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.250+0000 7f0b577fe640 1 --2- 172.21.15.28:0/2863902820 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0b44066470 0x7f0b44068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800a9a0 tx=0x7f0b48008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:05.256 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.254+0000 7f0b3ffff640 1 -- 172.21.15.28:0/2863902820 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b581e4030 con 0x7f0b5814b0b0 2023-11-28T19:32:05.472 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:05.470+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2863902820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f0b581e4030 con 0x7f0b5814b0b0 2023-11-28T19:32:06.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.378+0000 7f0b3ffff640 1 -- 172.21.15.28:0/2863902820 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v45) v1 ==== 166+0+0 (secure 0 0 0) 0x7f0b581e4030 con 0x7f0b5814b0b0 2023-11-28T19:32:06.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.382+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2863902820 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0b44066470 msgr2=0x7f0b44068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:06.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.382+0000 7f0b5dbb8640 1 --2- 172.21.15.28:0/2863902820 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0b44066470 0x7f0b44068930 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800a9a0 tx=0x7f0b48008040 comp rx=0 tx=0).stop 2023-11-28T19:32:06.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.382+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2863902820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b5814b0b0 msgr2=0x7f0b58141f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:06.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.382+0000 7f0b5dbb8640 1 --2- 172.21.15.28:0/2863902820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b5814b0b0 0x7f0b58141f60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0b5000c780 tx=0x7f0b5000cc40 comp rx=0 tx=0).stop 2023-11-28T19:32:06.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.382+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2863902820 shutdown_connections 2023-11-28T19:32:06.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.382+0000 7f0b5dbb8640 1 --2- 172.21.15.28:0/2863902820 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0b44066470 0x7f0b44068930 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:06.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.382+0000 7f0b5dbb8640 1 --2- 172.21.15.28:0/2863902820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b5814b0b0 0x7f0b58141f60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:06.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.382+0000 7f0b5dbb8640 1 --2- 172.21.15.28:0/2863902820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b5814ac70 0x7f0b581480a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:06.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.382+0000 7f0b5dbb8640 1 --2- 172.21.15.28:0/2863902820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b5806aaf0 0x7f0b581e7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:06.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.382+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2863902820 >> 172.21.15.28:0/2863902820 conn(0x7f0b580bd790 msgr2=0x7f0b580bf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:06.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.382+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2863902820 shutdown_connections 2023-11-28T19:32:06.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.382+0000 7f0b5dbb8640 1 -- 172.21.15.28:0/2863902820 wait complete. 2023-11-28T19:32:06.406 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-11-28T19:32:06.538 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab522a9640 1 Processor -- start 2023-11-28T19:32:06.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab522a9640 1 -- start start 2023-11-28T19:32:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab522a9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab4c0bc120 0x7fab4c0bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab522a9640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fab4c072940 0x7fab4c153c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:06.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab522a9640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab4c143b60 con 0x7fab4c0a2d60 2023-11-28T19:32:06.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab522a9640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab4c0b6f30 con 0x7fab4c072940 2023-11-28T19:32:06.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab522a9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0b7aa0 con 0x7fab4c0bc120 2023-11-28T19:32:06.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab50846640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fab4c072940 0x7fab4c153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:06.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab50846640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fab4c072940 0x7fab4c153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55876/0 (socket says 172.21.15.28:55876) 2023-11-28T19:32:06.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab50846640 1 -- 172.21.15.28:0/643355749 learned_addr learned my addr 172.21.15.28:0/643355749 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:06.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab4bfff640 1 --2- 172.21.15.28:0/643355749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab4c0bc120 0x7fab4c0bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:06.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab50846640 1 -- 172.21.15.28:0/643355749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab4c0bc120 msgr2=0x7fab4c0bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:06.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab50846640 1 --2- 172.21.15.28:0/643355749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab4c0bc120 0x7fab4c0bd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:06.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab50846640 1 -- 172.21.15.28:0/643355749 >> v1:172.21.15.131:6789/0 conn(0x7fab4c0a2d60 legacy=0x7fab4c14c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:06.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab50846640 1 -- 172.21.15.28:0/643355749 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab4c0b7d60 con 0x7fab4c072940 2023-11-28T19:32:06.542 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab4bfff640 1 --2- 172.21.15.28:0/643355749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab4c0bc120 0x7fab4c0bd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.538+0000 7fab50846640 1 --2- 172.21.15.28:0/643355749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab4c072940 0x7fab4c153c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fab44009e50 tx=0x7fab4401f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb40bd7c41e76b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab4affd640 1 -- 172.21.15.28:0/643355749 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440af400 con 0x7fab4c072940 2023-11-28T19:32:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab4affd640 1 -- 172.21.15.28:0/643355749 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab440ab050 con 0x7fab4c072940 2023-11-28T19:32:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab4affd640 1 -- 172.21.15.28:0/643355749 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440af780 con 0x7fab4c072940 2023-11-28T19:32:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 -- 172.21.15.28:0/643355749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab4c072940 msgr2=0x7fab4c153c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 --2- 172.21.15.28:0/643355749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab4c072940 0x7fab4c153c80 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fab44009e50 tx=0x7fab4401f1c0 comp rx=0 tx=0).stop 2023-11-28T19:32:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 -- 172.21.15.28:0/643355749 shutdown_connections 2023-11-28T19:32:06.543 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 --2- 172.21.15.28:0/643355749 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab4c072940 0x7fab4c153c80 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:06.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 --2- 172.21.15.28:0/643355749 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab4c0bc120 0x7fab4c0bd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:06.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 -- 172.21.15.28:0/643355749 >> 172.21.15.28:0/643355749 conn(0x7fab4c06ab80 msgr2=0x7fab4c0bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:06.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 -- 172.21.15.28:0/643355749 shutdown_connections 2023-11-28T19:32:06.544 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 -- 172.21.15.28:0/643355749 wait complete. 2023-11-28T19:32:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 Processor -- start 2023-11-28T19:32:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 -- start start 2023-11-28T19:32:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab4c072940 0x7fab4c09ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab4c0a2d60 0x7fab4c1e1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab4c0bc120 0x7fab4c142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0b1e60 con 0x7fab4c0bc120 2023-11-28T19:32:06.546 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c0a0d30 con 0x7fab4c0a2d60 2023-11-28T19:32:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab4c1e0c20 con 0x7fab4c072940 2023-11-28T19:32:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab50846640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab4c0bc120 0x7fab4c142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab50846640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab4c0bc120 0x7fab4c142790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55880/0 (socket says 172.21.15.28:55880) 2023-11-28T19:32:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab50846640 1 -- 172.21.15.28:0/3741680942 learned_addr learned my addr 172.21.15.28:0/3741680942 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab4b7fe640 1 --2- 172.21.15.28:0/3741680942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab4c0a2d60 0x7fab4c1e1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab4bfff640 1 --2- 172.21.15.28:0/3741680942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab4c072940 0x7fab4c09ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab50846640 1 -- 172.21.15.28:0/3741680942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab4c072940 msgr2=0x7fab4c09ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab50846640 1 --2- 172.21.15.28:0/3741680942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab4c072940 0x7fab4c09ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab50846640 1 -- 172.21.15.28:0/3741680942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab4c0a2d60 msgr2=0x7fab4c1e1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab50846640 1 --2- 172.21.15.28:0/3741680942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab4c0a2d60 0x7fab4c1e1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab50846640 1 -- 172.21.15.28:0/3741680942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab44009b30 con 0x7fab4c0bc120 2023-11-28T19:32:06.547 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab50846640 1 --2- 172.21.15.28:0/3741680942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab4c0bc120 0x7fab4c142790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fab440b2040 tx=0x7fab4401bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:06.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab48ff9640 1 -- 172.21.15.28:0/3741680942 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440afde0 con 0x7fab4c0bc120 2023-11-28T19:32:06.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab48ff9640 1 -- 172.21.15.28:0/3741680942 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab44009510 con 0x7fab4c0bc120 2023-11-28T19:32:06.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 -- 172.21.15.28:0/3741680942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab4c1e0f00 con 0x7fab4c0bc120 2023-11-28T19:32:06.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab48ff9640 1 -- 172.21.15.28:0/3741680942 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab440ba660 con 0x7fab4c0bc120 2023-11-28T19:32:06.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.542+0000 7fab522a9640 1 -- 172.21.15.28:0/3741680942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab4c0a1c40 con 0x7fab4c0bc120 2023-11-28T19:32:06.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.546+0000 7fab522a9640 1 -- 172.21.15.28:0/3741680942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab4c074a90 con 0x7fab4c0bc120 2023-11-28T19:32:06.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.546+0000 7fab48ff9640 1 -- 172.21.15.28:0/3741680942 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fab440b6040 con 0x7fab4c0bc120 2023-11-28T19:32:06.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.546+0000 7fab48ff9640 1 --2- 172.21.15.28:0/3741680942 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fab380664a0 0x7fab38068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:06.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.546+0000 7fab48ff9640 1 -- 172.21.15.28:0/3741680942 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab44122550 con 0x7fab4c0bc120 2023-11-28T19:32:06.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.546+0000 7fab4bfff640 1 --2- 172.21.15.28:0/3741680942 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fab380664a0 0x7fab38068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:06.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.546+0000 7fab4bfff640 1 --2- 172.21.15.28:0/3741680942 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fab380664a0 0x7fab38068960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab3c006fd0 tx=0x7fab3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:06.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.550+0000 7fab48ff9640 1 -- 172.21.15.28:0/3741680942 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fab440efa60 con 0x7fab4c0bc120 2023-11-28T19:32:06.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.706+0000 7fab522a9640 1 -- 172.21.15.28:0/3741680942 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fab4c1e13b0 con 0x7fab4c0bc120 2023-11-28T19:32:06.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.710+0000 7fab48ff9640 1 -- 172.21.15.28:0/3741680942 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fab440f3080 con 0x7fab4c0bc120 2023-11-28T19:32:06.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.714+0000 7fab522a9640 1 -- 172.21.15.28:0/3741680942 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fab380664a0 msgr2=0x7fab38068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:06.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.714+0000 7fab522a9640 1 --2- 172.21.15.28:0/3741680942 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fab380664a0 0x7fab38068960 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fab3c006fd0 tx=0x7fab3c008040 comp rx=0 tx=0).stop 2023-11-28T19:32:06.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.714+0000 7fab522a9640 1 -- 172.21.15.28:0/3741680942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab4c0bc120 msgr2=0x7fab4c142790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:06.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.714+0000 7fab522a9640 1 --2- 172.21.15.28:0/3741680942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab4c0bc120 0x7fab4c142790 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fab440b2040 tx=0x7fab4401bf60 comp rx=0 tx=0).stop 2023-11-28T19:32:06.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.714+0000 7fab522a9640 1 -- 172.21.15.28:0/3741680942 shutdown_connections 2023-11-28T19:32:06.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.714+0000 7fab522a9640 1 --2- 172.21.15.28:0/3741680942 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fab380664a0 0x7fab38068960 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:06.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.714+0000 7fab522a9640 1 --2- 172.21.15.28:0/3741680942 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fab4c0bc120 0x7fab4c142790 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:06.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.714+0000 7fab522a9640 1 --2- 172.21.15.28:0/3741680942 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fab4c0a2d60 0x7fab4c1e1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:06.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.714+0000 7fab522a9640 1 --2- 172.21.15.28:0/3741680942 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fab4c072940 0x7fab4c09ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:06.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.714+0000 7fab522a9640 1 -- 172.21.15.28:0/3741680942 >> 172.21.15.28:0/3741680942 conn(0x7fab4c06ab80 msgr2=0x7fab4c0bd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:06.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.714+0000 7fab522a9640 1 -- 172.21.15.28:0/3741680942 shutdown_connections 2023-11-28T19:32:06.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:06.714+0000 7fab522a9640 1 -- 172.21.15.28:0/3741680942 wait complete. 2023-11-28T19:32:06.732 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-11-28T19:32:06.732 DEBUG:teuthology.orchestra.run.smithi028:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T19:32:06.795 DEBUG:teuthology.orchestra.run.smithi131:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T19:32:06.862 DEBUG:teuthology.orchestra.run.smithi203:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-11-28T19:32:06.927 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-11-28T19:32:06.927 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:32:06.927 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:32:06.937 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:32:06.937 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:32:06.993 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:32:06.993 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:32:07.044 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:32:07.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb423458640 1 Processor -- start 2023-11-28T19:32:07.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb423458640 1 -- start start 2023-11-28T19:32:07.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb423458640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb41c0b3540 0x7fb41c14b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb423458640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb41c0ba0d0 0x7fb41c1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb423458640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb41c0a3fb0 con 0x7fb41c142510 2023-11-28T19:32:07.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb423458640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41c0b48a0 con 0x7fb41c0b3540 2023-11-28T19:32:07.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb423458640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb41c0b4cc0 con 0x7fb41c0ba0d0 2023-11-28T19:32:07.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb4211f4640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb41c142510 0x7fb41c0ba8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52038/0 (socket says 172.21.15.28:52038) 2023-11-28T19:32:07.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb4209f3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb41c0b3540 0x7fb41c14b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb4211f4640 1 -- 172.21.15.28:0/433564176 learned_addr learned my addr 172.21.15.28:0/433564176 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:07.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb4219f5640 1 --2- 172.21.15.28:0/433564176 >> v2:172.21.15.131:3300/0 conn(0x7fb41c0ba0d0 0x7fb41c1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb41bfff640 1 -- 172.21.15.28:0/433564176 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188315925 0 0) 0x7fb40c0014a0 con 0x7fb41c142510 2023-11-28T19:32:07.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb41bfff640 1 -- 172.21.15.28:0/433564176 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb404003530 con 0x7fb41c142510 2023-11-28T19:32:07.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb4209f3640 1 -- 172.21.15.28:0/433564176 >> v2:172.21.15.131:3300/0 conn(0x7fb41c0ba0d0 msgr2=0x7fb41c1529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:07.180 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb4209f3640 1 --2- 172.21.15.28:0/433564176 >> v2:172.21.15.131:3300/0 conn(0x7fb41c0ba0d0 0x7fb41c1529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb4209f3640 1 -- 172.21.15.28:0/433564176 >> v1:172.21.15.28:6789/0 conn(0x7fb41c142510 legacy=0x7fb41c0ba8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb4209f3640 1 -- 172.21.15.28:0/433564176 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c1428f0 con 0x7fb41c0b3540 2023-11-28T19:32:07.181 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.178+0000 7fb4219f5640 1 --2- 172.21.15.28:0/433564176 >> v2:172.21.15.131:3300/0 conn(0x7fb41c0ba0d0 0x7fb41c1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:07.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb4209f3640 1 --2- 172.21.15.28:0/433564176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb41c0b3540 0x7fb41c14b6a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0b9be0 tx=0x7fb41001ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9ac5e077ff7363 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:07.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb41bfff640 1 -- 172.21.15.28:0/433564176 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4100a8930 con 0x7fb41c0b3540 2023-11-28T19:32:07.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb41bfff640 1 -- 172.21.15.28:0/433564176 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4100a8a90 con 0x7fb41c0b3540 2023-11-28T19:32:07.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb41bfff640 1 -- 172.21.15.28:0/433564176 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4100a8e20 con 0x7fb41c0b3540 2023-11-28T19:32:07.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 -- 172.21.15.28:0/433564176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb41c0b3540 msgr2=0x7fb41c14b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 --2- 172.21.15.28:0/433564176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb41c0b3540 0x7fb41c14b6a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0b9be0 tx=0x7fb41001ec30 comp rx=0 tx=0).stop 2023-11-28T19:32:07.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 -- 172.21.15.28:0/433564176 shutdown_connections 2023-11-28T19:32:07.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 --2- 172.21.15.28:0/433564176 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb41c0b3540 0x7fb41c14b6a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 --2- 172.21.15.28:0/433564176 >> v2:172.21.15.131:3300/0 conn(0x7fb41c0ba0d0 0x7fb41c1529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 -- 172.21.15.28:0/433564176 >> 172.21.15.28:0/433564176 conn(0x7fb41c06b860 msgr2=0x7fb41c06bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:07.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 -- 172.21.15.28:0/433564176 shutdown_connections 2023-11-28T19:32:07.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 -- 172.21.15.28:0/433564176 wait complete. 2023-11-28T19:32:07.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 Processor -- start 2023-11-28T19:32:07.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 -- start start 2023-11-28T19:32:07.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41c0ba0d0 0x7fb41c1e2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb41c142510 0x7fb41c131710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb41c145870 0x7fb41c0b6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c0b5f30 con 0x7fb41c145870 2023-11-28T19:32:07.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c0b6210 con 0x7fb41c142510 2023-11-28T19:32:07.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb41c0b64f0 con 0x7fb41c0ba0d0 2023-11-28T19:32:07.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb4219f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb41c145870 0x7fb41c0b6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb4219f5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb41c145870 0x7fb41c0b6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55902/0 (socket says 172.21.15.28:55902) 2023-11-28T19:32:07.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb4219f5640 1 -- 172.21.15.28:0/1308820077 learned_addr learned my addr 172.21.15.28:0/1308820077 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:07.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb4211f4640 1 --2- 172.21.15.28:0/1308820077 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41c0ba0d0 0x7fb41c1e2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb4209f3640 1 --2- 172.21.15.28:0/1308820077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb41c142510 0x7fb41c131710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb4219f5640 1 -- 172.21.15.28:0/1308820077 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41c0ba0d0 msgr2=0x7fb41c1e2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb4219f5640 1 --2- 172.21.15.28:0/1308820077 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41c0ba0d0 0x7fb41c1e2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb4219f5640 1 -- 172.21.15.28:0/1308820077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb41c142510 msgr2=0x7fb41c131710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb4219f5640 1 --2- 172.21.15.28:0/1308820077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb41c142510 0x7fb41c131710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb4219f5640 1 -- 172.21.15.28:0/1308820077 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb410009420 con 0x7fb41c145870 2023-11-28T19:32:07.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb4219f5640 1 --2- 172.21.15.28:0/1308820077 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb41c145870 0x7fb41c0b6cf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb41400c7f0 tx=0x7fb41400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:07.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb419ffb640 1 -- 172.21.15.28:0/1308820077 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414007820 con 0x7fb41c145870 2023-11-28T19:32:07.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb419ffb640 1 -- 172.21.15.28:0/1308820077 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb414007980 con 0x7fb41c145870 2023-11-28T19:32:07.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 -- 172.21.15.28:0/1308820077 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb41c0b67d0 con 0x7fb41c145870 2023-11-28T19:32:07.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb419ffb640 1 -- 172.21.15.28:0/1308820077 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb414007d70 con 0x7fb41c145870 2023-11-28T19:32:07.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.182+0000 7fb423458640 1 -- 172.21.15.28:0/1308820077 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb41c0b78c0 con 0x7fb41c145870 2023-11-28T19:32:07.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.186+0000 7fb423458640 1 -- 172.21.15.28:0/1308820077 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb41c074a90 con 0x7fb41c145870 2023-11-28T19:32:07.189 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.186+0000 7fb419ffb640 1 -- 172.21.15.28:0/1308820077 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb414024480 con 0x7fb41c145870 2023-11-28T19:32:07.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.186+0000 7fb419ffb640 1 --2- 172.21.15.28:0/1308820077 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb408066470 0x7fb408068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.186+0000 7fb419ffb640 1 -- 172.21.15.28:0/1308820077 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4140845c0 con 0x7fb41c145870 2023-11-28T19:32:07.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.186+0000 7fb4211f4640 1 --2- 172.21.15.28:0/1308820077 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb408066470 0x7fb408068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.186+0000 7fb4211f4640 1 --2- 172.21.15.28:0/1308820077 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb408066470 0x7fb408068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb40c001600 tx=0x7fb40c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:07.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.190+0000 7fb419ffb640 1 -- 172.21.15.28:0/1308820077 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb414051b20 con 0x7fb41c145870 2023-11-28T19:32:07.341 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.338+0000 7fb423458640 1 -- 172.21.15.28:0/1308820077 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb41c0b6070 con 0x7fb41c145870 2023-11-28T19:32:07.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.342+0000 7fb419ffb640 1 -- 172.21.15.28:0/1308820077 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fb41c0b6070 con 0x7fb41c145870 2023-11-28T19:32:07.343 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:07.344 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:32:07.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.342+0000 7fb423458640 1 -- 172.21.15.28:0/1308820077 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb408066470 msgr2=0x7fb408068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.342+0000 7fb423458640 1 --2- 172.21.15.28:0/1308820077 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb408066470 0x7fb408068930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb40c001600 tx=0x7fb40c009040 comp rx=0 tx=0).stop 2023-11-28T19:32:07.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.342+0000 7fb423458640 1 -- 172.21.15.28:0/1308820077 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb41c145870 msgr2=0x7fb41c0b6cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.342+0000 7fb423458640 1 --2- 172.21.15.28:0/1308820077 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb41c145870 0x7fb41c0b6cf0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb41400c7f0 tx=0x7fb41400ccb0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.342+0000 7fb423458640 1 -- 172.21.15.28:0/1308820077 shutdown_connections 2023-11-28T19:32:07.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.342+0000 7fb423458640 1 --2- 172.21.15.28:0/1308820077 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb408066470 0x7fb408068930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.342+0000 7fb423458640 1 --2- 172.21.15.28:0/1308820077 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb41c145870 0x7fb41c0b6cf0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.342+0000 7fb423458640 1 --2- 172.21.15.28:0/1308820077 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb41c142510 0x7fb41c131710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.342+0000 7fb423458640 1 --2- 172.21.15.28:0/1308820077 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb41c0ba0d0 0x7fb41c1e2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.342+0000 7fb423458640 1 -- 172.21.15.28:0/1308820077 >> 172.21.15.28:0/1308820077 conn(0x7fb41c06b860 msgr2=0x7fb41c1412c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:07.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.342+0000 7fb423458640 1 -- 172.21.15.28:0/1308820077 shutdown_connections 2023-11-28T19:32:07.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.342+0000 7fb423458640 1 -- 172.21.15.28:0/1308820077 wait complete. 2023-11-28T19:32:07.361 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:31:33.212362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:31:42.810956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:31:43.579438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T19:32:07.361 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:32:07.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.482+0000 7f3d671c0640 1 Processor -- start 2023-11-28T19:32:07.485 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.482+0000 7f3d671c0640 1 -- start start 2023-11-28T19:32:07.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d600bab20 0x7f3d600b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3d600b59c0 0x7f3d6014b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f3d6006f540 0x7f3d6014ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d600b4650 con 0x7f3d600b59c0 2023-11-28T19:32:07.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6006d440 con 0x7f3d6006f540 2023-11-28T19:32:07.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600b42e0 con 0x7f3d600bab20 2023-11-28T19:32:07.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d5ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3d600b59c0 0x7f3d6014b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d5ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3d600b59c0 0x7f3d6014b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55916/0 (socket says 172.21.15.28:55916) 2023-11-28T19:32:07.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d5ffff640 1 -- 172.21.15.28:0/136103797 learned_addr learned my addr 172.21.15.28:0/136103797 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:07.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d6575d640 1 --2- 172.21.15.28:0/136103797 >> v2:172.21.15.131:3300/0 conn(0x7f3d6006f540 0x7f3d6014ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.487 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d64f5c640 1 --2- 172.21.15.28:0/136103797 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d600bab20 0x7f3d600b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d5ffff640 1 -- 172.21.15.28:0/136103797 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d600bab20 msgr2=0x7f3d600b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:07.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d5ffff640 1 --2- 172.21.15.28:0/136103797 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d600bab20 0x7f3d600b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d5ffff640 1 -- 172.21.15.28:0/136103797 >> v2:172.21.15.131:3300/0 conn(0x7f3d6006f540 msgr2=0x7f3d6014ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:07.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d5ffff640 1 --2- 172.21.15.28:0/136103797 >> v2:172.21.15.131:3300/0 conn(0x7f3d6006f540 0x7f3d6014ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d5ffff640 1 -- 172.21.15.28:0/136103797 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d600baf00 con 0x7f3d600b59c0 2023-11-28T19:32:07.488 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d6575d640 1 --2- 172.21.15.28:0/136103797 >> v2:172.21.15.131:3300/0 conn(0x7f3d6006f540 0x7f3d6014ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:07.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d5ffff640 1 --2- 172.21.15.28:0/136103797 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d600b59c0 0x7f3d6014b4f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3d6006da20 tx=0x7f3d5401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a7de311b3964671 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:07.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d5f7fe640 1 -- 172.21.15.28:0/136103797 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d540ab600 con 0x7f3d600b59c0 2023-11-28T19:32:07.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d5f7fe640 1 -- 172.21.15.28:0/136103797 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d540a7050 con 0x7f3d600b59c0 2023-11-28T19:32:07.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d5f7fe640 1 -- 172.21.15.28:0/136103797 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d540ab980 con 0x7f3d600b59c0 2023-11-28T19:32:07.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 -- 172.21.15.28:0/136103797 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d600b59c0 msgr2=0x7f3d6014b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 --2- 172.21.15.28:0/136103797 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d600b59c0 0x7f3d6014b4f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f3d6006da20 tx=0x7f3d5401c3e0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 -- 172.21.15.28:0/136103797 shutdown_connections 2023-11-28T19:32:07.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 --2- 172.21.15.28:0/136103797 >> v2:172.21.15.131:3300/0 conn(0x7f3d6006f540 0x7f3d6014ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 --2- 172.21.15.28:0/136103797 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d600b59c0 0x7f3d6014b4f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 --2- 172.21.15.28:0/136103797 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d600bab20 0x7f3d600b5100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 -- 172.21.15.28:0/136103797 >> 172.21.15.28:0/136103797 conn(0x7f3d600beaf0 msgr2=0x7f3d600bef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:07.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 -- 172.21.15.28:0/136103797 shutdown_connections 2023-11-28T19:32:07.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.486+0000 7f3d671c0640 1 -- 172.21.15.28:0/136103797 wait complete. 2023-11-28T19:32:07.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d671c0640 1 Processor -- start 2023-11-28T19:32:07.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d671c0640 1 -- start start 2023-11-28T19:32:07.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d671c0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d6006f540 0x7f3d6014dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d671c0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d600b59c0 0x7f3d601420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d671c0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d600bab20 0x7f3d601e41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d671c0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d600b9010 con 0x7f3d6006f540 2023-11-28T19:32:07.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d671c0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6014e130 con 0x7f3d600bab20 2023-11-28T19:32:07.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d671c0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d60144e10 con 0x7f3d600b59c0 2023-11-28T19:32:07.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d64f5c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d6006f540 0x7f3d6014dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d64f5c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d6006f540 0x7f3d6014dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55918/0 (socket says 172.21.15.28:55918) 2023-11-28T19:32:07.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d64f5c640 1 -- 172.21.15.28:0/2716911482 learned_addr learned my addr 172.21.15.28:0/2716911482 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:07.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d5ffff640 1 --2- 172.21.15.28:0/2716911482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d600b59c0 0x7f3d601420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d64f5c640 1 -- 172.21.15.28:0/2716911482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d600b59c0 msgr2=0x7f3d601420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d64f5c640 1 --2- 172.21.15.28:0/2716911482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d600b59c0 0x7f3d601420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.493 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d64f5c640 1 -- 172.21.15.28:0/2716911482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d600bab20 msgr2=0x7f3d601e41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d64f5c640 1 --2- 172.21.15.28:0/2716911482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d600bab20 0x7f3d601e41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d64f5c640 1 -- 172.21.15.28:0/2716911482 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d540094d0 con 0x7f3d6006f540 2023-11-28T19:32:07.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d5ffff640 1 --2- 172.21.15.28:0/2716911482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d600b59c0 0x7f3d601420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:07.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d64f5c640 1 --2- 172.21.15.28:0/2716911482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d6006f540 0x7f3d6014dbf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000c7f0 tx=0x7f3d5000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:07.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d5d7fa640 1 -- 172.21.15.28:0/2716911482 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50007820 con 0x7f3d6006f540 2023-11-28T19:32:07.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d5d7fa640 1 -- 172.21.15.28:0/2716911482 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50007980 con 0x7f3d6006f540 2023-11-28T19:32:07.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d671c0640 1 -- 172.21.15.28:0/2716911482 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d60142600 con 0x7f3d6006f540 2023-11-28T19:32:07.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d5d7fa640 1 -- 172.21.15.28:0/2716911482 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50007d30 con 0x7f3d6006f540 2023-11-28T19:32:07.494 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d671c0640 1 -- 172.21.15.28:0/2716911482 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d60140f00 con 0x7f3d6006f540 2023-11-28T19:32:07.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d671c0640 1 -- 172.21.15.28:0/2716911482 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d601410f0 con 0x7f3d6006f540 2023-11-28T19:32:07.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.490+0000 7f3d5d7fa640 1 -- 172.21.15.28:0/2716911482 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3d500113f0 con 0x7f3d6006f540 2023-11-28T19:32:07.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.494+0000 7f3d5d7fa640 1 --2- 172.21.15.28:0/2716911482 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3d4c066470 0x7f3d4c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.494+0000 7f3d5d7fa640 1 -- 172.21.15.28:0/2716911482 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d50083ee0 con 0x7f3d6006f540 2023-11-28T19:32:07.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.494+0000 7f3d5ffff640 1 --2- 172.21.15.28:0/2716911482 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3d4c066470 0x7f3d4c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.494+0000 7f3d5ffff640 1 --2- 172.21.15.28:0/2716911482 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3d4c066470 0x7f3d4c068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d540ad000 tx=0x7f3d54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:07.498 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.498+0000 7f3d5d7fa640 1 -- 172.21.15.28:0/2716911482 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3d50051360 con 0x7f3d6006f540 2023-11-28T19:32:07.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.654+0000 7f3d671c0640 1 -- 172.21.15.28:0/2716911482 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3d60074a90 con 0x7f3d6006f540 2023-11-28T19:32:07.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.654+0000 7f3d5d7fa640 1 -- 172.21.15.28:0/2716911482 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3d50054980 con 0x7f3d6006f540 2023-11-28T19:32:07.657 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-28T19:32:07.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.658+0000 7f3d671c0640 1 -- 172.21.15.28:0/2716911482 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3d4c066470 msgr2=0x7f3d4c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.658+0000 7f3d671c0640 1 --2- 172.21.15.28:0/2716911482 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3d4c066470 0x7f3d4c068930 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3d540ad000 tx=0x7f3d54008040 comp rx=0 tx=0).stop 2023-11-28T19:32:07.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.658+0000 7f3d671c0640 1 -- 172.21.15.28:0/2716911482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d6006f540 msgr2=0x7f3d6014dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.658+0000 7f3d671c0640 1 --2- 172.21.15.28:0/2716911482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d6006f540 0x7f3d6014dbf0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000c7f0 tx=0x7f3d5000ccb0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.658+0000 7f3d671c0640 1 -- 172.21.15.28:0/2716911482 shutdown_connections 2023-11-28T19:32:07.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.658+0000 7f3d671c0640 1 --2- 172.21.15.28:0/2716911482 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3d4c066470 0x7f3d4c068930 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.658+0000 7f3d671c0640 1 --2- 172.21.15.28:0/2716911482 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d600bab20 0x7f3d601e41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.658+0000 7f3d671c0640 1 --2- 172.21.15.28:0/2716911482 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d600b59c0 0x7f3d601420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.658+0000 7f3d671c0640 1 --2- 172.21.15.28:0/2716911482 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d6006f540 0x7f3d6014dbf0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.658+0000 7f3d671c0640 1 -- 172.21.15.28:0/2716911482 >> 172.21.15.28:0/2716911482 conn(0x7f3d600beaf0 msgr2=0x7f3d600b91e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:07.660 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.658+0000 7f3d671c0640 1 -- 172.21.15.28:0/2716911482 shutdown_connections 2023-11-28T19:32:07.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.658+0000 7f3d671c0640 1 -- 172.21.15.28:0/2716911482 wait complete. 2023-11-28T19:32:07.676 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:32:07.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eba328640 1 Processor -- start 2023-11-28T19:32:07.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eba328640 1 -- start start 2023-11-28T19:32:07.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eba328640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9eb4071f20 0x7f9eb4154af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eba328640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb40bb6f0 con 0x7f9eb40baa30 2023-11-28T19:32:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eba328640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb4072390 con 0x7f9eb40bb2d0 2023-11-28T19:32:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eba328640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb406f1e0 con 0x7f9eb4071f20 2023-11-28T19:32:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb3fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9eb40baa30 0x7f9eb406f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52048/0 (socket says 172.21.15.28:52048) 2023-11-28T19:32:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb3fff640 1 -- 172.21.15.28:0/2502789121 learned_addr learned my addr 172.21.15.28:0/2502789121 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb88c5640 1 --2- 172.21.15.28:0/2502789121 >> v2:172.21.15.131:3300/0 conn(0x7f9eb4071f20 0x7f9eb4154af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 -- 172.21.15.28:0/2502789121 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2495615616 0 0) 0x7f9ea4001120 con 0x7f9eb40baa30 2023-11-28T19:32:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 -- 172.21.15.28:0/2502789121 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e94003530 con 0x7f9eb40baa30 2023-11-28T19:32:07.810 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 -- 172.21.15.28:0/2502789121 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 547594999 0 0) 0x7f9e94003530 con 0x7f9eb40baa30 2023-11-28T19:32:07.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 -- 172.21.15.28:0/2502789121 >> v2:172.21.15.131:3300/0 conn(0x7f9eb4071f20 msgr2=0x7f9eb4154af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:07.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 --2- 172.21.15.28:0/2502789121 >> v2:172.21.15.131:3300/0 conn(0x7f9eb4071f20 0x7f9eb4154af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 -- 172.21.15.28:0/2502789121 >> v1:172.21.15.131:6789/0 conn(0x7f9eb40bb2d0 legacy=0x7f9eb4143020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 -- 172.21.15.28:0/2502789121 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb41491d0 con 0x7f9eb40baa30 2023-11-28T19:32:07.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 -- 172.21.15.28:0/2502789121 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f9ea4001810 con 0x7f9eb40baa30 2023-11-28T19:32:07.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 -- 172.21.15.28:0/2502789121 >> v1:172.21.15.28:6789/0 conn(0x7f9eb40baa30 legacy=0x7f9eb406f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 --2- 172.21.15.28:0/2502789121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e940039d0 0x7f9e94003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 --2- 172.21.15.28:0/2502789121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e940047d0 0x7f9e94004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 --2- 172.21.15.28:0/2502789121 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e94005190 0x7f9e9400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.811 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 -- 172.21.15.28:0/2502789121 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb406f1e0 con 0x7f9e94005190 2023-11-28T19:32:07.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 -- 172.21.15.28:0/2502789121 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9400c0a0 con 0x7f9e940047d0 2023-11-28T19:32:07.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb37fe640 1 -- 172.21.15.28:0/2502789121 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e9400c260 con 0x7f9e940039d0 2023-11-28T19:32:07.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb88c5640 1 --2- 172.21.15.28:0/2502789121 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e94005190 0x7f9e9400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eabfff640 1 --2- 172.21.15.28:0/2502789121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e940047d0 0x7f9e94004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb3fff640 1 --2- 172.21.15.28:0/2502789121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e940039d0 0x7f9e94003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb88c5640 1 -- 172.21.15.28:0/2502789121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e940039d0 msgr2=0x7f9e94003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:07.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb88c5640 1 --2- 172.21.15.28:0/2502789121 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e940039d0 0x7f9e94003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb88c5640 1 -- 172.21.15.28:0/2502789121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e940047d0 msgr2=0x7f9e94004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:07.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb88c5640 1 --2- 172.21.15.28:0/2502789121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e940047d0 0x7f9e94004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eb88c5640 1 -- 172.21.15.28:0/2502789121 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e94003530 con 0x7f9e94005190 2023-11-28T19:32:07.812 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.806+0000 7f9eabfff640 1 --2- 172.21.15.28:0/2502789121 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9e940047d0 0x7f9e94004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:07.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eb88c5640 1 -- 172.21.15.28:0/2502789121 reap_dead start 2023-11-28T19:32:07.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eb88c5640 1 --2- 172.21.15.28:0/2502789121 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e94005190 0x7f9e9400b990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009fc0 tx=0x7f9eac01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c55aeaf49286631a server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:07.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eb37fe640 1 -- 172.21.15.28:0/2502789121 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac0a5cb0 con 0x7f9e94005190 2023-11-28T19:32:07.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eb37fe640 1 -- 172.21.15.28:0/2502789121 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9eac00f040 con 0x7f9e94005190 2023-11-28T19:32:07.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eb37fe640 1 -- 172.21.15.28:0/2502789121 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9eac003be0 con 0x7f9e94005190 2023-11-28T19:32:07.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 -- 172.21.15.28:0/2502789121 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e94005190 msgr2=0x7f9e9400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 --2- 172.21.15.28:0/2502789121 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e94005190 0x7f9e9400b990 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9eac009fc0 tx=0x7f9eac01cca0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 -- 172.21.15.28:0/2502789121 shutdown_connections 2023-11-28T19:32:07.817 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 --2- 172.21.15.28:0/2502789121 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9e94005190 0x7f9e9400b990 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 -- 172.21.15.28:0/2502789121 >> 172.21.15.28:0/2502789121 conn(0x7f9eb4071400 msgr2=0x7f9eb4071810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 -- 172.21.15.28:0/2502789121 shutdown_connections 2023-11-28T19:32:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 -- 172.21.15.28:0/2502789121 wait complete. 2023-11-28T19:32:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 Processor -- start 2023-11-28T19:32:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 -- start start 2023-11-28T19:32:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e94005190 0x7f9eb40b6890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9eb413dfc0 0x7f9eb413c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9eb413c580 0x7f9eb41e1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb40b8cc0 con 0x7f9eb413dfc0 2023-11-28T19:32:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb40b8670 con 0x7f9eb413c580 2023-11-28T19:32:07.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eba328640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb40b8950 con 0x7f9e94005190 2023-11-28T19:32:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eabfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9eb413dfc0 0x7f9eb413c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eabfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9eb413dfc0 0x7f9eb413c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55930/0 (socket says 172.21.15.28:55930) 2023-11-28T19:32:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eabfff640 1 -- 172.21.15.28:0/1343888980 learned_addr learned my addr 172.21.15.28:0/1343888980 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.810+0000 7f9eb88c5640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9eb413c580 0x7f9eb41e1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eb3fff640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e94005190 0x7f9eb40b6890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eabfff640 1 -- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e94005190 msgr2=0x7f9eb40b6890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eabfff640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e94005190 0x7f9eb40b6890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eabfff640 1 -- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9eb413c580 msgr2=0x7f9eb41e1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eabfff640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9eb413c580 0x7f9eb41e1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eabfff640 1 -- 172.21.15.28:0/1343888980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb413e400 con 0x7f9eb413dfc0 2023-11-28T19:32:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eb88c5640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9eb413c580 0x7f9eb41e1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:07.819 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eabfff640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9eb413dfc0 0x7f9eb413c040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00e480 tx=0x7f9e9c00e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:07.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eb17fa640 1 -- 172.21.15.28:0/1343888980 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c0052e0 con 0x7f9eb413dfc0 2023-11-28T19:32:07.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eb17fa640 1 -- 172.21.15.28:0/1343888980 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e9c005440 con 0x7f9eb413dfc0 2023-11-28T19:32:07.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eba328640 1 -- 172.21.15.28:0/1343888980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb413ead0 con 0x7f9eb413dfc0 2023-11-28T19:32:07.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eb17fa640 1 -- 172.21.15.28:0/1343888980 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e9c003820 con 0x7f9eb413dfc0 2023-11-28T19:32:07.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eba328640 1 -- 172.21.15.28:0/1343888980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb40b8290 con 0x7f9eb413dfc0 2023-11-28T19:32:07.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eba328640 1 -- 172.21.15.28:0/1343888980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb41e1860 con 0x7f9eb413dfc0 2023-11-28T19:32:07.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eb17fa640 1 -- 172.21.15.28:0/1343888980 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9e9c003980 con 0x7f9eb413dfc0 2023-11-28T19:32:07.820 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eb17fa640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9e98066480 0x7f9e98068940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:07.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eb17fa640 1 -- 172.21.15.28:0/1343888980 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e9c083b30 con 0x7f9eb413dfc0 2023-11-28T19:32:07.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eb3fff640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9e98066480 0x7f9e98068940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:07.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.814+0000 7f9eb3fff640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9e98066480 0x7f9e98068940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4001060 tx=0x7f9ea4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:07.821 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.818+0000 7f9eb17fa640 1 -- 172.21.15.28:0/1343888980 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9e9c050f10 con 0x7f9eb413dfc0 2023-11-28T19:32:07.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.974+0000 7f9eba328640 1 -- 172.21.15.28:0/1343888980 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9eb413c960 con 0x7f9eb413dfc0 2023-11-28T19:32:07.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.974+0000 7f9eb17fa640 1 -- 172.21.15.28:0/1343888980 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9eb413c960 con 0x7f9eb413dfc0 2023-11-28T19:32:07.976 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-28T19:32:07.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.978+0000 7f9eba328640 1 -- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9e98066480 msgr2=0x7f9e98068940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.978+0000 7f9eba328640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9e98066480 0x7f9e98068940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4001060 tx=0x7f9ea4009040 comp rx=0 tx=0).stop 2023-11-28T19:32:07.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.978+0000 7f9eba328640 1 -- 172.21.15.28:0/1343888980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9eb413dfc0 msgr2=0x7f9eb413c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:07.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.978+0000 7f9eba328640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9eb413dfc0 0x7f9eb413c040 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9e9c00e480 tx=0x7f9e9c00e940 comp rx=0 tx=0).stop 2023-11-28T19:32:07.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.978+0000 7f9eba328640 1 -- 172.21.15.28:0/1343888980 shutdown_connections 2023-11-28T19:32:07.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.978+0000 7f9eba328640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9e98066480 0x7f9e98068940 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.978+0000 7f9eba328640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9eb413c580 0x7f9eb41e1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.978+0000 7f9eba328640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9eb413dfc0 0x7f9eb413c040 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.978+0000 7f9eba328640 1 --2- 172.21.15.28:0/1343888980 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9e94005190 0x7f9eb40b6890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:07.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.978+0000 7f9eba328640 1 -- 172.21.15.28:0/1343888980 >> 172.21.15.28:0/1343888980 conn(0x7f9eb4071400 msgr2=0x7f9eb41406e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:07.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.978+0000 7f9eba328640 1 -- 172.21.15.28:0/1343888980 shutdown_connections 2023-11-28T19:32:07.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:07.978+0000 7f9eba328640 1 -- 172.21.15.28:0/1343888980 wait complete. 2023-11-28T19:32:07.994 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:32:08.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.106+0000 7f81e66db640 1 Processor -- start 2023-11-28T19:32:08.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.106+0000 7f81e66db640 1 -- start start 2023-11-28T19:32:08.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81e66db640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f81e00bd340 0x7f81e0142120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81e66db640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f81e00728c0 0x7f81e00b4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81e66db640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81e0142660 0x7f81e00b4990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81e66db640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e00b6e90 con 0x7f81e00bd340 2023-11-28T19:32:08.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81e66db640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81e00b6560 con 0x7f81e00728c0 2023-11-28T19:32:08.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81e66db640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00b6840 con 0x7f81e0142660 2023-11-28T19:32:08.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81dffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f81e00bd340 0x7f81e0142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81dffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f81e00bd340 0x7f81e0142120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55934/0 (socket says 172.21.15.28:55934) 2023-11-28T19:32:08.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81dffff640 1 -- 172.21.15.28:0/1037247577 learned_addr learned my addr 172.21.15.28:0/1037247577 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:08.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81df7fe640 1 --2- 172.21.15.28:0/1037247577 >> v2:172.21.15.131:3300/0 conn(0x7f81e00728c0 0x7f81e00b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81e4c78640 1 --2- 172.21.15.28:0/1037247577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81e0142660 0x7f81e00b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81dffff640 1 -- 172.21.15.28:0/1037247577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81e0142660 msgr2=0x7f81e00b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:08.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81dffff640 1 --2- 172.21.15.28:0/1037247577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81e0142660 0x7f81e00b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81dffff640 1 -- 172.21.15.28:0/1037247577 >> v2:172.21.15.131:3300/0 conn(0x7f81e00728c0 msgr2=0x7f81e00b4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:08.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81dffff640 1 --2- 172.21.15.28:0/1037247577 >> v2:172.21.15.131:3300/0 conn(0x7f81e00728c0 0x7f81e00b4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81dffff640 1 -- 172.21.15.28:0/1037247577 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e00b6b20 con 0x7f81e00bd340 2023-11-28T19:32:08.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81df7fe640 1 --2- 172.21.15.28:0/1037247577 >> v2:172.21.15.131:3300/0 conn(0x7f81e00728c0 0x7f81e00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:08.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.110+0000 7f81e4c78640 1 --2- 172.21.15.28:0/1037247577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81e0142660 0x7f81e00b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:08.113 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81dffff640 1 --2- 172.21.15.28:0/1037247577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81e00bd340 0x7f81e0142120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f81e0149320 tx=0x7f81d80213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bb4a98a54fd3c62 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:08.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81deffd640 1 -- 172.21.15.28:0/1037247577 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d800b2d0 con 0x7f81e00bd340 2023-11-28T19:32:08.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81deffd640 1 -- 172.21.15.28:0/1037247577 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d80ad050 con 0x7f81e00bd340 2023-11-28T19:32:08.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81deffd640 1 -- 172.21.15.28:0/1037247577 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d8009820 con 0x7f81e00bd340 2023-11-28T19:32:08.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 -- 172.21.15.28:0/1037247577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81e00bd340 msgr2=0x7f81e0142120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 --2- 172.21.15.28:0/1037247577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81e00bd340 0x7f81e0142120 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f81e0149320 tx=0x7f81d80213c0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 -- 172.21.15.28:0/1037247577 shutdown_connections 2023-11-28T19:32:08.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 --2- 172.21.15.28:0/1037247577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81e0142660 0x7f81e00b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 --2- 172.21.15.28:0/1037247577 >> v2:172.21.15.131:3300/0 conn(0x7f81e00728c0 0x7f81e00b4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 --2- 172.21.15.28:0/1037247577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81e00bd340 0x7f81e0142120 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 -- 172.21.15.28:0/1037247577 >> 172.21.15.28:0/1037247577 conn(0x7f81e006ab80 msgr2=0x7f81e00bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:08.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 -- 172.21.15.28:0/1037247577 shutdown_connections 2023-11-28T19:32:08.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 -- 172.21.15.28:0/1037247577 wait complete. 2023-11-28T19:32:08.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 Processor -- start 2023-11-28T19:32:08.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 -- start start 2023-11-28T19:32:08.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81e00728c0 0x7f81e0071b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e00bd340 0x7f81e01e4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81e0142660 0x7f81e0142f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.118 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e01e4630 con 0x7f81e0142660 2023-11-28T19:32:08.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e00721b0 con 0x7f81e00bd340 2023-11-28T19:32:08.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e01e3fe0 con 0x7f81e00728c0 2023-11-28T19:32:08.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e4c78640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81e0142660 0x7f81e0142f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e4c78640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81e0142660 0x7f81e0142f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55944/0 (socket says 172.21.15.28:55944) 2023-11-28T19:32:08.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e4c78640 1 -- 172.21.15.28:0/2226141747 learned_addr learned my addr 172.21.15.28:0/2226141747 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:08.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81df7fe640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e00bd340 0x7f81e01e4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81dffff640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81e00728c0 0x7f81e0071b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e4c78640 1 -- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81e00728c0 msgr2=0x7f81e0071b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e4c78640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81e00728c0 0x7f81e0071b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e4c78640 1 -- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e00bd340 msgr2=0x7f81e01e4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e4c78640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e00bd340 0x7f81e01e4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e4c78640 1 -- 172.21.15.28:0/2226141747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d800bd40 con 0x7f81e0142660 2023-11-28T19:32:08.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81dffff640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81e00728c0 0x7f81e0071b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:08.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e4c78640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81e0142660 0x7f81e0142f90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f81d000c7f0 tx=0x7f81d000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:08.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81dcff9640 1 -- 172.21.15.28:0/2226141747 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0004230 con 0x7f81e0142660 2023-11-28T19:32:08.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 -- 172.21.15.28:0/2226141747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e00b9000 con 0x7f81e0142660 2023-11-28T19:32:08.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81dcff9640 1 -- 172.21.15.28:0/2226141747 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81d00043b0 con 0x7f81e0142660 2023-11-28T19:32:08.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81dcff9640 1 -- 172.21.15.28:0/2226141747 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81d0003860 con 0x7f81e0142660 2023-11-28T19:32:08.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.114+0000 7f81e66db640 1 -- 172.21.15.28:0/2226141747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e01d3b30 con 0x7f81e0142660 2023-11-28T19:32:08.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.118+0000 7f81e66db640 1 -- 172.21.15.28:0/2226141747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e01e47a0 con 0x7f81e0142660 2023-11-28T19:32:08.120 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.118+0000 7f81dcff9640 1 -- 172.21.15.28:0/2226141747 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81d0003bd0 con 0x7f81e0142660 2023-11-28T19:32:08.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.118+0000 7f81dcff9640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f81c4066470 0x7f81c4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.118+0000 7f81dcff9640 1 -- 172.21.15.28:0/2226141747 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f81d0084410 con 0x7f81e0142660 2023-11-28T19:32:08.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.118+0000 7f81dffff640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f81c4066470 0x7f81c4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.118+0000 7f81dffff640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f81c4066470 0x7f81c4068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f81d80b3000 tx=0x7f81d80ac000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:08.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.122+0000 7f81dcff9640 1 -- 172.21.15.28:0/2226141747 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f81d0051810 con 0x7f81e0142660 2023-11-28T19:32:08.274 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.274+0000 7f81e66db640 1 -- 172.21.15.28:0/2226141747 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f81e0074a90 con 0x7f81e0142660 2023-11-28T19:32:08.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.274+0000 7f81dcff9640 1 -- 172.21.15.28:0/2226141747 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f81d0054e30 con 0x7f81e0142660 2023-11-28T19:32:08.275 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-28T19:32:08.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.274+0000 7f81e66db640 1 -- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f81c4066470 msgr2=0x7f81c4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.274+0000 7f81e66db640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f81c4066470 0x7f81c4068930 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f81d80b3000 tx=0x7f81d80ac000 comp rx=0 tx=0).stop 2023-11-28T19:32:08.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.274+0000 7f81e66db640 1 -- 172.21.15.28:0/2226141747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81e0142660 msgr2=0x7f81e0142f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.274+0000 7f81e66db640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81e0142660 0x7f81e0142f90 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f81d000c7f0 tx=0x7f81d000ccb0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.274+0000 7f81e66db640 1 -- 172.21.15.28:0/2226141747 shutdown_connections 2023-11-28T19:32:08.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.274+0000 7f81e66db640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f81c4066470 0x7f81c4068930 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.274+0000 7f81e66db640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f81e0142660 0x7f81e0142f90 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.277 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.274+0000 7f81e66db640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81e00bd340 0x7f81e01e4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.274+0000 7f81e66db640 1 --2- 172.21.15.28:0/2226141747 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81e00728c0 0x7f81e0071b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.274+0000 7f81e66db640 1 -- 172.21.15.28:0/2226141747 >> 172.21.15.28:0/2226141747 conn(0x7f81e006ab80 msgr2=0x7f81e00b70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:08.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.274+0000 7f81e66db640 1 -- 172.21.15.28:0/2226141747 shutdown_connections 2023-11-28T19:32:08.278 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.274+0000 7f81e66db640 1 -- 172.21.15.28:0/2226141747 wait complete. 2023-11-28T19:32:08.293 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-11-28T19:32:08.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae37eec640 1 Processor -- start 2023-11-28T19:32:08.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae37eec640 1 -- start start 2023-11-28T19:32:08.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae37eec640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fae3014c790 0x7fae30154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae37eec640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae300b4dc0 con 0x7fae300b9380 2023-11-28T19:32:08.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae37eec640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae3014cbe0 con 0x7fae300ba4e0 2023-11-28T19:32:08.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae37eec640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae300ba060 con 0x7fae3014c790 2023-11-28T19:32:08.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae35487640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fae300b9380 0x7fae30143280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52056/0 (socket says 172.21.15.28:52056) 2023-11-28T19:32:08.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae35487640 1 -- 172.21.15.28:0/1371957301 learned_addr learned my addr 172.21.15.28:0/1371957301 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:08.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae36489640 1 --2- 172.21.15.28:0/1371957301 >> v2:172.21.15.131:3300/0 conn(0x7fae3014c790 0x7fae30154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 -- 172.21.15.28:0/1371957301 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3121857101 0 0) 0x7fae300b4dc0 con 0x7fae300b9380 2023-11-28T19:32:08.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 -- 172.21.15.28:0/1371957301 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae18003530 con 0x7fae300b9380 2023-11-28T19:32:08.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 -- 172.21.15.28:0/1371957301 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2018450622 0 0) 0x7fae18003530 con 0x7fae300b9380 2023-11-28T19:32:08.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 -- 172.21.15.28:0/1371957301 >> v2:172.21.15.131:3300/0 conn(0x7fae3014c790 msgr2=0x7fae30154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:08.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 --2- 172.21.15.28:0/1371957301 >> v2:172.21.15.131:3300/0 conn(0x7fae3014c790 0x7fae30154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 -- 172.21.15.28:0/1371957301 >> v1:172.21.15.131:6789/0 conn(0x7fae300ba4e0 legacy=0x7fae300b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 -- 172.21.15.28:0/1371957301 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae300b8ef0 con 0x7fae300b9380 2023-11-28T19:32:08.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 -- 172.21.15.28:0/1371957301 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7fae24001680 con 0x7fae300b9380 2023-11-28T19:32:08.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 -- 172.21.15.28:0/1371957301 >> v1:172.21.15.28:6789/0 conn(0x7fae300b9380 legacy=0x7fae30143280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 --2- 172.21.15.28:0/1371957301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae18003980 0x7fae18003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 --2- 172.21.15.28:0/1371957301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae18004380 0x7fae18004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 --2- 172.21.15.28:0/1371957301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae18005050 0x7fae1800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 -- 172.21.15.28:0/1371957301 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae300ba060 con 0x7fae18003980 2023-11-28T19:32:08.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 -- 172.21.15.28:0/1371957301 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae1800bf00 con 0x7fae18004380 2023-11-28T19:32:08.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae34c86640 1 -- 172.21.15.28:0/1371957301 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1800c0c0 con 0x7fae18005050 2023-11-28T19:32:08.421 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae35c88640 1 --2- 172.21.15.28:0/1371957301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae18003980 0x7fae18003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae36489640 1 --2- 172.21.15.28:0/1371957301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae18005050 0x7fae1800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae35c88640 1 -- 172.21.15.28:0/1371957301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae18005050 msgr2=0x7fae1800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:08.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae35c88640 1 --2- 172.21.15.28:0/1371957301 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae18005050 0x7fae1800b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae35c88640 1 -- 172.21.15.28:0/1371957301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae18004380 msgr2=0x7fae18004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:08.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae35487640 1 --2- 172.21.15.28:0/1371957301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae18004380 0x7fae18004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae35c88640 1 --2- 172.21.15.28:0/1371957301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae18004380 0x7fae18004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae36489640 1 -- 172.21.15.28:0/1371957301 reap_dead start 2023-11-28T19:32:08.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae35c88640 1 -- 172.21.15.28:0/1371957301 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae18003530 con 0x7fae18003980 2023-11-28T19:32:08.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.414+0000 7fae35487640 1 --2- 172.21.15.28:0/1371957301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae18004380 0x7fae18004850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:08.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae35c88640 1 --2- 172.21.15.28:0/1371957301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae18003980 0x7fae18003d60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fae28001f50 tx=0x7fae2801efb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186902d74acf737c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:08.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae34c86640 1 -- 172.21.15.28:0/1371957301 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae280a8bd0 con 0x7fae18003980 2023-11-28T19:32:08.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae34c86640 1 -- 172.21.15.28:0/1371957301 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae280a8d30 con 0x7fae18003980 2023-11-28T19:32:08.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae34c86640 1 -- 172.21.15.28:0/1371957301 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae280b0680 con 0x7fae18003980 2023-11-28T19:32:08.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 -- 172.21.15.28:0/1371957301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae18003980 msgr2=0x7fae18003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.427 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 --2- 172.21.15.28:0/1371957301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae18003980 0x7fae18003d60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fae28001f50 tx=0x7fae2801efb0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 -- 172.21.15.28:0/1371957301 shutdown_connections 2023-11-28T19:32:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 --2- 172.21.15.28:0/1371957301 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae18003980 0x7fae18003d60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 -- 172.21.15.28:0/1371957301 >> 172.21.15.28:0/1371957301 conn(0x7fae3006e7a0 msgr2=0x7fae3006b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 -- 172.21.15.28:0/1371957301 shutdown_connections 2023-11-28T19:32:08.428 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 -- 172.21.15.28:0/1371957301 wait complete. 2023-11-28T19:32:08.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 Processor -- start 2023-11-28T19:32:08.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 -- start start 2023-11-28T19:32:08.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae18003980 0x7fae3013fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae30149a60 0x7fae30148380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae301e1fa0 0x7fae30139e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.429 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae300b97f0 con 0x7fae30149a60 2023-11-28T19:32:08.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae301488c0 con 0x7fae18003980 2023-11-28T19:32:08.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae37eec640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae30142de0 con 0x7fae301e1fa0 2023-11-28T19:32:08.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.418+0000 7fae35487640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae30149a60 0x7fae30148380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae35487640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae30149a60 0x7fae30148380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55976/0 (socket says 172.21.15.28:55976) 2023-11-28T19:32:08.430 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae35487640 1 -- 172.21.15.28:0/1989216791 learned_addr learned my addr 172.21.15.28:0/1989216791 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:08.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae35c88640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae18003980 0x7fae3013fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae36489640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae301e1fa0 0x7fae30139e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae35487640 1 -- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae301e1fa0 msgr2=0x7fae30139e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae35487640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae301e1fa0 0x7fae30139e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.431 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae35487640 1 -- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae18003980 msgr2=0x7fae3013fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae35487640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae18003980 0x7fae3013fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae35487640 1 -- 172.21.15.28:0/1989216791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae301e2bf0 con 0x7fae30149a60 2023-11-28T19:32:08.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae36489640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae301e1fa0 0x7fae30139e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:08.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae35487640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae30149a60 0x7fae30148380 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fae2400d770 tx=0x7fae2400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:08.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae2e7fc640 1 -- 172.21.15.28:0/1989216791 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae240072d0 con 0x7fae30149a60 2023-11-28T19:32:08.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae2e7fc640 1 -- 172.21.15.28:0/1989216791 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae24007430 con 0x7fae30149a60 2023-11-28T19:32:08.432 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae2e7fc640 1 -- 172.21.15.28:0/1989216791 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae240047f0 con 0x7fae30149a60 2023-11-28T19:32:08.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae37eec640 1 -- 172.21.15.28:0/1989216791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae30142770 con 0x7fae30149a60 2023-11-28T19:32:08.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae37eec640 1 -- 172.21.15.28:0/1989216791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae30146c10 con 0x7fae30149a60 2023-11-28T19:32:08.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae37eec640 1 -- 172.21.15.28:0/1989216791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae30074a90 con 0x7fae30149a60 2023-11-28T19:32:08.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae2e7fc640 1 -- 172.21.15.28:0/1989216791 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fae24004950 con 0x7fae30149a60 2023-11-28T19:32:08.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae2e7fc640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fae1c0664a0 0x7fae1c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.433 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae2e7fc640 1 -- 172.21.15.28:0/1989216791 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fae24083570 con 0x7fae30149a60 2023-11-28T19:32:08.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae35c88640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fae1c0664a0 0x7fae1c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.422+0000 7fae35c88640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fae1c0664a0 0x7fae1c068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fae280b2000 tx=0x7fae28009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:08.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.426+0000 7fae2e7fc640 1 -- 172.21.15.28:0/1989216791 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fae24050a80 con 0x7fae30149a60 2023-11-28T19:32:08.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.590+0000 7fae37eec640 1 -- 172.21.15.28:0/1989216791 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fae301429c0 con 0x7fae30149a60 2023-11-28T19:32:08.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.590+0000 7fae2e7fc640 1 -- 172.21.15.28:0/1989216791 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7fae240540a0 con 0x7fae30149a60 2023-11-28T19:32:08.590 INFO:teuthology.orchestra.run.smithi028.stderr:listed 0 entries 2023-11-28T19:32:08.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.590+0000 7fae37eec640 1 -- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fae1c0664a0 msgr2=0x7fae1c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.590+0000 7fae37eec640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fae1c0664a0 0x7fae1c068960 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fae280b2000 tx=0x7fae28009040 comp rx=0 tx=0).stop 2023-11-28T19:32:08.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.590+0000 7fae37eec640 1 -- 172.21.15.28:0/1989216791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae30149a60 msgr2=0x7fae30148380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.590+0000 7fae37eec640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae30149a60 0x7fae30148380 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fae2400d770 tx=0x7fae2400dc30 comp rx=0 tx=0).stop 2023-11-28T19:32:08.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.590+0000 7fae37eec640 1 -- 172.21.15.28:0/1989216791 shutdown_connections 2023-11-28T19:32:08.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.590+0000 7fae37eec640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fae1c0664a0 0x7fae1c068960 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.590+0000 7fae37eec640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fae301e1fa0 0x7fae30139e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.590+0000 7fae37eec640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fae30149a60 0x7fae30148380 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.590+0000 7fae37eec640 1 --2- 172.21.15.28:0/1989216791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fae18003980 0x7fae3013fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.590+0000 7fae37eec640 1 -- 172.21.15.28:0/1989216791 >> 172.21.15.28:0/1989216791 conn(0x7fae3006e7a0 msgr2=0x7fae300bdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:08.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.590+0000 7fae37eec640 1 -- 172.21.15.28:0/1989216791 shutdown_connections 2023-11-28T19:32:08.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.590+0000 7fae37eec640 1 -- 172.21.15.28:0/1989216791 wait complete. 2023-11-28T19:32:08.608 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-11-28T19:32:08.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:08.609 DEBUG:teuthology.orchestra.run.smithi203:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-11-28T19:32:08.655 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi203.front.sepia.ceph.com 2023-11-28T19:32:08.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:08.656 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-11-28T19:32:08.728 INFO:tasks.cephfs.cephfs_test_case:[] 2023-11-28T19:32:08.728 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:32:08.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4dc92b640 1 Processor -- start 2023-11-28T19:32:08.855 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4dc92b640 1 -- start start 2023-11-28T19:32:08.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4dc92b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa4d806aaf0 0x7fa4d806aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4dc92b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa4d814bdf0 0x7fa4d8155da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4dc92b640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d80bd5e0 con 0x7fa4d814ac70 2023-11-28T19:32:08.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4dc92b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d80bc1c0 con 0x7fa4d806aaf0 2023-11-28T19:32:08.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4dc92b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d806bca0 con 0x7fa4d814bdf0 2023-11-28T19:32:08.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4d659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa4d806aaf0 0x7fa4d806aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4d659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fa4d806aaf0 0x7fa4d806aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55978/0 (socket says 172.21.15.28:55978) 2023-11-28T19:32:08.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4d659c640 1 -- 172.21.15.28:0/3052048594 learned_addr learned my addr 172.21.15.28:0/3052048594 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:08.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4d6d9d640 1 --2- 172.21.15.28:0/3052048594 >> v2:172.21.15.131:3300/0 conn(0x7fa4d814bdf0 0x7fa4d8155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4d659c640 1 -- 172.21.15.28:0/3052048594 >> v2:172.21.15.131:3300/0 conn(0x7fa4d814bdf0 msgr2=0x7fa4d8155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:08.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4d659c640 1 --2- 172.21.15.28:0/3052048594 >> v2:172.21.15.131:3300/0 conn(0x7fa4d814bdf0 0x7fa4d8155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4d659c640 1 -- 172.21.15.28:0/3052048594 >> v1:172.21.15.131:6789/0 conn(0x7fa4d814ac70 legacy=0x7fa4d814b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4d659c640 1 -- 172.21.15.28:0/3052048594 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d806b7a0 con 0x7fa4d806aaf0 2023-11-28T19:32:08.857 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.854+0000 7fa4d6d9d640 1 --2- 172.21.15.28:0/3052048594 >> v2:172.21.15.131:3300/0 conn(0x7fa4d814bdf0 0x7fa4d8155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:08.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4d659c640 1 --2- 172.21.15.28:0/3052048594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4d806aaf0 0x7fa4d806aed0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80a0620 tx=0x7fa4c801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd740344616e0b8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:08.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4d559a640 1 -- 172.21.15.28:0/3052048594 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c80ac640 con 0x7fa4d806aaf0 2023-11-28T19:32:08.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4d559a640 1 -- 172.21.15.28:0/3052048594 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c80ac7a0 con 0x7fa4d806aaf0 2023-11-28T19:32:08.858 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4d559a640 1 -- 172.21.15.28:0/3052048594 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c80acb30 con 0x7fa4d806aaf0 2023-11-28T19:32:08.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 -- 172.21.15.28:0/3052048594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4d806aaf0 msgr2=0x7fa4d806aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 --2- 172.21.15.28:0/3052048594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4d806aaf0 0x7fa4d806aed0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fa4d80a0620 tx=0x7fa4c801c4d0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 -- 172.21.15.28:0/3052048594 shutdown_connections 2023-11-28T19:32:08.859 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 --2- 172.21.15.28:0/3052048594 >> v2:172.21.15.131:3300/0 conn(0x7fa4d814bdf0 0x7fa4d8155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 --2- 172.21.15.28:0/3052048594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4d806aaf0 0x7fa4d806aed0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 -- 172.21.15.28:0/3052048594 >> 172.21.15.28:0/3052048594 conn(0x7fa4d80bd790 msgr2=0x7fa4d80bdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:08.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 -- 172.21.15.28:0/3052048594 shutdown_connections 2023-11-28T19:32:08.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 -- 172.21.15.28:0/3052048594 wait complete. 2023-11-28T19:32:08.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 Processor -- start 2023-11-28T19:32:08.860 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 -- start start 2023-11-28T19:32:08.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4d806aaf0 0x7fa4d8144a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4d814ac70 0x7fa4d81e42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d814bdf0 0x7fa4d81ddeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d80a41e0 con 0x7fa4d814ac70 2023-11-28T19:32:08.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d8144fb0 con 0x7fa4d814bdf0 2023-11-28T19:32:08.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4dc92b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d81dda20 con 0x7fa4d806aaf0 2023-11-28T19:32:08.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.858+0000 7fa4d5d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4d814ac70 0x7fa4d81e42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4d5d9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4d814ac70 0x7fa4d81e42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:55994/0 (socket says 172.21.15.28:55994) 2023-11-28T19:32:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4d5d9b640 1 -- 172.21.15.28:0/1434980647 learned_addr learned my addr 172.21.15.28:0/1434980647 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4d659c640 1 --2- 172.21.15.28:0/1434980647 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4d806aaf0 0x7fa4d8144a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4d6d9d640 1 --2- 172.21.15.28:0/1434980647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d814bdf0 0x7fa4d81ddeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4d5d9b640 1 -- 172.21.15.28:0/1434980647 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4d806aaf0 msgr2=0x7fa4d8144a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4d5d9b640 1 --2- 172.21.15.28:0/1434980647 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4d806aaf0 0x7fa4d8144a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4d5d9b640 1 -- 172.21.15.28:0/1434980647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d814bdf0 msgr2=0x7fa4d81ddeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4d5d9b640 1 --2- 172.21.15.28:0/1434980647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d814bdf0 0x7fa4d81ddeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4d5d9b640 1 -- 172.21.15.28:0/1434980647 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c80094d0 con 0x7fa4d814ac70 2023-11-28T19:32:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4d5d9b640 1 --2- 172.21.15.28:0/1434980647 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4d814ac70 0x7fa4d81e42d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c530 tx=0x7fa4cc00c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:08.864 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4c6ffd640 1 -- 172.21.15.28:0/1434980647 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc005220 con 0x7fa4d814ac70 2023-11-28T19:32:08.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4c6ffd640 1 -- 172.21.15.28:0/1434980647 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc005380 con 0x7fa4d814ac70 2023-11-28T19:32:08.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4c6ffd640 1 -- 172.21.15.28:0/1434980647 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc007270 con 0x7fa4d814ac70 2023-11-28T19:32:08.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4dc92b640 1 -- 172.21.15.28:0/1434980647 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d81e4b40 con 0x7fa4d814ac70 2023-11-28T19:32:08.865 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4dc92b640 1 -- 172.21.15.28:0/1434980647 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d81e5100 con 0x7fa4d814ac70 2023-11-28T19:32:08.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4dc92b640 1 -- 172.21.15.28:0/1434980647 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d8074a90 con 0x7fa4d814ac70 2023-11-28T19:32:08.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4c6ffd640 1 -- 172.21.15.28:0/1434980647 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa4cc0073d0 con 0x7fa4d814ac70 2023-11-28T19:32:08.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4c6ffd640 1 --2- 172.21.15.28:0/1434980647 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa4b80664a0 0x7fa4b8068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:08.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4c6ffd640 1 -- 172.21.15.28:0/1434980647 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4cc083620 con 0x7fa4d814ac70 2023-11-28T19:32:08.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.862+0000 7fa4d659c640 1 --2- 172.21.15.28:0/1434980647 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa4b80664a0 0x7fa4b8068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:08.866 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.866+0000 7fa4d659c640 1 --2- 172.21.15.28:0/1434980647 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa4b80664a0 0x7fa4b8068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80ae000 tx=0x7fa4c80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:08.868 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:08.866+0000 7fa4c6ffd640 1 -- 172.21.15.28:0/1434980647 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fa4cc050b30 con 0x7fa4d814ac70 2023-11-28T19:32:09.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.046+0000 7fa4dc92b640 1 -- 172.21.15.28:0/1434980647 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa4d81ddb60 con 0x7fa4d814ac70 2023-11-28T19:32:09.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.050+0000 7fa4c6ffd640 1 -- 172.21.15.28:0/1434980647 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7fa4cc054150 con 0x7fa4d814ac70 2023-11-28T19:32:09.050 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:09.050 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3575778574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3575778574},{"type":"v1","addr":"172.21.15.131:6835","nonce":3575778574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6833/1578638846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1578638846},{"type":"v1","addr":"172.21.15.28:6833","nonce":1578638846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:31:44.589007+0000","modified":"2023-11-28T19:31:47.643502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2598774147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2598774147},{"type":"v1","addr":"172.21.15.28:6835","nonce":2598774147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:32:09.050 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-11-28T19:32:09.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.050+0000 7fa4dc92b640 1 -- 172.21.15.28:0/1434980647 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa4b80664a0 msgr2=0x7fa4b8068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.050+0000 7fa4dc92b640 1 --2- 172.21.15.28:0/1434980647 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa4b80664a0 0x7fa4b8068960 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fa4c80ae000 tx=0x7fa4c80a7000 comp rx=0 tx=0).stop 2023-11-28T19:32:09.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.050+0000 7fa4dc92b640 1 -- 172.21.15.28:0/1434980647 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4d814ac70 msgr2=0x7fa4d81e42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.050+0000 7fa4dc92b640 1 --2- 172.21.15.28:0/1434980647 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4d814ac70 0x7fa4d81e42d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fa4cc00c530 tx=0x7fa4cc00c9f0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.050+0000 7fa4dc92b640 1 -- 172.21.15.28:0/1434980647 shutdown_connections 2023-11-28T19:32:09.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.050+0000 7fa4dc92b640 1 --2- 172.21.15.28:0/1434980647 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa4b80664a0 0x7fa4b8068960 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.050+0000 7fa4dc92b640 1 --2- 172.21.15.28:0/1434980647 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4d814bdf0 0x7fa4d81ddeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.050+0000 7fa4dc92b640 1 --2- 172.21.15.28:0/1434980647 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa4d814ac70 0x7fa4d81e42d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.050+0000 7fa4dc92b640 1 --2- 172.21.15.28:0/1434980647 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa4d806aaf0 0x7fa4d8144a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.050+0000 7fa4dc92b640 1 -- 172.21.15.28:0/1434980647 >> 172.21.15.28:0/1434980647 conn(0x7fa4d80bd790 msgr2=0x7fa4d80bfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:09.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.050+0000 7fa4dc92b640 1 -- 172.21.15.28:0/1434980647 shutdown_connections 2023-11-28T19:32:09.053 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.050+0000 7fa4dc92b640 1 -- 172.21.15.28:0/1434980647 wait complete. 2023-11-28T19:32:09.067 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:32:09.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09b880640 1 Processor -- start 2023-11-28T19:32:09.182 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09b880640 1 -- start start 2023-11-28T19:32:09.183 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09b880640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe0940b8f30 0x7fe094071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09b880640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe09414c860 0x7fe0940b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09b880640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe09414ccc0 0x7fe0940b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09b880640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0940b6cd0 con 0x7fe0940b8f30 2023-11-28T19:32:09.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09b880640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe094143aa0 con 0x7fe09414c860 2023-11-28T19:32:09.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09b880640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe09406f780 con 0x7fe09414ccc0 2023-11-28T19:32:09.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09961c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe0940b8f30 0x7fe094071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09961c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe0940b8f30 0x7fe094071790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56002/0 (socket says 172.21.15.28:56002) 2023-11-28T19:32:09.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09961c640 1 -- 172.21.15.28:0/1538130654 learned_addr learned my addr 172.21.15.28:0/1538130654 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:09.184 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe099e1d640 1 --2- 172.21.15.28:0/1538130654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe09414ccc0 0x7fe0940b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe098e1b640 1 --2- 172.21.15.28:0/1538130654 >> v2:172.21.15.131:3300/0 conn(0x7fe09414c860 0x7fe0940b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09961c640 1 -- 172.21.15.28:0/1538130654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe09414ccc0 msgr2=0x7fe0940b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:09.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09961c640 1 --2- 172.21.15.28:0/1538130654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe09414ccc0 0x7fe0940b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09961c640 1 -- 172.21.15.28:0/1538130654 >> v2:172.21.15.131:3300/0 conn(0x7fe09414c860 msgr2=0x7fe0940b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:09.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09961c640 1 --2- 172.21.15.28:0/1538130654 >> v2:172.21.15.131:3300/0 conn(0x7fe09414c860 0x7fe0940b6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.185 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.182+0000 7fe09961c640 1 -- 172.21.15.28:0/1538130654 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe094072320 con 0x7fe0940b8f30 2023-11-28T19:32:09.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09961c640 1 --2- 172.21.15.28:0/1538130654 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0940b8f30 0x7fe094071790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe094071580 tx=0x7fe09001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88f2a90442a43f2c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:09.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe08bfff640 1 -- 172.21.15.28:0/1538130654 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0900ab600 con 0x7fe0940b8f30 2023-11-28T19:32:09.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe08bfff640 1 -- 172.21.15.28:0/1538130654 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0900a7050 con 0x7fe0940b8f30 2023-11-28T19:32:09.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe08bfff640 1 -- 172.21.15.28:0/1538130654 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0900ab980 con 0x7fe0940b8f30 2023-11-28T19:32:09.187 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 -- 172.21.15.28:0/1538130654 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0940b8f30 msgr2=0x7fe094071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 --2- 172.21.15.28:0/1538130654 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0940b8f30 0x7fe094071790 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe094071580 tx=0x7fe09001c4d0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 -- 172.21.15.28:0/1538130654 shutdown_connections 2023-11-28T19:32:09.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 --2- 172.21.15.28:0/1538130654 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe09414ccc0 0x7fe0940b6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 --2- 172.21.15.28:0/1538130654 >> v2:172.21.15.131:3300/0 conn(0x7fe09414c860 0x7fe0940b6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 --2- 172.21.15.28:0/1538130654 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0940b8f30 0x7fe094071790 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 -- 172.21.15.28:0/1538130654 >> 172.21.15.28:0/1538130654 conn(0x7fe0940bcb40 msgr2=0x7fe0940bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:09.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 -- 172.21.15.28:0/1538130654 shutdown_connections 2023-11-28T19:32:09.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 -- 172.21.15.28:0/1538130654 wait complete. 2023-11-28T19:32:09.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 Processor -- start 2023-11-28T19:32:09.190 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 -- start start 2023-11-28T19:32:09.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0940b8f30 0x7fe0940b9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe09414c860 0x7fe094138060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09414ccc0 0x7fe094133e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0940b9ab0 con 0x7fe09414ccc0 2023-11-28T19:32:09.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0941e1b90 con 0x7fe0940b8f30 2023-11-28T19:32:09.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09b880640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0941e1e70 con 0x7fe09414c860 2023-11-28T19:32:09.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe099e1d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09414ccc0 0x7fe094133e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe099e1d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09414ccc0 0x7fe094133e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56018/0 (socket says 172.21.15.28:56018) 2023-11-28T19:32:09.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe099e1d640 1 -- 172.21.15.28:0/3898225419 learned_addr learned my addr 172.21.15.28:0/3898225419 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:09.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.186+0000 7fe09961c640 1 --2- 172.21.15.28:0/3898225419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0940b8f30 0x7fe0940b9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe099e1d640 1 -- 172.21.15.28:0/3898225419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe09414c860 msgr2=0x7fe094138060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe099e1d640 1 --2- 172.21.15.28:0/3898225419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe09414c860 0x7fe094138060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe099e1d640 1 -- 172.21.15.28:0/3898225419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0940b8f30 msgr2=0x7fe0940b9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe099e1d640 1 --2- 172.21.15.28:0/3898225419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0940b8f30 0x7fe0940b9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe099e1d640 1 -- 172.21.15.28:0/3898225419 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0900094d0 con 0x7fe09414ccc0 2023-11-28T19:32:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe09961c640 1 --2- 172.21.15.28:0/3898225419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0940b8f30 0x7fe0940b9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe099e1d640 1 --2- 172.21.15.28:0/3898225419 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09414ccc0 0x7fe094133e20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009fd0 tx=0x7fe08c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe089ffb640 1 -- 172.21.15.28:0/3898225419 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c014420 con 0x7fe09414ccc0 2023-11-28T19:32:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe089ffb640 1 -- 172.21.15.28:0/3898225419 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe08c014580 con 0x7fe09414ccc0 2023-11-28T19:32:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe089ffb640 1 -- 172.21.15.28:0/3898225419 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe08c014930 con 0x7fe09414ccc0 2023-11-28T19:32:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe09b880640 1 -- 172.21.15.28:0/3898225419 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0941e2150 con 0x7fe09414ccc0 2023-11-28T19:32:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe09b880640 1 -- 172.21.15.28:0/3898225419 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0941e2950 con 0x7fe09414ccc0 2023-11-28T19:32:09.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe09b880640 1 -- 172.21.15.28:0/3898225419 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe094074a90 con 0x7fe09414ccc0 2023-11-28T19:32:09.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe089ffb640 1 -- 172.21.15.28:0/3898225419 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe08c014a90 con 0x7fe09414ccc0 2023-11-28T19:32:09.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe089ffb640 1 --2- 172.21.15.28:0/3898225419 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe0780664a0 0x7fe078068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe089ffb640 1 -- 172.21.15.28:0/3898225419 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe08c084770 con 0x7fe09414ccc0 2023-11-28T19:32:09.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe09961c640 1 --2- 172.21.15.28:0/3898225419 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe0780664a0 0x7fe078068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.194 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.190+0000 7fe09961c640 1 --2- 172.21.15.28:0/3898225419 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe0780664a0 0x7fe078068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe0900ad000 tx=0x7fe0900a6000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:09.196 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.194+0000 7fe089ffb640 1 -- 172.21.15.28:0/3898225419 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe08c051b60 con 0x7fe09414ccc0 2023-11-28T19:32:09.350 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.346+0000 7fe09b880640 1 -- 172.21.15.28:0/3898225419 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0941e2600 con 0x7fe09414ccc0 2023-11-28T19:32:09.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.350+0000 7fe089ffb640 1 -- 172.21.15.28:0/3898225419 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fe08c055180 con 0x7fe09414ccc0 2023-11-28T19:32:09.352 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:09.352 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:32:09.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.350+0000 7fe09b880640 1 -- 172.21.15.28:0/3898225419 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe0780664a0 msgr2=0x7fe078068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.350+0000 7fe09b880640 1 --2- 172.21.15.28:0/3898225419 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe0780664a0 0x7fe078068960 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe0900ad000 tx=0x7fe0900a6000 comp rx=0 tx=0).stop 2023-11-28T19:32:09.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.350+0000 7fe09b880640 1 -- 172.21.15.28:0/3898225419 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09414ccc0 msgr2=0x7fe094133e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.350+0000 7fe09b880640 1 --2- 172.21.15.28:0/3898225419 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09414ccc0 0x7fe094133e20 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe08c009fd0 tx=0x7fe08c00e4b0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.350+0000 7fe09b880640 1 -- 172.21.15.28:0/3898225419 shutdown_connections 2023-11-28T19:32:09.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.350+0000 7fe09b880640 1 --2- 172.21.15.28:0/3898225419 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe0780664a0 0x7fe078068960 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.350+0000 7fe09b880640 1 --2- 172.21.15.28:0/3898225419 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe09414ccc0 0x7fe094133e20 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.350+0000 7fe09b880640 1 --2- 172.21.15.28:0/3898225419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe09414c860 0x7fe094138060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.350+0000 7fe09b880640 1 --2- 172.21.15.28:0/3898225419 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0940b8f30 0x7fe0940b9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.350+0000 7fe09b880640 1 -- 172.21.15.28:0/3898225419 >> 172.21.15.28:0/3898225419 conn(0x7fe0940bcb40 msgr2=0x7fe09413ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:09.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.350+0000 7fe09b880640 1 -- 172.21.15.28:0/3898225419 shutdown_connections 2023-11-28T19:32:09.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.354+0000 7fe09b880640 1 -- 172.21.15.28:0/3898225419 wait complete. 2023-11-28T19:32:09.370 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:31:33.212362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-11-28T19:31:42.810956+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-11-28T19:31:43.579438+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T19:32:09.371 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:32:09.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f607c0f4640 1 Processor -- start 2023-11-28T19:32:09.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f607c0f4640 1 -- start start 2023-11-28T19:32:09.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f607c0f4640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f60740bc120 0x7f60740bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f607c0f4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6074072940 0x7f6074153c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f607c0f4640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6074143b60 con 0x7f60740a2d60 2023-11-28T19:32:09.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f607c0f4640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60740b6f30 con 0x7f60740bc120 2023-11-28T19:32:09.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f607c0f4640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60740b7aa0 con 0x7f6074072940 2023-11-28T19:32:09.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f6079e90640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f60740bc120 0x7f60740bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f6079e90640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f60740bc120 0x7f60740bd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56034/0 (socket says 172.21.15.28:56034) 2023-11-28T19:32:09.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f6079e90640 1 -- 172.21.15.28:0/1137380686 learned_addr learned my addr 172.21.15.28:0/1137380686 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:09.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f607a691640 1 --2- 172.21.15.28:0/1137380686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6074072940 0x7f6074153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f6079e90640 1 -- 172.21.15.28:0/1137380686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6074072940 msgr2=0x7f6074153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:09.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f6079e90640 1 --2- 172.21.15.28:0/1137380686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6074072940 0x7f6074153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f6079e90640 1 -- 172.21.15.28:0/1137380686 >> v1:172.21.15.131:6789/0 conn(0x7f60740a2d60 legacy=0x7f607414c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:09.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f6079e90640 1 -- 172.21.15.28:0/1137380686 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60740b7d60 con 0x7f60740bc120 2023-11-28T19:32:09.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.506+0000 7f607a691640 1 --2- 172.21.15.28:0/1137380686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6074072940 0x7f6074153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:09.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f6079e90640 1 --2- 172.21.15.28:0/1137380686 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60740bc120 0x7f60740bd0e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f60740b7070 tx=0x7f607001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2f33ae1718a220 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:09.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f6078e8e640 1 -- 172.21.15.28:0/1137380686 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700a8990 con 0x7f60740bc120 2023-11-28T19:32:09.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f6078e8e640 1 -- 172.21.15.28:0/1137380686 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60700a8af0 con 0x7f60740bc120 2023-11-28T19:32:09.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f6078e8e640 1 -- 172.21.15.28:0/1137380686 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60700a8e80 con 0x7f60740bc120 2023-11-28T19:32:09.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 -- 172.21.15.28:0/1137380686 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60740bc120 msgr2=0x7f60740bd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 --2- 172.21.15.28:0/1137380686 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60740bc120 0x7f60740bd0e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f60740b7070 tx=0x7f607001ecd0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 -- 172.21.15.28:0/1137380686 shutdown_connections 2023-11-28T19:32:09.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 --2- 172.21.15.28:0/1137380686 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6074072940 0x7f6074153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 --2- 172.21.15.28:0/1137380686 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60740bc120 0x7f60740bd0e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 -- 172.21.15.28:0/1137380686 >> 172.21.15.28:0/1137380686 conn(0x7f607406ab80 msgr2=0x7f60740bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:09.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 -- 172.21.15.28:0/1137380686 shutdown_connections 2023-11-28T19:32:09.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 -- 172.21.15.28:0/1137380686 wait complete. 2023-11-28T19:32:09.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 Processor -- start 2023-11-28T19:32:09.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 -- start start 2023-11-28T19:32:09.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6074072940 0x7f6074149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60740a2d60 0x7f60741462e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60740bc120 0x7f6074146820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60741489a0 con 0x7f60740a2d60 2023-11-28T19:32:09.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60741495f0 con 0x7f60740bc120 2023-11-28T19:32:09.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6074147ae0 con 0x7f6074072940 2023-11-28T19:32:09.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607968f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60740a2d60 0x7f60741462e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607968f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60740a2d60 0x7f60741462e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56038/0 (socket says 172.21.15.28:56038) 2023-11-28T19:32:09.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607968f640 1 -- 172.21.15.28:0/889489152 learned_addr learned my addr 172.21.15.28:0/889489152 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:09.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f6079e90640 1 --2- 172.21.15.28:0/889489152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6074072940 0x7f6074149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607a691640 1 --2- 172.21.15.28:0/889489152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60740bc120 0x7f6074146820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607968f640 1 -- 172.21.15.28:0/889489152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6074072940 msgr2=0x7f6074149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607968f640 1 --2- 172.21.15.28:0/889489152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6074072940 0x7f6074149d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607968f640 1 -- 172.21.15.28:0/889489152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60740bc120 msgr2=0x7f6074146820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607968f640 1 --2- 172.21.15.28:0/889489152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60740bc120 0x7f6074146820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607968f640 1 -- 172.21.15.28:0/889489152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60700094d0 con 0x7f60740a2d60 2023-11-28T19:32:09.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607968f640 1 --2- 172.21.15.28:0/889489152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60740a2d60 0x7f60741462e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f606400c410 tx=0x7f606400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:09.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f606a7fc640 1 -- 172.21.15.28:0/889489152 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064011790 con 0x7f60740a2d60 2023-11-28T19:32:09.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f606a7fc640 1 -- 172.21.15.28:0/889489152 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60640118f0 con 0x7f60740a2d60 2023-11-28T19:32:09.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 -- 172.21.15.28:0/889489152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6074147dc0 con 0x7f60740a2d60 2023-11-28T19:32:09.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f606a7fc640 1 -- 172.21.15.28:0/889489152 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064011ce0 con 0x7f60740a2d60 2023-11-28T19:32:09.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.510+0000 7f607c0f4640 1 -- 172.21.15.28:0/889489152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6074148380 con 0x7f60740a2d60 2023-11-28T19:32:09.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.514+0000 7f607c0f4640 1 -- 172.21.15.28:0/889489152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6074148510 con 0x7f60740a2d60 2023-11-28T19:32:09.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.514+0000 7f606a7fc640 1 -- 172.21.15.28:0/889489152 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f606401c460 con 0x7f60740a2d60 2023-11-28T19:32:09.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.514+0000 7f606a7fc640 1 --2- 172.21.15.28:0/889489152 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6058066470 0x7f6058068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.514+0000 7f606a7fc640 1 -- 172.21.15.28:0/889489152 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6064083b80 con 0x7f60740a2d60 2023-11-28T19:32:09.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.514+0000 7f6079e90640 1 --2- 172.21.15.28:0/889489152 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6058066470 0x7f6058068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.514+0000 7f6079e90640 1 --2- 172.21.15.28:0/889489152 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6058066470 0x7f6058068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f60700b2000 tx=0x7f60700aa070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:09.521 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.518+0000 7f606a7fc640 1 -- 172.21.15.28:0/889489152 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6064051000 con 0x7f60740a2d60 2023-11-28T19:32:09.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.678+0000 7f607c0f4640 1 -- 172.21.15.28:0/889489152 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6074074a90 con 0x7f60740a2d60 2023-11-28T19:32:09.681 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.678+0000 7f606a7fc640 1 -- 172.21.15.28:0/889489152 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6064054620 con 0x7f60740a2d60 2023-11-28T19:32:09.681 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-28T19:32:09.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.682+0000 7f607c0f4640 1 -- 172.21.15.28:0/889489152 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6058066470 msgr2=0x7f6058068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.682+0000 7f607c0f4640 1 --2- 172.21.15.28:0/889489152 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6058066470 0x7f6058068930 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f60700b2000 tx=0x7f60700aa070 comp rx=0 tx=0).stop 2023-11-28T19:32:09.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.682+0000 7f607c0f4640 1 -- 172.21.15.28:0/889489152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60740a2d60 msgr2=0x7f60741462e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.682+0000 7f607c0f4640 1 --2- 172.21.15.28:0/889489152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60740a2d60 0x7f60741462e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f606400c410 tx=0x7f606400c8d0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.682+0000 7f607c0f4640 1 -- 172.21.15.28:0/889489152 shutdown_connections 2023-11-28T19:32:09.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.682+0000 7f607c0f4640 1 --2- 172.21.15.28:0/889489152 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6058066470 0x7f6058068930 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.682+0000 7f607c0f4640 1 --2- 172.21.15.28:0/889489152 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f60740bc120 0x7f6074146820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.682+0000 7f607c0f4640 1 --2- 172.21.15.28:0/889489152 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f60740a2d60 0x7f60741462e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.682+0000 7f607c0f4640 1 --2- 172.21.15.28:0/889489152 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6074072940 0x7f6074149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.682+0000 7f607c0f4640 1 -- 172.21.15.28:0/889489152 >> 172.21.15.28:0/889489152 conn(0x7f607406ab80 msgr2=0x7f60740b9430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:09.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.682+0000 7f607c0f4640 1 -- 172.21.15.28:0/889489152 shutdown_connections 2023-11-28T19:32:09.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.682+0000 7f607c0f4640 1 -- 172.21.15.28:0/889489152 wait complete. 2023-11-28T19:32:09.701 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-11-28T19:32:09.822 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b701ec640 1 Processor -- start 2023-11-28T19:32:09.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b701ec640 1 -- start start 2023-11-28T19:32:09.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b701ec640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0b680bab20 0x7f0b680b5100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b701ec640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b680b4650 con 0x7f0b6806f540 2023-11-28T19:32:09.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b701ec640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6806d440 con 0x7f0b680b59c0 2023-11-28T19:32:09.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b701ec640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b680b42e0 con 0x7f0b680bab20 2023-11-28T19:32:09.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6e789640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0b6806f540 0x7f0b68155dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52070/0 (socket says 172.21.15.28:52070) 2023-11-28T19:32:09.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6e789640 1 -- 172.21.15.28:0/3497238353 learned_addr learned my addr 172.21.15.28:0/3497238353 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:09.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6df88640 1 --2- 172.21.15.28:0/3497238353 >> v2:172.21.15.131:3300/0 conn(0x7f0b680bab20 0x7f0b680b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 -- 172.21.15.28:0/3497238353 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 568384680 0 0) 0x7f0b680b4650 con 0x7f0b6806f540 2023-11-28T19:32:09.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 -- 172.21.15.28:0/3497238353 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0b54003530 con 0x7f0b6806f540 2023-11-28T19:32:09.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 -- 172.21.15.28:0/3497238353 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 30353441 0 0) 0x7f0b54003530 con 0x7f0b6806f540 2023-11-28T19:32:09.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 -- 172.21.15.28:0/3497238353 >> v2:172.21.15.131:3300/0 conn(0x7f0b680bab20 msgr2=0x7f0b680b5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:09.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 --2- 172.21.15.28:0/3497238353 >> v2:172.21.15.131:3300/0 conn(0x7f0b680bab20 0x7f0b680b5100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 -- 172.21.15.28:0/3497238353 >> v1:172.21.15.131:6789/0 conn(0x7f0b680b59c0 legacy=0x7f0b6814b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 -- 172.21.15.28:0/3497238353 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b680baf00 con 0x7f0b6806f540 2023-11-28T19:32:09.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 -- 172.21.15.28:0/3497238353 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f0b60001a00 con 0x7f0b6806f540 2023-11-28T19:32:09.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 -- 172.21.15.28:0/3497238353 >> v1:172.21.15.28:6789/0 conn(0x7f0b6806f540 legacy=0x7f0b68155dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 --2- 172.21.15.28:0/3497238353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b54003980 0x7f0b54003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 --2- 172.21.15.28:0/3497238353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b540047d0 0x7f0b54004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 --2- 172.21.15.28:0/3497238353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b540052b0 0x7f0b5400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 -- 172.21.15.28:0/3497238353 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b680b42e0 con 0x7f0b54003980 2023-11-28T19:32:09.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 -- 172.21.15.28:0/3497238353 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5400c180 con 0x7f0b540047d0 2023-11-28T19:32:09.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6cf86640 1 -- 172.21.15.28:0/3497238353 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5400c340 con 0x7f0b540052b0 2023-11-28T19:32:09.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6df88640 1 --2- 172.21.15.28:0/3497238353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b54003980 0x7f0b54003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6d787640 1 --2- 172.21.15.28:0/3497238353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b540047d0 0x7f0b54004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6e789640 1 --2- 172.21.15.28:0/3497238353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b540052b0 0x7f0b5400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6df88640 1 -- 172.21.15.28:0/3497238353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b540052b0 msgr2=0x7f0b5400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:09.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6df88640 1 --2- 172.21.15.28:0/3497238353 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b540052b0 0x7f0b5400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6df88640 1 -- 172.21.15.28:0/3497238353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b540047d0 msgr2=0x7f0b54004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:09.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6df88640 1 --2- 172.21.15.28:0/3497238353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b540047d0 0x7f0b54004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6df88640 1 -- 172.21.15.28:0/3497238353 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b54003530 con 0x7f0b54003980 2023-11-28T19:32:09.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6d787640 1 --2- 172.21.15.28:0/3497238353 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b540047d0 0x7f0b54004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:09.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.822+0000 7f0b6e789640 1 -- 172.21.15.28:0/3497238353 reap_dead start 2023-11-28T19:32:09.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.826+0000 7f0b6df88640 1 --2- 172.21.15.28:0/3497238353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b54003980 0x7f0b54003da0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009ab0 tx=0x7f0b5801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a312912c23aa2f2e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:09.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.826+0000 7f0b6cf86640 1 -- 172.21.15.28:0/3497238353 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580aa480 con 0x7f0b54003980 2023-11-28T19:32:09.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.826+0000 7f0b6cf86640 1 -- 172.21.15.28:0/3497238353 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b580aa5e0 con 0x7f0b54003980 2023-11-28T19:32:09.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.826+0000 7f0b6cf86640 1 -- 172.21.15.28:0/3497238353 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580aa990 con 0x7f0b54003980 2023-11-28T19:32:09.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.826+0000 7f0b701ec640 1 -- 172.21.15.28:0/3497238353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b54003980 msgr2=0x7f0b54003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.826+0000 7f0b701ec640 1 --2- 172.21.15.28:0/3497238353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b54003980 0x7f0b54003da0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0b58009ab0 tx=0x7f0b5801ca10 comp rx=0 tx=0).stop 2023-11-28T19:32:09.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.826+0000 7f0b701ec640 1 -- 172.21.15.28:0/3497238353 shutdown_connections 2023-11-28T19:32:09.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.826+0000 7f0b701ec640 1 --2- 172.21.15.28:0/3497238353 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b54003980 0x7f0b54003da0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.826+0000 7f0b701ec640 1 -- 172.21.15.28:0/3497238353 >> 172.21.15.28:0/3497238353 conn(0x7f0b680beaf0 msgr2=0x7f0b680bef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:09.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.826+0000 7f0b701ec640 1 -- 172.21.15.28:0/3497238353 shutdown_connections 2023-11-28T19:32:09.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.826+0000 7f0b701ec640 1 -- 172.21.15.28:0/3497238353 wait complete. 2023-11-28T19:32:09.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b701ec640 1 Processor -- start 2023-11-28T19:32:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b701ec640 1 -- start start 2023-11-28T19:32:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b701ec640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b54003980 0x7f0b6813f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b701ec640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b6813be00 0x7f0b681e78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b701ec640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b68135c00 0x7f0b68136060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b701ec640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6813f870 con 0x7f0b54003980 2023-11-28T19:32:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b701ec640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6814db80 con 0x7f0b68135c00 2023-11-28T19:32:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b701ec640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6814c6e0 con 0x7f0b6813be00 2023-11-28T19:32:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b6df88640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b54003980 0x7f0b6813f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b6df88640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b54003980 0x7f0b6813f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56052/0 (socket says 172.21.15.28:56052) 2023-11-28T19:32:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b6df88640 1 -- 172.21.15.28:0/1001908006 learned_addr learned my addr 172.21.15.28:0/1001908006 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b6e789640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b68135c00 0x7f0b68136060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.835 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b6d787640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b6813be00 0x7f0b681e78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b6df88640 1 -- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b6813be00 msgr2=0x7f0b681e78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b6df88640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b6813be00 0x7f0b681e78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b6df88640 1 -- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b68135c00 msgr2=0x7f0b68136060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b6df88640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b68135c00 0x7f0b68136060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b6df88640 1 -- 172.21.15.28:0/1001908006 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6814d530 con 0x7f0b54003980 2023-11-28T19:32:09.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b6d787640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b6813be00 0x7f0b681e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:09.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b6e789640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b68135c00 0x7f0b68136060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:09.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b6df88640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b54003980 0x7f0b6813f330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0b580ac040 tx=0x7f0b54005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:09.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b5e7fc640 1 -- 172.21.15.28:0/1001908006 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b58005ce0 con 0x7f0b54003980 2023-11-28T19:32:09.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b5e7fc640 1 -- 172.21.15.28:0/1001908006 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b58005e40 con 0x7f0b54003980 2023-11-28T19:32:09.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b701ec640 1 -- 172.21.15.28:0/1001908006 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6814d810 con 0x7f0b54003980 2023-11-28T19:32:09.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b5e7fc640 1 -- 172.21.15.28:0/1001908006 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b580aa950 con 0x7f0b54003980 2023-11-28T19:32:09.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b701ec640 1 -- 172.21.15.28:0/1001908006 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b681e7e20 con 0x7f0b54003980 2023-11-28T19:32:09.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b701ec640 1 -- 172.21.15.28:0/1001908006 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6814d390 con 0x7f0b54003980 2023-11-28T19:32:09.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b5e7fc640 1 -- 172.21.15.28:0/1001908006 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0b580aaab0 con 0x7f0b54003980 2023-11-28T19:32:09.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b5e7fc640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0b4c0664a0 0x7f0b4c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:09.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.830+0000 7f0b5e7fc640 1 -- 172.21.15.28:0/1001908006 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b5811e2c0 con 0x7f0b54003980 2023-11-28T19:32:09.837 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.834+0000 7f0b6d787640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0b4c0664a0 0x7f0b4c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:09.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.834+0000 7f0b6d787640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0b4c0664a0 0x7f0b4c068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0b6814ac80 tx=0x7f0b64009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:09.838 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.838+0000 7f0b5e7fc640 1 -- 172.21.15.28:0/1001908006 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0b6814d390 con 0x7f0b54003980 2023-11-28T19:32:09.987 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.986+0000 7f0b701ec640 1 -- 172.21.15.28:0/1001908006 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0b6814d390 con 0x7f0b54003980 2023-11-28T19:32:09.988 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.986+0000 7f0b5e7fc640 1 -- 172.21.15.28:0/1001908006 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v21) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0b6814d390 con 0x7f0b54003980 2023-11-28T19:32:09.988 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 32 2023-11-28T19:32:09.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.990+0000 7f0b701ec640 1 -- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0b4c0664a0 msgr2=0x7f0b4c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.990+0000 7f0b701ec640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0b4c0664a0 0x7f0b4c068960 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f0b6814ac80 tx=0x7f0b64009040 comp rx=0 tx=0).stop 2023-11-28T19:32:09.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.990+0000 7f0b701ec640 1 -- 172.21.15.28:0/1001908006 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b54003980 msgr2=0x7f0b6813f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:09.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.990+0000 7f0b701ec640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b54003980 0x7f0b6813f330 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0b580ac040 tx=0x7f0b54005800 comp rx=0 tx=0).stop 2023-11-28T19:32:09.990 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.990+0000 7f0b701ec640 1 -- 172.21.15.28:0/1001908006 shutdown_connections 2023-11-28T19:32:09.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.990+0000 7f0b701ec640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0b4c0664a0 0x7f0b4c068960 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.990+0000 7f0b701ec640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b68135c00 0x7f0b68136060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.990+0000 7f0b701ec640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0b6813be00 0x7f0b681e78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.990+0000 7f0b701ec640 1 --2- 172.21.15.28:0/1001908006 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0b54003980 0x7f0b6813f330 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:09.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.990+0000 7f0b701ec640 1 -- 172.21.15.28:0/1001908006 >> 172.21.15.28:0/1001908006 conn(0x7f0b680beaf0 msgr2=0x7f0b6806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:09.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.990+0000 7f0b701ec640 1 -- 172.21.15.28:0/1001908006 shutdown_connections 2023-11-28T19:32:09.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:09.990+0000 7f0b701ec640 1 -- 172.21.15.28:0/1001908006 wait complete. 2023-11-28T19:32:10.009 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-11-28T19:32:10.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.130+0000 7fe0255ae640 1 Processor -- start 2023-11-28T19:32:10.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.130+0000 7fe0255ae640 1 -- start start 2023-11-28T19:32:10.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe0255ae640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe020145220 0x7fe0200ba7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe0255ae640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe0200b5ad0 0x7fe0200b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe0255ae640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe020145600 con 0x7fe0200bd0e0 2023-11-28T19:32:10.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe0255ae640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0200b4d30 con 0x7fe0200b5ad0 2023-11-28T19:32:10.136 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe0255ae640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200b9270 con 0x7fe020145220 2023-11-28T19:32:10.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01f7fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fe0200bd0e0 0x7fe02014aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52076/0 (socket says 172.21.15.28:52076) 2023-11-28T19:32:10.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01f7fe640 1 -- 172.21.15.28:0/991414577 learned_addr learned my addr 172.21.15.28:0/991414577 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:10.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01effd640 1 --2- 172.21.15.28:0/991414577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe020145220 0x7fe0200ba7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01e7fc640 1 --2- 172.21.15.28:0/991414577 >> v2:172.21.15.131:3300/0 conn(0x7fe0200b5ad0 0x7fe0200b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 -- 172.21.15.28:0/991414577 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1303290719 0 0) 0x7fe020145600 con 0x7fe0200bd0e0 2023-11-28T19:32:10.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 -- 172.21.15.28:0/991414577 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe008003530 con 0x7fe0200bd0e0 2023-11-28T19:32:10.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 -- 172.21.15.28:0/991414577 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2851508203 0 0) 0x7fe008003530 con 0x7fe0200bd0e0 2023-11-28T19:32:10.137 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 -- 172.21.15.28:0/991414577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe020145220 msgr2=0x7fe0200ba7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:10.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 --2- 172.21.15.28:0/991414577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe020145220 0x7fe0200ba7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 -- 172.21.15.28:0/991414577 >> v2:172.21.15.131:3300/0 conn(0x7fe0200b5ad0 msgr2=0x7fe0200b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:10.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 --2- 172.21.15.28:0/991414577 >> v2:172.21.15.131:3300/0 conn(0x7fe0200b5ad0 0x7fe0200b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 -- 172.21.15.28:0/991414577 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0200b6530 con 0x7fe0200bd0e0 2023-11-28T19:32:10.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 -- 172.21.15.28:0/991414577 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7fe018001a00 con 0x7fe0200bd0e0 2023-11-28T19:32:10.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 -- 172.21.15.28:0/991414577 >> v1:172.21.15.28:6789/0 conn(0x7fe0200bd0e0 legacy=0x7fe02014aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 --2- 172.21.15.28:0/991414577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe008003980 0x7fe008003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 --2- 172.21.15.28:0/991414577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe020145220 0x7fe0080047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 --2- 172.21.15.28:0/991414577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe008004d10 0x7fe008005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.138 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01effd640 1 --2- 172.21.15.28:0/991414577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe008003980 0x7fe008003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 -- 172.21.15.28:0/991414577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0200b9270 con 0x7fe008003980 2023-11-28T19:32:10.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 -- 172.21.15.28:0/991414577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe00800b990 con 0x7fe008004d10 2023-11-28T19:32:10.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01dffb640 1 -- 172.21.15.28:0/991414577 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe00800dce0 con 0x7fe020145220 2023-11-28T19:32:10.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01e7fc640 1 --2- 172.21.15.28:0/991414577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe020145220 0x7fe0080047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01f7fe640 1 --2- 172.21.15.28:0/991414577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe008004d10 0x7fe008005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01effd640 1 -- 172.21.15.28:0/991414577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe020145220 msgr2=0x7fe0080047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:10.139 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01effd640 1 --2- 172.21.15.28:0/991414577 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe020145220 0x7fe0080047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01effd640 1 -- 172.21.15.28:0/991414577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe008004d10 msgr2=0x7fe008005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:10.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01effd640 1 --2- 172.21.15.28:0/991414577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe008004d10 0x7fe008005190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.140 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.134+0000 7fe01effd640 1 -- 172.21.15.28:0/991414577 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe008003530 con 0x7fe008003980 2023-11-28T19:32:10.142 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01effd640 1 --2- 172.21.15.28:0/991414577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe008003980 0x7fe008003da0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe010009ae0 tx=0x7fe01001ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f5cad557d7e43b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:10.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01dffb640 1 -- 172.21.15.28:0/991414577 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0100a5570 con 0x7fe008003980 2023-11-28T19:32:10.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01dffb640 1 -- 172.21.15.28:0/991414577 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0100a56d0 con 0x7fe008003980 2023-11-28T19:32:10.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01dffb640 1 -- 172.21.15.28:0/991414577 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0100a5a80 con 0x7fe008003980 2023-11-28T19:32:10.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 -- 172.21.15.28:0/991414577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe008003980 msgr2=0x7fe008003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 --2- 172.21.15.28:0/991414577 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe008003980 0x7fe008003da0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe010009ae0 tx=0x7fe01001ca20 comp rx=0 tx=0).stop 2023-11-28T19:32:10.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01f7fe640 1 -- 172.21.15.28:0/991414577 reap_dead start 2023-11-28T19:32:10.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 -- 172.21.15.28:0/991414577 shutdown_connections 2023-11-28T19:32:10.143 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 -- 172.21.15.28:0/991414577 >> 172.21.15.28:0/991414577 conn(0x7fe02006ab80 msgr2=0x7fe0200bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:10.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 -- 172.21.15.28:0/991414577 shutdown_connections 2023-11-28T19:32:10.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 -- 172.21.15.28:0/991414577 wait complete. 2023-11-28T19:32:10.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 Processor -- start 2023-11-28T19:32:10.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 -- start start 2023-11-28T19:32:10.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe008003980 0x7fe020146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.144 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0201487e0 0x7fe02006f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe020147be0 0x7fe020072120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0201dff70 con 0x7fe020147be0 2023-11-28T19:32:10.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe02006fbe0 con 0x7fe0201487e0 2023-11-28T19:32:10.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0201df920 con 0x7fe008003980 2023-11-28T19:32:10.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe020147be0 0x7fe020072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.145 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe020147be0 0x7fe020072120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56072/0 (socket says 172.21.15.28:56072) 2023-11-28T19:32:10.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01f7fe640 1 -- 172.21.15.28:0/3470594748 learned_addr learned my addr 172.21.15.28:0/3470594748 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:10.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01e7fc640 1 --2- 172.21.15.28:0/3470594748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0201487e0 0x7fe02006f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01effd640 1 --2- 172.21.15.28:0/3470594748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe008003980 0x7fe020146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01f7fe640 1 -- 172.21.15.28:0/3470594748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe008003980 msgr2=0x7fe020146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01f7fe640 1 --2- 172.21.15.28:0/3470594748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe008003980 0x7fe020146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01f7fe640 1 -- 172.21.15.28:0/3470594748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0201487e0 msgr2=0x7fe02006f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01f7fe640 1 --2- 172.21.15.28:0/3470594748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0201487e0 0x7fe02006f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.146 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01f7fe640 1 -- 172.21.15.28:0/3470594748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0201dfc00 con 0x7fe020147be0 2023-11-28T19:32:10.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe01f7fe640 1 --2- 172.21.15.28:0/3470594748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe020147be0 0x7fe020072120 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe018000f90 tx=0x7fe01800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:10.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0077fe640 1 -- 172.21.15.28:0/3470594748 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe01800bb80 con 0x7fe020147be0 2023-11-28T19:32:10.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0077fe640 1 -- 172.21.15.28:0/3470594748 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe01800bce0 con 0x7fe020147be0 2023-11-28T19:32:10.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 -- 172.21.15.28:0/3470594748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0201df610 con 0x7fe020147be0 2023-11-28T19:32:10.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0077fe640 1 -- 172.21.15.28:0/3470594748 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe018007290 con 0x7fe020147be0 2023-11-28T19:32:10.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.138+0000 7fe0255ae640 1 -- 172.21.15.28:0/3470594748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe020146650 con 0x7fe020147be0 2023-11-28T19:32:10.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.142+0000 7fe0255ae640 1 -- 172.21.15.28:0/3470594748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0201e0120 con 0x7fe020147be0 2023-11-28T19:32:10.147 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.142+0000 7fe0077fe640 1 -- 172.21.15.28:0/3470594748 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe0180073f0 con 0x7fe020147be0 2023-11-28T19:32:10.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.142+0000 7fe0077fe640 1 --2- 172.21.15.28:0/3470594748 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe00c0664a0 0x7fe00c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.142+0000 7fe0077fe640 1 -- 172.21.15.28:0/3470594748 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0180840a0 con 0x7fe020147be0 2023-11-28T19:32:10.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.142+0000 7fe01effd640 1 --2- 172.21.15.28:0/3470594748 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe00c0664a0 0x7fe00c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.148 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.142+0000 7fe01effd640 1 --2- 172.21.15.28:0/3470594748 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe00c0664a0 0x7fe00c068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe0100af000 tx=0x7fe0100046d0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:10.149 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.146+0000 7fe0077fe640 1 -- 172.21.15.28:0/3470594748 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe0201e0120 con 0x7fe020147be0 2023-11-28T19:32:10.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.298+0000 7fe0255ae640 1 -- 172.21.15.28:0/3470594748 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe0201e0120 con 0x7fe020147be0 2023-11-28T19:32:10.298 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.298+0000 7fe0077fe640 1 -- 172.21.15.28:0/3470594748 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe0201e0120 con 0x7fe020147be0 2023-11-28T19:32:10.299 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 64 2023-11-28T19:32:10.300 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.298+0000 7fe0255ae640 1 -- 172.21.15.28:0/3470594748 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe00c0664a0 msgr2=0x7fe00c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.298+0000 7fe0255ae640 1 --2- 172.21.15.28:0/3470594748 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe00c0664a0 0x7fe00c068960 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe0100af000 tx=0x7fe0100046d0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.298+0000 7fe0255ae640 1 -- 172.21.15.28:0/3470594748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe020147be0 msgr2=0x7fe020072120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.298+0000 7fe0255ae640 1 --2- 172.21.15.28:0/3470594748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe020147be0 0x7fe020072120 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe018000f90 tx=0x7fe01800b4a0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.298+0000 7fe0255ae640 1 -- 172.21.15.28:0/3470594748 shutdown_connections 2023-11-28T19:32:10.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.298+0000 7fe0255ae640 1 --2- 172.21.15.28:0/3470594748 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe00c0664a0 0x7fe00c068960 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.298+0000 7fe0255ae640 1 --2- 172.21.15.28:0/3470594748 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe020147be0 0x7fe020072120 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.298+0000 7fe0255ae640 1 --2- 172.21.15.28:0/3470594748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0201487e0 0x7fe02006f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.298+0000 7fe0255ae640 1 --2- 172.21.15.28:0/3470594748 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe008003980 0x7fe020146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.298+0000 7fe0255ae640 1 -- 172.21.15.28:0/3470594748 >> 172.21.15.28:0/3470594748 conn(0x7fe02006ab80 msgr2=0x7fe020141cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:10.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.298+0000 7fe0255ae640 1 -- 172.21.15.28:0/3470594748 shutdown_connections 2023-11-28T19:32:10.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.298+0000 7fe0255ae640 1 -- 172.21.15.28:0/3470594748 wait complete. 2023-11-28T19:32:10.316 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:32:10.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb325e9b640 1 Processor -- start 2023-11-28T19:32:10.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb325e9b640 1 -- start start 2023-11-28T19:32:10.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb325e9b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb32006ab60 0x7fb32014b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb325e9b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb32006af40 0x7fb320155e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.439 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb325e9b640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3200bce60 con 0x7fb3200bbad0 2023-11-28T19:32:10.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb325e9b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3200bd5d0 con 0x7fb32006af40 2023-11-28T19:32:10.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb325e9b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3200a6b70 con 0x7fb32006ab60 2023-11-28T19:32:10.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb31ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb32006af40 0x7fb320155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb31ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fb32006af40 0x7fb320155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56078/0 (socket says 172.21.15.28:56078) 2023-11-28T19:32:10.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb31ffff640 1 -- 172.21.15.28:0/2260747507 learned_addr learned my addr 172.21.15.28:0/2260747507 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:10.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb31f7fe640 1 --2- 172.21.15.28:0/2260747507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb32006ab60 0x7fb32014b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb31ffff640 1 -- 172.21.15.28:0/2260747507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb32006ab60 msgr2=0x7fb32014b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:10.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb31ffff640 1 --2- 172.21.15.28:0/2260747507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb32006ab60 0x7fb32014b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb31ffff640 1 -- 172.21.15.28:0/2260747507 >> v1:172.21.15.131:6789/0 conn(0x7fb3200bbad0 legacy=0x7fb3200a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:10.440 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.438+0000 7fb31ffff640 1 -- 172.21.15.28:0/2260747507 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3200bff70 con 0x7fb32006af40 2023-11-28T19:32:10.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31ffff640 1 --2- 172.21.15.28:0/2260747507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32006af40 0x7fb320155e20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb318009e50 tx=0x7fb31801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b889a4fdc9f3fa server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:10.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31e7fc640 1 -- 172.21.15.28:0/2260747507 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3180a57c0 con 0x7fb32006af40 2023-11-28T19:32:10.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31e7fc640 1 -- 172.21.15.28:0/2260747507 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3180a5920 con 0x7fb32006af40 2023-11-28T19:32:10.442 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31e7fc640 1 -- 172.21.15.28:0/2260747507 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3180a5cb0 con 0x7fb32006af40 2023-11-28T19:32:10.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 -- 172.21.15.28:0/2260747507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32006af40 msgr2=0x7fb320155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 --2- 172.21.15.28:0/2260747507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32006af40 0x7fb320155e20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb318009e50 tx=0x7fb31801c9e0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.443 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 -- 172.21.15.28:0/2260747507 shutdown_connections 2023-11-28T19:32:10.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 --2- 172.21.15.28:0/2260747507 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32006af40 0x7fb320155e20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 --2- 172.21.15.28:0/2260747507 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb32006ab60 0x7fb32014b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 -- 172.21.15.28:0/2260747507 >> 172.21.15.28:0/2260747507 conn(0x7fb3200c0c90 msgr2=0x7fb3200c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:10.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 -- 172.21.15.28:0/2260747507 shutdown_connections 2023-11-28T19:32:10.444 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 -- 172.21.15.28:0/2260747507 wait complete. 2023-11-28T19:32:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 Processor -- start 2023-11-28T19:32:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 -- start start 2023-11-28T19:32:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32006ab60 0x7fb32013fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32006af40 0x7fb3201497e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3200bbad0 0x7fb3200b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb320140020 con 0x7fb32006ab60 2023-11-28T19:32:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3201e4620 con 0x7fb32006af40 2023-11-28T19:32:10.446 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb325e9b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb32014b3e0 con 0x7fb3200bbad0 2023-11-28T19:32:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32006ab60 0x7fb32013fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31f7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32006ab60 0x7fb32013fae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56094/0 (socket says 172.21.15.28:56094) 2023-11-28T19:32:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31f7fe640 1 -- 172.21.15.28:0/1921399159 learned_addr learned my addr 172.21.15.28:0/1921399159 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31effd640 1 --2- 172.21.15.28:0/1921399159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32006af40 0x7fb3201497e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31ffff640 1 --2- 172.21.15.28:0/1921399159 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3200bbad0 0x7fb3200b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31f7fe640 1 -- 172.21.15.28:0/1921399159 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3200bbad0 msgr2=0x7fb3200b33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31f7fe640 1 --2- 172.21.15.28:0/1921399159 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3200bbad0 0x7fb3200b33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.447 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31f7fe640 1 -- 172.21.15.28:0/1921399159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32006af40 msgr2=0x7fb3201497e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31f7fe640 1 --2- 172.21.15.28:0/1921399159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32006af40 0x7fb3201497e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31f7fe640 1 -- 172.21.15.28:0/1921399159 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb318009b30 con 0x7fb32006ab60 2023-11-28T19:32:10.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.442+0000 7fb31f7fe640 1 --2- 172.21.15.28:0/1921399159 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32006ab60 0x7fb32013fae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb31000d800 tx=0x7fb31000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:10.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.446+0000 7fb307fff640 1 -- 172.21.15.28:0/1921399159 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31000b6c0 con 0x7fb32006ab60 2023-11-28T19:32:10.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.446+0000 7fb307fff640 1 -- 172.21.15.28:0/1921399159 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb31000b820 con 0x7fb32006ab60 2023-11-28T19:32:10.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.446+0000 7fb325e9b640 1 -- 172.21.15.28:0/1921399159 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3201e3cf0 con 0x7fb32006ab60 2023-11-28T19:32:10.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.446+0000 7fb307fff640 1 -- 172.21.15.28:0/1921399159 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb31000bb90 con 0x7fb32006ab60 2023-11-28T19:32:10.448 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.446+0000 7fb325e9b640 1 -- 172.21.15.28:0/1921399159 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3201e42b0 con 0x7fb32006ab60 2023-11-28T19:32:10.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.446+0000 7fb325e9b640 1 -- 172.21.15.28:0/1921399159 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb320074a90 con 0x7fb32006ab60 2023-11-28T19:32:10.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.446+0000 7fb307fff640 1 -- 172.21.15.28:0/1921399159 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb31000bcf0 con 0x7fb32006ab60 2023-11-28T19:32:10.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.446+0000 7fb307fff640 1 --2- 172.21.15.28:0/1921399159 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb30c0664a0 0x7fb30c068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.446+0000 7fb307fff640 1 -- 172.21.15.28:0/1921399159 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb310084400 con 0x7fb32006ab60 2023-11-28T19:32:10.449 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.446+0000 7fb31effd640 1 --2- 172.21.15.28:0/1921399159 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb30c0664a0 0x7fb30c068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.450 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.446+0000 7fb31effd640 1 --2- 172.21.15.28:0/1921399159 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb30c0664a0 0x7fb30c068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb320149560 tx=0x7fb314009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:10.451 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.450+0000 7fb307fff640 1 -- 172.21.15.28:0/1921399159 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb310051870 con 0x7fb32006ab60 2023-11-28T19:32:10.639 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.638+0000 7fb325e9b640 1 -- 172.21.15.28:0/1921399159 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3200bfaa0 con 0x7fb32006ab60 2023-11-28T19:32:10.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.638+0000 7fb307fff640 1 -- 172.21.15.28:0/1921399159 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7fb310011340 con 0x7fb32006ab60 2023-11-28T19:32:10.641 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:10.641 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3575778574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3575778574},{"type":"v1","addr":"172.21.15.131:6835","nonce":3575778574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6833/1578638846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1578638846},{"type":"v1","addr":"172.21.15.28:6833","nonce":1578638846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:31:44.589007+0000","modified":"2023-11-28T19:31:47.643502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2598774147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2598774147},{"type":"v1","addr":"172.21.15.28:6835","nonce":2598774147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:32:10.641 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-11-28T19:32:10.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.642+0000 7fb325e9b640 1 -- 172.21.15.28:0/1921399159 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb30c0664a0 msgr2=0x7fb30c068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.642+0000 7fb325e9b640 1 --2- 172.21.15.28:0/1921399159 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb30c0664a0 0x7fb30c068960 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb320149560 tx=0x7fb314009040 comp rx=0 tx=0).stop 2023-11-28T19:32:10.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.642+0000 7fb325e9b640 1 -- 172.21.15.28:0/1921399159 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32006ab60 msgr2=0x7fb32013fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.642+0000 7fb325e9b640 1 --2- 172.21.15.28:0/1921399159 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32006ab60 0x7fb32013fae0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb31000d800 tx=0x7fb31000dcc0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.642+0000 7fb325e9b640 1 -- 172.21.15.28:0/1921399159 shutdown_connections 2023-11-28T19:32:10.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.642+0000 7fb325e9b640 1 --2- 172.21.15.28:0/1921399159 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb30c0664a0 0x7fb30c068960 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.644 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.642+0000 7fb325e9b640 1 --2- 172.21.15.28:0/1921399159 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb3200bbad0 0x7fb3200b33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.642+0000 7fb325e9b640 1 --2- 172.21.15.28:0/1921399159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb32006af40 0x7fb3201497e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.642+0000 7fb325e9b640 1 --2- 172.21.15.28:0/1921399159 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb32006ab60 0x7fb32013fae0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.642+0000 7fb325e9b640 1 -- 172.21.15.28:0/1921399159 >> 172.21.15.28:0/1921399159 conn(0x7fb3200c0c90 msgr2=0x7fb3200a17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:10.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.642+0000 7fb325e9b640 1 -- 172.21.15.28:0/1921399159 shutdown_connections 2023-11-28T19:32:10.645 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.642+0000 7fb325e9b640 1 -- 172.21.15.28:0/1921399159 wait complete. 2023-11-28T19:32:10.660 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:32:10.778 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd12d93640 1 Processor -- start 2023-11-28T19:32:10.779 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd12d93640 1 -- start start 2023-11-28T19:32:10.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd12d93640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd0c06ab60 0x7efd0c14b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd12d93640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efd0c06af40 0x7efd0c155e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd12d93640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd0c0bce60 con 0x7efd0c0bbad0 2023-11-28T19:32:10.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd12d93640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd0c0bd5d0 con 0x7efd0c06af40 2023-11-28T19:32:10.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd12d93640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0a6b70 con 0x7efd0c06ab60 2023-11-28T19:32:10.781 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd11330640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efd0c06af40 0x7efd0c155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd0bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7efd0c0bbad0 0x7efd0c0a6040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52078/0 (socket says 172.21.15.28:52078) 2023-11-28T19:32:10.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd0bfff640 1 -- 172.21.15.28:0/586575738 learned_addr learned my addr 172.21.15.28:0/586575738 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:10.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd10b2f640 1 --2- 172.21.15.28:0/586575738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd0c06ab60 0x7efd0c14b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd11330640 1 -- 172.21.15.28:0/586575738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd0c06ab60 msgr2=0x7efd0c14b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:10.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd11330640 1 --2- 172.21.15.28:0/586575738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd0c06ab60 0x7efd0c14b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd11330640 1 -- 172.21.15.28:0/586575738 >> v1:172.21.15.28:6789/0 conn(0x7efd0c0bbad0 legacy=0x7efd0c0a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd0b7fe640 1 -- 172.21.15.28:0/586575738 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2341074504 0 0) 0x7efd0c0bce60 con 0x7efd0c0bbad0 2023-11-28T19:32:10.782 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.778+0000 7efd11330640 1 -- 172.21.15.28:0/586575738 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c0bff70 con 0x7efd0c06af40 2023-11-28T19:32:10.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd11330640 1 --2- 172.21.15.28:0/586575738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd0c06af40 0x7efd0c155e20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efd04009d90 tx=0x7efd0401c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b753781934988d1c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:10.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd0b7fe640 1 -- 172.21.15.28:0/586575738 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd040a58f0 con 0x7efd0c06af40 2023-11-28T19:32:10.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd0b7fe640 1 -- 172.21.15.28:0/586575738 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd040a5a50 con 0x7efd0c06af40 2023-11-28T19:32:10.783 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd0b7fe640 1 -- 172.21.15.28:0/586575738 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd040a5de0 con 0x7efd0c06af40 2023-11-28T19:32:10.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd12d93640 1 -- 172.21.15.28:0/586575738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd0c06af40 msgr2=0x7efd0c155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd12d93640 1 --2- 172.21.15.28:0/586575738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd0c06af40 0x7efd0c155e20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7efd04009d90 tx=0x7efd0401c920 comp rx=0 tx=0).stop 2023-11-28T19:32:10.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd12d93640 1 -- 172.21.15.28:0/586575738 shutdown_connections 2023-11-28T19:32:10.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd12d93640 1 --2- 172.21.15.28:0/586575738 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd0c06af40 0x7efd0c155e20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.784 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd12d93640 1 --2- 172.21.15.28:0/586575738 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd0c06ab60 0x7efd0c14b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd12d93640 1 -- 172.21.15.28:0/586575738 >> 172.21.15.28:0/586575738 conn(0x7efd0c0c0c90 msgr2=0x7efd0c0c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:10.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd12d93640 1 -- 172.21.15.28:0/586575738 shutdown_connections 2023-11-28T19:32:10.785 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd12d93640 1 -- 172.21.15.28:0/586575738 wait complete. 2023-11-28T19:32:10.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd12d93640 1 Processor -- start 2023-11-28T19:32:10.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd12d93640 1 -- start start 2023-11-28T19:32:10.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd12d93640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd0c06ab60 0x7efd0c14ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.782+0000 7efd12d93640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd0c06af40 0x7efd0c1e79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd12d93640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd0c0bbad0 0x7efd0c1e7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd12d93640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c14b220 con 0x7efd0c0bbad0 2023-11-28T19:32:10.787 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd12d93640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0ba9a0 con 0x7efd0c06ab60 2023-11-28T19:32:10.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd12d93640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0c0ba3e0 con 0x7efd0c06af40 2023-11-28T19:32:10.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd11330640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd0c0bbad0 0x7efd0c1e7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd11330640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd0c0bbad0 0x7efd0c1e7ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56108/0 (socket says 172.21.15.28:56108) 2023-11-28T19:32:10.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd11330640 1 -- 172.21.15.28:0/4013566757 learned_addr learned my addr 172.21.15.28:0/4013566757 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:10.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd0bfff640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd0c06af40 0x7efd0c1e79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd10b2f640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd0c06ab60 0x7efd0c14ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd11330640 1 -- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd0c06af40 msgr2=0x7efd0c1e79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.788 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd11330640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd0c06af40 0x7efd0c1e79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd11330640 1 -- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd0c06ab60 msgr2=0x7efd0c14ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd11330640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd0c06ab60 0x7efd0c14ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd11330640 1 -- 172.21.15.28:0/4013566757 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd04009a70 con 0x7efd0c0bbad0 2023-11-28T19:32:10.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd10b2f640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd0c06ab60 0x7efd0c14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:10.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd0bfff640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd0c06af40 0x7efd0c1e79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:10.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd11330640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd0c0bbad0 0x7efd0c1e7ef0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efd0401a550 tx=0x7efd040196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:10.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd097fa640 1 -- 172.21.15.28:0/4013566757 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd040a58f0 con 0x7efd0c0bbad0 2023-11-28T19:32:10.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd097fa640 1 -- 172.21.15.28:0/4013566757 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd04003ba0 con 0x7efd0c0bbad0 2023-11-28T19:32:10.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd12d93640 1 -- 172.21.15.28:0/4013566757 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0c0ba6c0 con 0x7efd0c0bbad0 2023-11-28T19:32:10.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd097fa640 1 -- 172.21.15.28:0/4013566757 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd040ad650 con 0x7efd0c0bbad0 2023-11-28T19:32:10.789 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd12d93640 1 -- 172.21.15.28:0/4013566757 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0c0b50a0 con 0x7efd0c0bbad0 2023-11-28T19:32:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd12d93640 1 -- 172.21.15.28:0/4013566757 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd0c1e76d0 con 0x7efd0c0bbad0 2023-11-28T19:32:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd097fa640 1 -- 172.21.15.28:0/4013566757 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efd040b4070 con 0x7efd0c0bbad0 2023-11-28T19:32:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd097fa640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efcf8066470 0x7efcf8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd097fa640 1 -- 172.21.15.28:0/4013566757 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efd0411e150 con 0x7efd0c0bbad0 2023-11-28T19:32:10.791 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.786+0000 7efd10b2f640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efcf8066470 0x7efcf8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:10.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.790+0000 7efd10b2f640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efcf8066470 0x7efcf8068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009840 tx=0x7efcfc008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:10.792 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.790+0000 7efd097fa640 1 -- 172.21.15.28:0/4013566757 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efd040ef140 con 0x7efd0c0bbad0 2023-11-28T19:32:10.943 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.942+0000 7efd12d93640 1 -- 172.21.15.28:0/4013566757 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd0c1e76d0 con 0x7efd0c0bbad0 2023-11-28T19:32:10.946 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.946+0000 7efd097fa640 1 -- 172.21.15.28:0/4013566757 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7efd0c1e76d0 con 0x7efd0c0bbad0 2023-11-28T19:32:10.946 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:10.946 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:32:10.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.946+0000 7efd12d93640 1 -- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efcf8066470 msgr2=0x7efcf8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.946+0000 7efd12d93640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efcf8066470 0x7efcf8068930 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7efcfc009840 tx=0x7efcfc008040 comp rx=0 tx=0).stop 2023-11-28T19:32:10.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.946+0000 7efd12d93640 1 -- 172.21.15.28:0/4013566757 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd0c0bbad0 msgr2=0x7efd0c1e7ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:10.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.946+0000 7efd12d93640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd0c0bbad0 0x7efd0c1e7ef0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7efd0401a550 tx=0x7efd040196c0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.948 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.946+0000 7efd12d93640 1 -- 172.21.15.28:0/4013566757 shutdown_connections 2023-11-28T19:32:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.946+0000 7efd12d93640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efcf8066470 0x7efcf8068930 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.946+0000 7efd12d93640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efd0c0bbad0 0x7efd0c1e7ef0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.946+0000 7efd12d93640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efd0c06af40 0x7efd0c1e79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.946+0000 7efd12d93640 1 --2- 172.21.15.28:0/4013566757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efd0c06ab60 0x7efd0c14ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.946+0000 7efd12d93640 1 -- 172.21.15.28:0/4013566757 >> 172.21.15.28:0/4013566757 conn(0x7efd0c0c0c90 msgr2=0x7efd0c0a1610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:10.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.946+0000 7efd12d93640 1 -- 172.21.15.28:0/4013566757 shutdown_connections 2023-11-28T19:32:10.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:10.946+0000 7efd12d93640 1 -- 172.21.15.28:0/4013566757 wait complete. 2023-11-28T19:32:10.964 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-11-28T19:32:10.964 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:32:11.082 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.078+0000 7f6bb1374640 1 Processor -- start 2023-11-28T19:32:11.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.078+0000 7f6bb1374640 1 -- start start 2023-11-28T19:32:11.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6bb1374640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bac142560 0x7f6bac0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6bb1374640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bac0b4aa0 con 0x7f6bac0b5dd0 2023-11-28T19:32:11.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6bb1374640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bac142940 con 0x7f6bac0b4610 2023-11-28T19:32:11.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6bb1374640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac06f950 con 0x7f6bac142560 2023-11-28T19:32:11.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6ba3fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f6bac0b5dd0 0x7f6bac0b6470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52094/0 (socket says 172.21.15.28:52094) 2023-11-28T19:32:11.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6ba3fff640 1 -- 172.21.15.28:0/4135291820 learned_addr learned my addr 172.21.15.28:0/4135291820 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:11.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baaffd640 1 --2- 172.21.15.28:0/4135291820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bac142560 0x7f6bac0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 -- 172.21.15.28:0/4135291820 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1302571602 0 0) 0x7f6bac0b4aa0 con 0x7f6bac0b5dd0 2023-11-28T19:32:11.083 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 -- 172.21.15.28:0/4135291820 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b98003530 con 0x7f6bac0b5dd0 2023-11-28T19:32:11.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 -- 172.21.15.28:0/4135291820 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1075679381 0 0) 0x7f6b98003530 con 0x7f6bac0b5dd0 2023-11-28T19:32:11.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 -- 172.21.15.28:0/4135291820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bac142560 msgr2=0x7f6bac0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:11.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 --2- 172.21.15.28:0/4135291820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bac142560 0x7f6bac0b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 -- 172.21.15.28:0/4135291820 >> v1:172.21.15.131:6789/0 conn(0x7f6bac0b4610 legacy=0x7f6bac152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.085 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 -- 172.21.15.28:0/4135291820 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac14bb40 con 0x7f6bac0b5dd0 2023-11-28T19:32:11.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 -- 172.21.15.28:0/4135291820 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f6b94001680 con 0x7f6bac0b5dd0 2023-11-28T19:32:11.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 -- 172.21.15.28:0/4135291820 >> v1:172.21.15.28:6789/0 conn(0x7f6bac0b5dd0 legacy=0x7f6bac0b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 --2- 172.21.15.28:0/4135291820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b980039b0 0x7f6b98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 --2- 172.21.15.28:0/4135291820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bac142560 0x7f6b980047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 --2- 172.21.15.28:0/4135291820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b98004d10 0x7f6b98005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 -- 172.21.15.28:0/4135291820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac06f950 con 0x7f6b98004d10 2023-11-28T19:32:11.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 -- 172.21.15.28:0/4135291820 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9800bad0 con 0x7f6b980039b0 2023-11-28T19:32:11.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baa7fc640 1 -- 172.21.15.28:0/4135291820 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9800bc90 con 0x7f6bac142560 2023-11-28T19:32:11.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6bab7fe640 1 --2- 172.21.15.28:0/4135291820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b98004d10 0x7f6b98005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6ba3fff640 1 --2- 172.21.15.28:0/4135291820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bac142560 0x7f6b980047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.086 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baaffd640 1 --2- 172.21.15.28:0/4135291820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b980039b0 0x7f6b98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6bab7fe640 1 -- 172.21.15.28:0/4135291820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bac142560 msgr2=0x7f6b980047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:11.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6bab7fe640 1 --2- 172.21.15.28:0/4135291820 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bac142560 0x7f6b980047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6bab7fe640 1 -- 172.21.15.28:0/4135291820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b980039b0 msgr2=0x7f6b98003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:11.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6bab7fe640 1 --2- 172.21.15.28:0/4135291820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b980039b0 0x7f6b98003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6bab7fe640 1 -- 172.21.15.28:0/4135291820 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b98003530 con 0x7f6b98004d10 2023-11-28T19:32:11.087 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.082+0000 7f6baaffd640 1 --2- 172.21.15.28:0/4135291820 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b980039b0 0x7f6b98003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:11.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bab7fe640 1 --2- 172.21.15.28:0/4135291820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b98004d10 0x7f6b98005190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4001e40 tx=0x7f6ba401c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df65b8c920f9fc63 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:11.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6baa7fc640 1 -- 172.21.15.28:0/4135291820 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba4003b80 con 0x7f6b98004d10 2023-11-28T19:32:11.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6baa7fc640 1 -- 172.21.15.28:0/4135291820 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ba4003ce0 con 0x7f6b98004d10 2023-11-28T19:32:11.090 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6baa7fc640 1 -- 172.21.15.28:0/4135291820 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ba40052c0 con 0x7f6b98004d10 2023-11-28T19:32:11.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bb1374640 1 -- 172.21.15.28:0/4135291820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b98004d10 msgr2=0x7f6b98005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bb1374640 1 --2- 172.21.15.28:0/4135291820 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b98004d10 0x7f6b98005190 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f6ba4001e40 tx=0x7f6ba401c740 comp rx=0 tx=0).stop 2023-11-28T19:32:11.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bab7fe640 1 -- 172.21.15.28:0/4135291820 reap_dead start 2023-11-28T19:32:11.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bb1374640 1 -- 172.21.15.28:0/4135291820 shutdown_connections 2023-11-28T19:32:11.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bb1374640 1 -- 172.21.15.28:0/4135291820 >> 172.21.15.28:0/4135291820 conn(0x7f6bac0bcb40 msgr2=0x7f6bac0bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:11.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bb1374640 1 -- 172.21.15.28:0/4135291820 shutdown_connections 2023-11-28T19:32:11.091 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bb1374640 1 -- 172.21.15.28:0/4135291820 wait complete. 2023-11-28T19:32:11.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bb1374640 1 Processor -- start 2023-11-28T19:32:11.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bb1374640 1 -- start start 2023-11-28T19:32:11.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bb1374640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b98004d10 0x7f6bac1d5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bb1374640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bac071d40 0x7f6bac1e4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bb1374640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bac13f2e0 0x7f6bac1e4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bb1374640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac1d6170 con 0x7f6b98004d10 2023-11-28T19:32:11.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bb1374640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac1e42c0 con 0x7f6bac13f2e0 2023-11-28T19:32:11.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bb1374640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bac070a50 con 0x7f6bac071d40 2023-11-28T19:32:11.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6baaffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b98004d10 0x7f6bac1d5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.092 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6ba3fff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bac071d40 0x7f6bac1e4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6baaffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b98004d10 0x7f6bac1d5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56118/0 (socket says 172.21.15.28:56118) 2023-11-28T19:32:11.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6bab7fe640 1 --2- 172.21.15.28:0/4196873441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bac13f2e0 0x7f6bac1e4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6baaffd640 1 -- 172.21.15.28:0/4196873441 learned_addr learned my addr 172.21.15.28:0/4196873441 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:11.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6baaffd640 1 -- 172.21.15.28:0/4196873441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bac071d40 msgr2=0x7f6bac1e4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6baaffd640 1 --2- 172.21.15.28:0/4196873441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bac071d40 0x7f6bac1e4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6baaffd640 1 -- 172.21.15.28:0/4196873441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bac13f2e0 msgr2=0x7f6bac1e4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6baaffd640 1 --2- 172.21.15.28:0/4196873441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bac13f2e0 0x7f6bac1e4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6baaffd640 1 -- 172.21.15.28:0/4196873441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac070d30 con 0x7f6b98004d10 2023-11-28T19:32:11.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6baaffd640 1 --2- 172.21.15.28:0/4196873441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b98004d10 0x7f6bac1d5c30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c010890 tx=0x7f6b9c010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:11.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.086+0000 7f6ba37fe640 1 -- 172.21.15.28:0/4196873441 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c004220 con 0x7f6b98004d10 2023-11-28T19:32:11.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.090+0000 7f6ba37fe640 1 -- 172.21.15.28:0/4196873441 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b9c004380 con 0x7f6b98004d10 2023-11-28T19:32:11.093 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.090+0000 7f6bb1374640 1 -- 172.21.15.28:0/4196873441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bac0721e0 con 0x7f6b98004d10 2023-11-28T19:32:11.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.090+0000 7f6ba37fe640 1 -- 172.21.15.28:0/4196873441 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b9c00eb80 con 0x7f6b98004d10 2023-11-28T19:32:11.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.090+0000 7f6bb1374640 1 -- 172.21.15.28:0/4196873441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bac0706e0 con 0x7f6b98004d10 2023-11-28T19:32:11.094 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.090+0000 7f6bb1374640 1 -- 172.21.15.28:0/4196873441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bac074a90 con 0x7f6b98004d10 2023-11-28T19:32:11.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.090+0000 7f6ba37fe640 1 -- 172.21.15.28:0/4196873441 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6b9c00ece0 con 0x7f6b98004d10 2023-11-28T19:32:11.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.090+0000 7f6ba37fe640 1 --2- 172.21.15.28:0/4196873441 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6b8c066470 0x7f6b8c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.090+0000 7f6ba37fe640 1 -- 172.21.15.28:0/4196873441 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b9c084040 con 0x7f6b98004d10 2023-11-28T19:32:11.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.090+0000 7f6ba3fff640 1 --2- 172.21.15.28:0/4196873441 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6b8c066470 0x7f6b8c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.095 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.090+0000 7f6ba3fff640 1 --2- 172.21.15.28:0/4196873441 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6b8c066470 0x7f6b8c068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6bac139700 tx=0x7f6b94007040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:11.096 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.094+0000 7f6ba37fe640 1 -- 172.21.15.28:0/4196873441 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6b9c051570 con 0x7f6b98004d10 2023-11-28T19:32:11.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.278+0000 7f6bb1374640 1 -- 172.21.15.28:0/4196873441 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6bac0b4a80 con 0x7f6b98004d10 2023-11-28T19:32:11.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.282+0000 7f6ba37fe640 1 -- 172.21.15.28:0/4196873441 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7f6b9c0044f0 con 0x7f6b98004d10 2023-11-28T19:32:11.283 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:11.283 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3575778574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3575778574},{"type":"v1","addr":"172.21.15.131:6835","nonce":3575778574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6833/1578638846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1578638846},{"type":"v1","addr":"172.21.15.28:6833","nonce":1578638846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:31:44.589007+0000","modified":"2023-11-28T19:31:47.643502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2598774147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2598774147},{"type":"v1","addr":"172.21.15.28:6835","nonce":2598774147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:32:11.283 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-11-28T19:32:11.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.282+0000 7f6bb1374640 1 -- 172.21.15.28:0/4196873441 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6b8c066470 msgr2=0x7f6b8c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.282+0000 7f6bb1374640 1 --2- 172.21.15.28:0/4196873441 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6b8c066470 0x7f6b8c068930 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6bac139700 tx=0x7f6b94007040 comp rx=0 tx=0).stop 2023-11-28T19:32:11.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.282+0000 7f6bb1374640 1 -- 172.21.15.28:0/4196873441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b98004d10 msgr2=0x7f6bac1d5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.282+0000 7f6bb1374640 1 --2- 172.21.15.28:0/4196873441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b98004d10 0x7f6bac1d5c30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c010890 tx=0x7f6b9c010d50 comp rx=0 tx=0).stop 2023-11-28T19:32:11.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.282+0000 7f6bb1374640 1 -- 172.21.15.28:0/4196873441 shutdown_connections 2023-11-28T19:32:11.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.282+0000 7f6bb1374640 1 --2- 172.21.15.28:0/4196873441 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6b8c066470 0x7f6b8c068930 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.282+0000 7f6bb1374640 1 --2- 172.21.15.28:0/4196873441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bac13f2e0 0x7f6bac1e4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.285 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.282+0000 7f6bb1374640 1 --2- 172.21.15.28:0/4196873441 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6bac071d40 0x7f6bac1e4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.282+0000 7f6bb1374640 1 --2- 172.21.15.28:0/4196873441 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b98004d10 0x7f6bac1d5c30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.282+0000 7f6bb1374640 1 -- 172.21.15.28:0/4196873441 >> 172.21.15.28:0/4196873441 conn(0x7f6bac0bcb40 msgr2=0x7f6bac0b7540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:11.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.282+0000 7f6bb1374640 1 -- 172.21.15.28:0/4196873441 shutdown_connections 2023-11-28T19:32:11.286 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.282+0000 7f6bb1374640 1 -- 172.21.15.28:0/4196873441 wait complete. 2023-11-28T19:32:11.300 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:32:11.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a9816640 1 Processor -- start 2023-11-28T19:32:11.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a9816640 1 -- start start 2023-11-28T19:32:11.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a9816640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f41a406b6e0 0x7f41a4148900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a9816640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a40bcb70 con 0x7f41a40b42f0 2023-11-28T19:32:11.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a9816640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41a40bc900 con 0x7f41a40c0540 2023-11-28T19:32:11.411 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a9816640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41a40bb780 con 0x7f41a406b6e0 2023-11-28T19:32:11.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a2ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f41a406b6e0 0x7f41a4148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f419bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f41a40b42f0 0x7f41a40bfe30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52098/0 (socket says 172.21.15.28:52098) 2023-11-28T19:32:11.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f419bfff640 1 -- 172.21.15.28:0/3129504537 learned_addr learned my addr 172.21.15.28:0/3129504537 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:11.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a2ffd640 1 -- 172.21.15.28:0/3129504537 >> v1:172.21.15.131:6789/0 conn(0x7f41a40c0540 legacy=0x7f41a4155e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a2ffd640 1 -- 172.21.15.28:0/3129504537 >> v1:172.21.15.28:6789/0 conn(0x7f41a40b42f0 legacy=0x7f41a40bfe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a27fc640 1 -- 172.21.15.28:0/3129504537 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3361117266 0 0) 0x7f41a40bcb70 con 0x7f41a40b42f0 2023-11-28T19:32:11.412 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a2ffd640 1 -- 172.21.15.28:0/3129504537 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41a406a9a0 con 0x7f41a406b6e0 2023-11-28T19:32:11.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a2ffd640 1 --2- 172.21.15.28:0/3129504537 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a406b6e0 0x7f41a4148900 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f41940097c0 tx=0x7f419401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64153856c9f83b68 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:11.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a27fc640 1 -- 172.21.15.28:0/3129504537 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41940ab600 con 0x7f41a406b6e0 2023-11-28T19:32:11.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a27fc640 1 -- 172.21.15.28:0/3129504537 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41940a7050 con 0x7f41a406b6e0 2023-11-28T19:32:11.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.410+0000 7f41a27fc640 1 -- 172.21.15.28:0/3129504537 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41940ab980 con 0x7f41a406b6e0 2023-11-28T19:32:11.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 -- 172.21.15.28:0/3129504537 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a406b6e0 msgr2=0x7f41a4148900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.414 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 --2- 172.21.15.28:0/3129504537 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a406b6e0 0x7f41a4148900 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f41940097c0 tx=0x7f419401c3c0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 -- 172.21.15.28:0/3129504537 shutdown_connections 2023-11-28T19:32:11.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 --2- 172.21.15.28:0/3129504537 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a406b6e0 0x7f41a4148900 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 -- 172.21.15.28:0/3129504537 >> 172.21.15.28:0/3129504537 conn(0x7f41a40bd6e0 msgr2=0x7f41a40bdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:11.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 -- 172.21.15.28:0/3129504537 shutdown_connections 2023-11-28T19:32:11.415 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 -- 172.21.15.28:0/3129504537 wait complete. 2023-11-28T19:32:11.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 Processor -- start 2023-11-28T19:32:11.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 -- start start 2023-11-28T19:32:11.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a406b6e0 0x7f41a41e3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41a40b42f0 0x7f41a41431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a40c0540 0x7f41a40b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.417 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a4145c30 con 0x7f41a40c0540 2023-11-28T19:32:11.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41a40a0740 con 0x7f41a406b6e0 2023-11-28T19:32:11.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41a41e4440 con 0x7f41a40b42f0 2023-11-28T19:32:11.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a40c0540 0x7f41a40b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a40c0540 0x7f41a40b2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56130/0 (socket says 172.21.15.28:56130) 2023-11-28T19:32:11.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a37fe640 1 -- 172.21.15.28:0/4178704049 learned_addr learned my addr 172.21.15.28:0/4178704049 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:11.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a37fe640 1 -- 172.21.15.28:0/4178704049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41a40b42f0 msgr2=0x7f41a41431e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a37fe640 1 --2- 172.21.15.28:0/4178704049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41a40b42f0 0x7f41a41431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a37fe640 1 -- 172.21.15.28:0/4178704049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a406b6e0 msgr2=0x7f41a41e3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a37fe640 1 --2- 172.21.15.28:0/4178704049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a406b6e0 0x7f41a41e3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a37fe640 1 -- 172.21.15.28:0/4178704049 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4194009420 con 0x7f41a40c0540 2023-11-28T19:32:11.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a37fe640 1 --2- 172.21.15.28:0/4178704049 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a40c0540 0x7f41a40b2ec0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f419c00c760 tx=0x7f419c00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:11.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a0ff9640 1 -- 172.21.15.28:0/4178704049 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c003ba0 con 0x7f41a40c0540 2023-11-28T19:32:11.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a0ff9640 1 -- 172.21.15.28:0/4178704049 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419c003d00 con 0x7f41a40c0540 2023-11-28T19:32:11.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 -- 172.21.15.28:0/4178704049 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41a41e46b0 con 0x7f41a40c0540 2023-11-28T19:32:11.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a0ff9640 1 -- 172.21.15.28:0/4178704049 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419c00aa90 con 0x7f41a40c0540 2023-11-28T19:32:11.419 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 -- 172.21.15.28:0/4178704049 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41a4148a80 con 0x7f41a40c0540 2023-11-28T19:32:11.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.414+0000 7f41a9816640 1 -- 172.21.15.28:0/4178704049 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41a414c560 con 0x7f41a40c0540 2023-11-28T19:32:11.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.418+0000 7f41a0ff9640 1 -- 172.21.15.28:0/4178704049 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f419c00abf0 con 0x7f41a40c0540 2023-11-28T19:32:11.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.418+0000 7f41a0ff9640 1 --2- 172.21.15.28:0/4178704049 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4184066470 0x7f4184068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.418+0000 7f41a0ff9640 1 -- 172.21.15.28:0/4178704049 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f419c083bd0 con 0x7f41a40c0540 2023-11-28T19:32:11.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.418+0000 7f41a2ffd640 1 --2- 172.21.15.28:0/4178704049 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4184066470 0x7f4184068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.420 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.418+0000 7f41a2ffd640 1 --2- 172.21.15.28:0/4178704049 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4184066470 0x7f4184068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f41940ad000 tx=0x7f4194004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:11.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.422+0000 7f41a0ff9640 1 -- 172.21.15.28:0/4178704049 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f419c051050 con 0x7f41a40c0540 2023-11-28T19:32:11.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.610+0000 7f41a9816640 1 -- 172.21.15.28:0/4178704049 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f41a41e4aa0 con 0x7f41a40c0540 2023-11-28T19:32:11.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.610+0000 7f41a0ff9640 1 -- 172.21.15.28:0/4178704049 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4120 (secure 0 0 0) 0x7f419c054670 con 0x7f41a40c0540 2023-11-28T19:32:11.612 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:11.613 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/3575778574","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3575778574},{"type":"v1","addr":"172.21.15.131:6835","nonce":3575778574}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4242,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6833/1578638846","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1578638846},{"type":"v1","addr":"172.21.15.28:6833","nonce":1578638846}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:31:44.589007+0000","modified":"2023-11-28T19:31:47.643502+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4245},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4245":{"gid":4245,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6835/2598774147","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6834","nonce":2598774147},{"type":"v1","addr":"172.21.15.28:6835","nonce":2598774147}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-11-28T19:32:11.613 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 8 2023-11-28T19:32:11.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.614+0000 7f41a9816640 1 -- 172.21.15.28:0/4178704049 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4184066470 msgr2=0x7f4184068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.614+0000 7f41a9816640 1 --2- 172.21.15.28:0/4178704049 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4184066470 0x7f4184068930 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f41940ad000 tx=0x7f4194004740 comp rx=0 tx=0).stop 2023-11-28T19:32:11.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.614+0000 7f41a9816640 1 -- 172.21.15.28:0/4178704049 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a40c0540 msgr2=0x7f41a40b2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.614+0000 7f41a9816640 1 --2- 172.21.15.28:0/4178704049 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a40c0540 0x7f41a40b2ec0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f419c00c760 tx=0x7f419c00cc20 comp rx=0 tx=0).stop 2023-11-28T19:32:11.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.614+0000 7f41a9816640 1 -- 172.21.15.28:0/4178704049 shutdown_connections 2023-11-28T19:32:11.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.614+0000 7f41a9816640 1 --2- 172.21.15.28:0/4178704049 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4184066470 0x7f4184068930 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.614+0000 7f41a9816640 1 --2- 172.21.15.28:0/4178704049 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f41a40c0540 0x7f41a40b2ec0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.614+0000 7f41a9816640 1 --2- 172.21.15.28:0/4178704049 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f41a40b42f0 0x7f41a41431e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.615 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.614+0000 7f41a9816640 1 --2- 172.21.15.28:0/4178704049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f41a406b6e0 0x7f41a41e3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.614+0000 7f41a9816640 1 -- 172.21.15.28:0/4178704049 >> 172.21.15.28:0/4178704049 conn(0x7f41a40bd6e0 msgr2=0x7f41a40bf8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:11.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.614+0000 7f41a9816640 1 -- 172.21.15.28:0/4178704049 shutdown_connections 2023-11-28T19:32:11.616 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.614+0000 7f41a9816640 1 -- 172.21.15.28:0/4178704049 wait complete. 2023-11-28T19:32:11.630 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:32:11.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe636187640 1 Processor -- start 2023-11-28T19:32:11.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe636187640 1 -- start start 2023-11-28T19:32:11.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe636187640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe630148da0 0x7fe6300723f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.739 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe636187640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe6300b88f0 0x7fe630149180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe636187640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe630149ad0 con 0x7fe6301496c0 2023-11-28T19:32:11.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe636187640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63014d260 con 0x7fe6300b88f0 2023-11-28T19:32:11.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe636187640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe63014c8c0 con 0x7fe630148da0 2023-11-28T19:32:11.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe62effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe6300b88f0 0x7fe630149180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe62effd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fe6300b88f0 0x7fe630149180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56142/0 (socket says 172.21.15.28:56142) 2023-11-28T19:32:11.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe62effd640 1 -- 172.21.15.28:0/331835667 learned_addr learned my addr 172.21.15.28:0/331835667 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:11.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe62f7fe640 1 --2- 172.21.15.28:0/331835667 >> v2:172.21.15.131:3300/0 conn(0x7fe630148da0 0x7fe6300723f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe62effd640 1 -- 172.21.15.28:0/331835667 >> v2:172.21.15.131:3300/0 conn(0x7fe630148da0 msgr2=0x7fe6300723f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:11.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe62effd640 1 --2- 172.21.15.28:0/331835667 >> v2:172.21.15.131:3300/0 conn(0x7fe630148da0 0x7fe6300723f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe62effd640 1 -- 172.21.15.28:0/331835667 >> v1:172.21.15.131:6789/0 conn(0x7fe6301496c0 legacy=0x7fe63006a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:11.740 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe62effd640 1 -- 172.21.15.28:0/331835667 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63014cba0 con 0x7fe6300b88f0 2023-11-28T19:32:11.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe62f7fe640 1 --2- 172.21.15.28:0/331835667 >> v2:172.21.15.131:3300/0 conn(0x7fe630148da0 0x7fe6300723f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:11.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe62effd640 1 --2- 172.21.15.28:0/331835667 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6300b88f0 0x7fe630149180 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe630072ce0 tx=0x7fe62401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f4c91993ade7c8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:11.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe62e7fc640 1 -- 172.21.15.28:0/331835667 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6240a89b0 con 0x7fe6300b88f0 2023-11-28T19:32:11.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe62e7fc640 1 -- 172.21.15.28:0/331835667 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6240a8b10 con 0x7fe6300b88f0 2023-11-28T19:32:11.741 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.738+0000 7fe62e7fc640 1 -- 172.21.15.28:0/331835667 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6240a8ea0 con 0x7fe6300b88f0 2023-11-28T19:32:11.742 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 -- 172.21.15.28:0/331835667 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6300b88f0 msgr2=0x7fe630149180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 --2- 172.21.15.28:0/331835667 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6300b88f0 0x7fe630149180 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fe630072ce0 tx=0x7fe62401ecb0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 -- 172.21.15.28:0/331835667 shutdown_connections 2023-11-28T19:32:11.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 --2- 172.21.15.28:0/331835667 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6300b88f0 0x7fe630149180 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 --2- 172.21.15.28:0/331835667 >> v2:172.21.15.131:3300/0 conn(0x7fe630148da0 0x7fe6300723f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 -- 172.21.15.28:0/331835667 >> 172.21.15.28:0/331835667 conn(0x7fe63006bf10 msgr2=0x7fe6300bdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:11.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 -- 172.21.15.28:0/331835667 shutdown_connections 2023-11-28T19:32:11.743 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 -- 172.21.15.28:0/331835667 wait complete. 2023-11-28T19:32:11.745 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 Processor -- start 2023-11-28T19:32:11.745 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 -- start start 2023-11-28T19:32:11.745 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6300b88f0 0x7fe6301d2700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.745 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe630148da0 0x7fe630143180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.745 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6301496c0 0x7fe630142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.745 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe630141160 con 0x7fe6301496c0 2023-11-28T19:32:11.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe630142e80 con 0x7fe630148da0 2023-11-28T19:32:11.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6300b4470 con 0x7fe6300b88f0 2023-11-28T19:32:11.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe62ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6301496c0 0x7fe630142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe62ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6301496c0 0x7fe630142940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56150/0 (socket says 172.21.15.28:56150) 2023-11-28T19:32:11.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe62ffff640 1 -- 172.21.15.28:0/1075597788 learned_addr learned my addr 172.21.15.28:0/1075597788 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:11.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe62effd640 1 --2- 172.21.15.28:0/1075597788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe630148da0 0x7fe630143180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe62f7fe640 1 --2- 172.21.15.28:0/1075597788 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6300b88f0 0x7fe6301d2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe62ffff640 1 -- 172.21.15.28:0/1075597788 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6300b88f0 msgr2=0x7fe6301d2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe62ffff640 1 --2- 172.21.15.28:0/1075597788 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6300b88f0 0x7fe6301d2700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe62ffff640 1 -- 172.21.15.28:0/1075597788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe630148da0 msgr2=0x7fe630143180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe62ffff640 1 --2- 172.21.15.28:0/1075597788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe630148da0 0x7fe630143180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe62ffff640 1 -- 172.21.15.28:0/1075597788 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6240094d0 con 0x7fe6301496c0 2023-11-28T19:32:11.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe62ffff640 1 --2- 172.21.15.28:0/1075597788 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6301496c0 0x7fe630142940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe62800b970 tx=0x7fe62800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:11.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe617fff640 1 -- 172.21.15.28:0/1075597788 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62800cb40 con 0x7fe6301496c0 2023-11-28T19:32:11.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe617fff640 1 -- 172.21.15.28:0/1075597788 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe62800cca0 con 0x7fe6301496c0 2023-11-28T19:32:11.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 -- 172.21.15.28:0/1075597788 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe630141cf0 con 0x7fe6301496c0 2023-11-28T19:32:11.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe617fff640 1 -- 172.21.15.28:0/1075597788 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe628014680 con 0x7fe6301496c0 2023-11-28T19:32:11.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.742+0000 7fe636187640 1 -- 172.21.15.28:0/1075597788 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe630141630 con 0x7fe6301496c0 2023-11-28T19:32:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.746+0000 7fe636187640 1 -- 172.21.15.28:0/1075597788 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe630141820 con 0x7fe6301496c0 2023-11-28T19:32:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.746+0000 7fe617fff640 1 -- 172.21.15.28:0/1075597788 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe62801d3b0 con 0x7fe6301496c0 2023-11-28T19:32:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.746+0000 7fe617fff640 1 --2- 172.21.15.28:0/1075597788 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe61c066470 0x7fe61c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.746+0000 7fe617fff640 1 -- 172.21.15.28:0/1075597788 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe628083c10 con 0x7fe6301496c0 2023-11-28T19:32:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.746+0000 7fe62f7fe640 1 --2- 172.21.15.28:0/1075597788 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe61c066470 0x7fe61c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:11.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.746+0000 7fe62f7fe640 1 --2- 172.21.15.28:0/1075597788 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe61c066470 0x7fe61c068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe62000a9a0 tx=0x7fe620008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:11.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.750+0000 7fe617fff640 1 -- 172.21.15.28:0/1075597788 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe628051120 con 0x7fe6301496c0 2023-11-28T19:32:11.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.902+0000 7fe636187640 1 -- 172.21.15.28:0/1075597788 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe630141ee0 con 0x7fe6301496c0 2023-11-28T19:32:11.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.902+0000 7fe617fff640 1 -- 172.21.15.28:0/1075597788 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16505 (secure 0 0 0) 0x7fe630141ee0 con 0x7fe6301496c0 2023-11-28T19:32:11.905 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:11.905 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":21,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:31:46.067287+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:31:42.810956+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-11-28T19:31:43.579438+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:32:11.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.906+0000 7fe636187640 1 -- 172.21.15.28:0/1075597788 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe61c066470 msgr2=0x7fe61c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.906+0000 7fe636187640 1 --2- 172.21.15.28:0/1075597788 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe61c066470 0x7fe61c068930 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fe62000a9a0 tx=0x7fe620008040 comp rx=0 tx=0).stop 2023-11-28T19:32:11.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.906+0000 7fe636187640 1 -- 172.21.15.28:0/1075597788 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6301496c0 msgr2=0x7fe630142940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:11.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.906+0000 7fe636187640 1 --2- 172.21.15.28:0/1075597788 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6301496c0 0x7fe630142940 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe62800b970 tx=0x7fe62800be30 comp rx=0 tx=0).stop 2023-11-28T19:32:11.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.906+0000 7fe636187640 1 -- 172.21.15.28:0/1075597788 shutdown_connections 2023-11-28T19:32:11.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.906+0000 7fe636187640 1 --2- 172.21.15.28:0/1075597788 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe61c066470 0x7fe61c068930 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.906+0000 7fe636187640 1 --2- 172.21.15.28:0/1075597788 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe6301496c0 0x7fe630142940 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.906+0000 7fe636187640 1 --2- 172.21.15.28:0/1075597788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe630148da0 0x7fe630143180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.906+0000 7fe636187640 1 --2- 172.21.15.28:0/1075597788 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe6300b88f0 0x7fe6301d2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:11.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.906+0000 7fe636187640 1 -- 172.21.15.28:0/1075597788 >> 172.21.15.28:0/1075597788 conn(0x7fe63006bf10 msgr2=0x7fe6300bc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:11.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.906+0000 7fe636187640 1 -- 172.21.15.28:0/1075597788 shutdown_connections 2023-11-28T19:32:11.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:11.906+0000 7fe636187640 1 -- 172.21.15.28:0/1075597788 wait complete. 2023-11-28T19:32:11.926 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-11-28T19:32:12.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.038+0000 7f3d28a7d640 1 Processor -- start 2023-11-28T19:32:12.042 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d28a7d640 1 -- start start 2023-11-28T19:32:12.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d28a7d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3d240b8c40 0x7f3d240b5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:12.043 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d28a7d640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d24142000 con 0x7f3d240b8290 2023-11-28T19:32:12.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d28a7d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d240b64e0 con 0x7f3d24148140 2023-11-28T19:32:12.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d28a7d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d240b6d90 con 0x7f3d240b8c40 2023-11-28T19:32:12.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d2259c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f3d240b8c40 0x7f3d240b5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:12.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d19d9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f3d240b8290 0x7f3d241418f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52102/0 (socket says 172.21.15.28:52102) 2023-11-28T19:32:12.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d19d9b640 1 -- 172.21.15.28:0/3969690270 learned_addr learned my addr 172.21.15.28:0/3969690270 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:12.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d2259c640 1 -- 172.21.15.28:0/3969690270 >> v1:172.21.15.131:6789/0 conn(0x7f3d24148140 legacy=0x7f3d24152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:12.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d2259c640 1 -- 172.21.15.28:0/3969690270 >> v1:172.21.15.28:6789/0 conn(0x7f3d240b8290 legacy=0x7f3d241418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:12.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d2259c640 1 -- 172.21.15.28:0/3969690270 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d240b67c0 con 0x7f3d240b8c40 2023-11-28T19:32:12.044 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d21d9b640 1 -- 172.21.15.28:0/3969690270 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2344005272 0 0) 0x7f3d24142000 con 0x7f3d240b8290 2023-11-28T19:32:12.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d2259c640 1 --2- 172.21.15.28:0/3969690270 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d240b8c40 0x7f3d240b5ee0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0097c0 tx=0x7f3d0c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ef8ce20056b988 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:12.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d21d9b640 1 -- 172.21.15.28:0/3969690270 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0a8930 con 0x7f3d240b8c40 2023-11-28T19:32:12.045 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d21d9b640 1 -- 172.21.15.28:0/3969690270 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0c0a8a90 con 0x7f3d240b8c40 2023-11-28T19:32:12.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.042+0000 7f3d21d9b640 1 -- 172.21.15.28:0/3969690270 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0c0a8e20 con 0x7f3d240b8c40 2023-11-28T19:32:12.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 -- 172.21.15.28:0/3969690270 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d240b8c40 msgr2=0x7f3d240b5ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:12.046 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 --2- 172.21.15.28:0/3969690270 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d240b8c40 0x7f3d240b5ee0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0097c0 tx=0x7f3d0c01ec30 comp rx=0 tx=0).stop 2023-11-28T19:32:12.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 -- 172.21.15.28:0/3969690270 shutdown_connections 2023-11-28T19:32:12.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 --2- 172.21.15.28:0/3969690270 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d240b8c40 0x7f3d240b5ee0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 -- 172.21.15.28:0/3969690270 >> 172.21.15.28:0/3969690270 conn(0x7f3d240bcb40 msgr2=0x7f3d240bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:12.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 -- 172.21.15.28:0/3969690270 shutdown_connections 2023-11-28T19:32:12.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 -- 172.21.15.28:0/3969690270 wait complete. 2023-11-28T19:32:12.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 Processor -- start 2023-11-28T19:32:12.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 -- start start 2023-11-28T19:32:12.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d240b8290 0x7f3d24144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:12.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d240b8c40 0x7f3d24142680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:12.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d24148140 0x7f3d24134060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:12.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d24142bc0 con 0x7f3d24148140 2023-11-28T19:32:12.049 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d24143d80 con 0x7f3d240b8290 2023-11-28T19:32:12.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d24144060 con 0x7f3d240b8c40 2023-11-28T19:32:12.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d22d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d24148140 0x7f3d24134060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:12.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d22d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d24148140 0x7f3d24134060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56162/0 (socket says 172.21.15.28:56162) 2023-11-28T19:32:12.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d22d9d640 1 -- 172.21.15.28:0/2981036504 learned_addr learned my addr 172.21.15.28:0/2981036504 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:12.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d22d9d640 1 -- 172.21.15.28:0/2981036504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d240b8c40 msgr2=0x7f3d24142680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:12.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d22d9d640 1 --2- 172.21.15.28:0/2981036504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d240b8c40 0x7f3d24142680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d22d9d640 1 -- 172.21.15.28:0/2981036504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d240b8290 msgr2=0x7f3d24144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:12.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d22d9d640 1 --2- 172.21.15.28:0/2981036504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d240b8290 0x7f3d24144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d22d9d640 1 -- 172.21.15.28:0/2981036504 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d0c009420 con 0x7f3d24148140 2023-11-28T19:32:12.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d22d9d640 1 --2- 172.21.15.28:0/2981036504 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d24148140 0x7f3d24134060 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00b9a0 tx=0x7f3d1c00be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:12.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d1b7fe640 1 -- 172.21.15.28:0/2981036504 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c00cba0 con 0x7f3d24148140 2023-11-28T19:32:12.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d1b7fe640 1 -- 172.21.15.28:0/2981036504 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1c00cd00 con 0x7f3d24148140 2023-11-28T19:32:12.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 -- 172.21.15.28:0/2981036504 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d24132410 con 0x7f3d24148140 2023-11-28T19:32:12.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d1b7fe640 1 -- 172.21.15.28:0/2981036504 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c014680 con 0x7f3d24148140 2023-11-28T19:32:12.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 -- 172.21.15.28:0/2981036504 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d24149020 con 0x7f3d24148140 2023-11-28T19:32:12.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.046+0000 7f3d28a7d640 1 -- 172.21.15.28:0/2981036504 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d240677e0 con 0x7f3d24148140 2023-11-28T19:32:12.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.050+0000 7f3d1b7fe640 1 -- 172.21.15.28:0/2981036504 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f3d1c01d3b0 con 0x7f3d24148140 2023-11-28T19:32:12.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.050+0000 7f3d1b7fe640 1 --2- 172.21.15.28:0/2981036504 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3d04066470 0x7f3d04068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:12.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.050+0000 7f3d1b7fe640 1 -- 172.21.15.28:0/2981036504 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d1c083d30 con 0x7f3d24148140 2023-11-28T19:32:12.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.050+0000 7f3d2259c640 1 --2- 172.21.15.28:0/2981036504 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3d04066470 0x7f3d04068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:12.052 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.050+0000 7f3d2259c640 1 --2- 172.21.15.28:0/2981036504 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3d04066470 0x7f3d04068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0b2000 tx=0x7f3d0c004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:12.055 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.054+0000 7f3d1b7fe640 1 -- 172.21.15.28:0/2981036504 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3d1c0511a0 con 0x7f3d24148140 2023-11-28T19:32:12.236 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.234+0000 7f3d28a7d640 1 -- 172.21.15.28:0/2981036504 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3d24134600 con 0x7f3d24148140 2023-11-28T19:32:12.237 INFO:tasks.ceph.mon.a.smithi028.stderr:2023-11-28T19:32:12.234+0000 7f986b118640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-11-28T19:32:12.240 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.238+0000 7f3d1b7fe640 1 -- 172.21.15.28:0/2981036504 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3d1c0547c0 con 0x7f3d24148140 2023-11-28T19:32:12.240 INFO:teuthology.orchestra.run.smithi028.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-11-28T19:32:12.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.242+0000 7f3d28a7d640 1 -- 172.21.15.28:0/2981036504 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3d04066470 msgr2=0x7f3d04068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:12.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.242+0000 7f3d28a7d640 1 --2- 172.21.15.28:0/2981036504 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3d04066470 0x7f3d04068930 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c0b2000 tx=0x7f3d0c004740 comp rx=0 tx=0).stop 2023-11-28T19:32:12.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.242+0000 7f3d28a7d640 1 -- 172.21.15.28:0/2981036504 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d24148140 msgr2=0x7f3d24134060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:12.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.242+0000 7f3d28a7d640 1 --2- 172.21.15.28:0/2981036504 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d24148140 0x7f3d24134060 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00b9a0 tx=0x7f3d1c00be60 comp rx=0 tx=0).stop 2023-11-28T19:32:12.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.242+0000 7f3d28a7d640 1 -- 172.21.15.28:0/2981036504 shutdown_connections 2023-11-28T19:32:12.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.242+0000 7f3d28a7d640 1 --2- 172.21.15.28:0/2981036504 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3d04066470 0x7f3d04068930 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.242+0000 7f3d28a7d640 1 --2- 172.21.15.28:0/2981036504 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f3d24148140 0x7f3d24134060 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.242+0000 7f3d28a7d640 1 --2- 172.21.15.28:0/2981036504 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f3d240b8c40 0x7f3d24142680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.242+0000 7f3d28a7d640 1 --2- 172.21.15.28:0/2981036504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3d240b8290 0x7f3d24144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.242+0000 7f3d28a7d640 1 -- 172.21.15.28:0/2981036504 >> 172.21.15.28:0/2981036504 conn(0x7f3d240bcb40 msgr2=0x7f3d240b7230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:12.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.242+0000 7f3d28a7d640 1 -- 172.21.15.28:0/2981036504 shutdown_connections 2023-11-28T19:32:12.244 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.242+0000 7f3d28a7d640 1 -- 172.21.15.28:0/2981036504 wait complete. 2023-11-28T19:32:12.252 INFO:tasks.ceph.mds.a.smithi028.stderr: -4625> 2023-11-28T19:31:48.279+0000 7fb3dc76f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T19:32:12.260 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-11-28T19:32:12.292 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2023-11-28T19:32:12.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5f5e3640 1 Processor -- start 2023-11-28T19:32:12.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5f5e3640 1 -- start start 2023-11-28T19:32:12.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5f5e3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a581494b0 0x7f2a580b5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:12.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5f5e3640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f2a58149890 0x7f2a580b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:12.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5f5e3640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2a58149f50 0x7f2a580ba9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:12.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5f5e3640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a580b8860 con 0x7f2a58149f50 2023-11-28T19:32:12.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5f5e3640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5806fd70 con 0x7f2a58149890 2023-11-28T19:32:12.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5f5e3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580b5c50 con 0x7f2a581494b0 2023-11-28T19:32:12.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5db80640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2a58149f50 0x7f2a580ba9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:12.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5db80640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f2a58149f50 0x7f2a580ba9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56176/0 (socket says 172.21.15.28:56176) 2023-11-28T19:32:12.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5db80640 1 -- 172.21.15.28:0/1281068310 learned_addr learned my addr 172.21.15.28:0/1281068310 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:12.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5d37f640 1 --2- 172.21.15.28:0/1281068310 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a581494b0 0x7f2a580b5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:12.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5cb7e640 1 --2- 172.21.15.28:0/1281068310 >> v2:172.21.15.131:3300/0 conn(0x7f2a58149890 0x7f2a580b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:12.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5db80640 1 -- 172.21.15.28:0/1281068310 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a581494b0 msgr2=0x7f2a580b5710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:12.386 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5db80640 1 --2- 172.21.15.28:0/1281068310 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a581494b0 0x7f2a580b5710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5db80640 1 -- 172.21.15.28:0/1281068310 >> v2:172.21.15.131:3300/0 conn(0x7f2a58149890 msgr2=0x7f2a580b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:12.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5db80640 1 --2- 172.21.15.28:0/1281068310 >> v2:172.21.15.131:3300/0 conn(0x7f2a58149890 0x7f2a580b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5db80640 1 -- 172.21.15.28:0/1281068310 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a580b4440 con 0x7f2a58149f50 2023-11-28T19:32:12.387 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.382+0000 7f2a5d37f640 1 --2- 172.21.15.28:0/1281068310 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a581494b0 0x7f2a580b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:12.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.386+0000 7f2a5db80640 1 --2- 172.21.15.28:0/1281068310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a58149f50 0x7f2a580ba9f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2a5806afd0 tx=0x7f2a5001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ea8abd9ccb3f4c5 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:12.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.386+0000 7f2a4bfff640 1 -- 172.21.15.28:0/1281068310 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a500af400 con 0x7f2a58149f50 2023-11-28T19:32:12.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.386+0000 7f2a4bfff640 1 -- 172.21.15.28:0/1281068310 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a500ab050 con 0x7f2a58149f50 2023-11-28T19:32:12.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.386+0000 7f2a4bfff640 1 -- 172.21.15.28:0/1281068310 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a500af780 con 0x7f2a58149f50 2023-11-28T19:32:12.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.386+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/1281068310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a58149f50 msgr2=0x7f2a580ba9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:12.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.386+0000 7f2a5f5e3640 1 --2- 172.21.15.28:0/1281068310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a58149f50 0x7f2a580ba9f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f2a5806afd0 tx=0x7f2a5001f1c0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.386+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/1281068310 shutdown_connections 2023-11-28T19:32:12.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.386+0000 7f2a5f5e3640 1 --2- 172.21.15.28:0/1281068310 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a58149f50 0x7f2a580ba9f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.386+0000 7f2a5f5e3640 1 --2- 172.21.15.28:0/1281068310 >> v2:172.21.15.131:3300/0 conn(0x7f2a58149890 0x7f2a580b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.386+0000 7f2a5f5e3640 1 --2- 172.21.15.28:0/1281068310 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a581494b0 0x7f2a580b5710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.386+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/1281068310 >> 172.21.15.28:0/1281068310 conn(0x7f2a580beaf0 msgr2=0x7f2a580bef00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:12.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.386+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/1281068310 shutdown_connections 2023-11-28T19:32:12.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.386+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/1281068310 wait complete. 2023-11-28T19:32:12.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5f5e3640 1 Processor -- start 2023-11-28T19:32:12.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5f5e3640 1 -- start start 2023-11-28T19:32:12.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5f5e3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a581494b0 0x7f2a581444c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:12.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5f5e3640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a58149890 0x7f2a58144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:12.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5f5e3640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a58149f50 0x7f2a58145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:12.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5f5e3640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58144a00 con 0x7f2a58149f50 2023-11-28T19:32:12.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5f5e3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a5806d0b0 con 0x7f2a581494b0 2023-11-28T19:32:12.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5f5e3640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a580b7030 con 0x7f2a58149890 2023-11-28T19:32:12.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5db80640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a58149f50 0x7f2a58145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:12.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5db80640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a58149f50 0x7f2a58145210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56182/0 (socket says 172.21.15.28:56182) 2023-11-28T19:32:12.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5db80640 1 -- 172.21.15.28:0/758856517 learned_addr learned my addr 172.21.15.28:0/758856517 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:12.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5d37f640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a581494b0 0x7f2a581444c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:12.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5cb7e640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a58149890 0x7f2a58144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:12.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5db80640 1 -- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a58149890 msgr2=0x7f2a58144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:12.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5db80640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a58149890 0x7f2a58144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5db80640 1 -- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a581494b0 msgr2=0x7f2a581444c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:12.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5db80640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a581494b0 0x7f2a581444c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:12.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5db80640 1 -- 172.21.15.28:0/758856517 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a50009b30 con 0x7f2a58149f50 2023-11-28T19:32:12.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5d37f640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a581494b0 0x7f2a581444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:12.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5db80640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a58149f50 0x7f2a58145210 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2a5001fa60 tx=0x7f2a5001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:12.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a49ffb640 1 -- 172.21.15.28:0/758856517 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a500afd60 con 0x7f2a58149f50 2023-11-28T19:32:12.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a49ffb640 1 -- 172.21.15.28:0/758856517 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a50009510 con 0x7f2a58149f50 2023-11-28T19:32:12.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/758856517 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a5806ca60 con 0x7f2a58149f50 2023-11-28T19:32:12.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a49ffb640 1 -- 172.21.15.28:0/758856517 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a500ba680 con 0x7f2a58149f50 2023-11-28T19:32:12.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/758856517 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a58146670 con 0x7f2a58149f50 2023-11-28T19:32:12.395 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/758856517 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a5806db90 con 0x7f2a58149f50 2023-11-28T19:32:12.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.390+0000 7f2a49ffb640 1 -- 172.21.15.28:0/758856517 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f2a500b6040 con 0x7f2a58149f50 2023-11-28T19:32:12.396 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.394+0000 7f2a49ffb640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2a3c066470 0x7f2a3c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:12.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.394+0000 7f2a49ffb640 1 -- 172.21.15.28:0/758856517 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f2a50122a00 con 0x7f2a58149f50 2023-11-28T19:32:12.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.394+0000 7f2a5d37f640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2a3c066470 0x7f2a3c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:12.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.394+0000 7f2a5d37f640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2a3c066470 0x7f2a3c068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2a54006b20 tx=0x7f2a54008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:12.397 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.394+0000 7f2a49ffb640 1 -- 172.21.15.28:0/758856517 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f2a500eff10 con 0x7f2a58149f50 2023-11-28T19:32:12.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:12.590+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/758856517 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2a5806db90 con 0x7f2a58149f50 2023-11-28T19:32:13.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.242+0000 7f2a49ffb640 1 -- 172.21.15.28:0/758856517 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2a5806db90 con 0x7f2a58149f50 2023-11-28T19:32:13.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.246+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2a3c066470 msgr2=0x7f2a3c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:13.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.246+0000 7f2a5f5e3640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2a3c066470 0x7f2a3c068930 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f2a54006b20 tx=0x7f2a54008040 comp rx=0 tx=0).stop 2023-11-28T19:32:13.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.246+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/758856517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a58149f50 msgr2=0x7f2a58145210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:13.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.246+0000 7f2a5f5e3640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a58149f50 0x7f2a58145210 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2a5001fa60 tx=0x7f2a5001bf60 comp rx=0 tx=0).stop 2023-11-28T19:32:13.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.246+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/758856517 shutdown_connections 2023-11-28T19:32:13.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.246+0000 7f2a5f5e3640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f2a3c066470 0x7f2a3c068930 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:13.247 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.246+0000 7f2a5f5e3640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f2a58149f50 0x7f2a58145210 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:13.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.246+0000 7f2a5f5e3640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f2a58149890 0x7f2a58144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:13.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.246+0000 7f2a5f5e3640 1 --2- 172.21.15.28:0/758856517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a581494b0 0x7f2a581444c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:13.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.246+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/758856517 >> 172.21.15.28:0/758856517 conn(0x7f2a580beaf0 msgr2=0x7f2a58147c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:13.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.246+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/758856517 shutdown_connections 2023-11-28T19:32:13.248 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.246+0000 7f2a5f5e3640 1 -- 172.21.15.28:0/758856517 wait complete. 2023-11-28T19:32:13.273 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-11-28T19:32:13.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.449+0000 7f4766c8c640 1 Processor -- start 2023-11-28T19:32:13.452 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.449+0000 7f4766c8c640 1 -- start start 2023-11-28T19:32:13.453 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.449+0000 7f4766c8c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f47600b1d50 0x7f4760147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:13.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.449+0000 7f4766c8c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47600b4ad0 con 0x7f47600b2ce0 2023-11-28T19:32:13.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.449+0000 7f4766c8c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4760148920 con 0x7f4760148510 2023-11-28T19:32:13.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.449+0000 7f4766c8c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47600b9da0 con 0x7f47600b1d50 2023-11-28T19:32:13.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.449+0000 7f475ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f47600b1d50 0x7f4760147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:13.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.449+0000 7f475ffff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f47600b1d50 0x7f4760147fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56188/0 (socket says 172.21.15.28:56188) 2023-11-28T19:32:13.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.449+0000 7f4764a28640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f47600b2ce0 0x7f47600b9690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52108/0 (socket says 172.21.15.28:52108) 2023-11-28T19:32:13.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.449+0000 7f475ffff640 1 -- 172.21.15.28:0/1501293652 learned_addr learned my addr 172.21.15.28:0/1501293652 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:13.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.449+0000 7f475ffff640 1 -- 172.21.15.28:0/1501293652 >> v1:172.21.15.131:6789/0 conn(0x7f4760148510 legacy=0x7f4760146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:13.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.449+0000 7f475ffff640 1 -- 172.21.15.28:0/1501293652 >> v1:172.21.15.28:6789/0 conn(0x7f47600b2ce0 legacy=0x7f47600b9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:13.454 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.449+0000 7f475ffff640 1 -- 172.21.15.28:0/1501293652 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47600b2490 con 0x7f47600b1d50 2023-11-28T19:32:13.455 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.453+0000 7f475ffff640 1 --2- 172.21.15.28:0/1501293652 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47600b1d50 0x7f4760147fd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f474c009870 tx=0x7f474c01c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8349702289307d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:13.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.453+0000 7f475f7fe640 1 -- 172.21.15.28:0/1501293652 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0ab600 con 0x7f47600b1d50 2023-11-28T19:32:13.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.453+0000 7f475f7fe640 1 -- 172.21.15.28:0/1501293652 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c0a7050 con 0x7f47600b1d50 2023-11-28T19:32:13.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.453+0000 7f475f7fe640 1 -- 172.21.15.28:0/1501293652 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0ab980 con 0x7f47600b1d50 2023-11-28T19:32:13.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.453+0000 7f4766c8c640 1 -- 172.21.15.28:0/1501293652 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47600b1d50 msgr2=0x7f4760147fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:13.456 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.453+0000 7f4766c8c640 1 --2- 172.21.15.28:0/1501293652 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47600b1d50 0x7f4760147fd0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f474c009870 tx=0x7f474c01c500 comp rx=0 tx=0).stop 2023-11-28T19:32:13.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.453+0000 7f4766c8c640 1 -- 172.21.15.28:0/1501293652 shutdown_connections 2023-11-28T19:32:13.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.453+0000 7f4766c8c640 1 --2- 172.21.15.28:0/1501293652 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47600b1d50 0x7f4760147fd0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:13.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.453+0000 7f4766c8c640 1 -- 172.21.15.28:0/1501293652 >> 172.21.15.28:0/1501293652 conn(0x7f47600666d0 msgr2=0x7f476006a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:13.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.453+0000 7f4766c8c640 1 -- 172.21.15.28:0/1501293652 shutdown_connections 2023-11-28T19:32:13.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.453+0000 7f4766c8c640 1 -- 172.21.15.28:0/1501293652 wait complete. 2023-11-28T19:32:13.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.453+0000 7f4766c8c640 1 Processor -- start 2023-11-28T19:32:13.457 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f4766c8c640 1 -- start start 2023-11-28T19:32:13.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f4766c8c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47600b1d50 0x7f476006f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:13.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f4766c8c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47600b2ce0 0x7f47601e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:13.459 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f4766c8c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4760148510 0x7f47600bc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:13.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f4766c8c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47601e5a00 con 0x7f47600b2ce0 2023-11-28T19:32:13.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f4766c8c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47600bb9d0 con 0x7f4760148510 2023-11-28T19:32:13.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f4766c8c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4760146660 con 0x7f47600b1d50 2023-11-28T19:32:13.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47600b2ce0 0x7f47601e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:13.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475ffff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47600b2ce0 0x7f47601e54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56190/0 (socket says 172.21.15.28:56190) 2023-11-28T19:32:13.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475ffff640 1 -- 172.21.15.28:0/3878245745 learned_addr learned my addr 172.21.15.28:0/3878245745 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:13.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f4765229640 1 --2- 172.21.15.28:0/3878245745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4760148510 0x7f47600bc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:13.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f4764a28640 1 --2- 172.21.15.28:0/3878245745 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47600b1d50 0x7f476006f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:13.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475ffff640 1 -- 172.21.15.28:0/3878245745 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47600b1d50 msgr2=0x7f476006f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:13.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475ffff640 1 --2- 172.21.15.28:0/3878245745 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47600b1d50 0x7f476006f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:13.460 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475ffff640 1 -- 172.21.15.28:0/3878245745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4760148510 msgr2=0x7f47600bc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:13.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475ffff640 1 --2- 172.21.15.28:0/3878245745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4760148510 0x7f47600bc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:13.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475ffff640 1 -- 172.21.15.28:0/3878245745 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f474c0094d0 con 0x7f47600b2ce0 2023-11-28T19:32:13.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475ffff640 1 --2- 172.21.15.28:0/3878245745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47600b2ce0 0x7f47601e54c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f474c0ae040 tx=0x7f474c0192a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:13.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475d7fa640 1 -- 172.21.15.28:0/3878245745 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0b4850 con 0x7f47600b2ce0 2023-11-28T19:32:13.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475d7fa640 1 -- 172.21.15.28:0/3878245745 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f474c0b49b0 con 0x7f47600b2ce0 2023-11-28T19:32:13.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f4766c8c640 1 -- 172.21.15.28:0/3878245745 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47600bbbe0 con 0x7f47600b2ce0 2023-11-28T19:32:13.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475d7fa640 1 -- 172.21.15.28:0/3878245745 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f474c0b4d60 con 0x7f47600b2ce0 2023-11-28T19:32:13.461 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f4766c8c640 1 -- 172.21.15.28:0/3878245745 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47600bc1a0 con 0x7f47600b2ce0 2023-11-28T19:32:13.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f4766c8c640 1 -- 172.21.15.28:0/3878245745 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47600bbd70 con 0x7f47600b2ce0 2023-11-28T19:32:13.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475d7fa640 1 -- 172.21.15.28:0/3878245745 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f474c0b2070 con 0x7f47600b2ce0 2023-11-28T19:32:13.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475d7fa640 1 --2- 172.21.15.28:0/3878245745 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4744066470 0x7f4744068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:13.462 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.457+0000 7f475d7fa640 1 -- 172.21.15.28:0/3878245745 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f474c11e100 con 0x7f47600b2ce0 2023-11-28T19:32:13.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.461+0000 7f4764a28640 1 --2- 172.21.15.28:0/3878245745 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4744066470 0x7f4744068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:13.463 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.461+0000 7f4764a28640 1 --2- 172.21.15.28:0/3878245745 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4744066470 0x7f4744068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4754000f70 tx=0x7f4754009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:13.465 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.461+0000 7f475d7fa640 1 -- 172.21.15.28:0/3878245745 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f474c0eb510 con 0x7f47600b2ce0 2023-11-28T19:32:13.624 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:13.621+0000 7f4766c8c640 1 -- 172.21.15.28:0/3878245745 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4760074a90 con 0x7f47600b2ce0 2023-11-28T19:32:14.418 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.417+0000 7f475d7fa640 1 -- 172.21.15.28:0/3878245745 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f474c0eeb30 con 0x7f47600b2ce0 2023-11-28T19:32:14.419 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' removed 2023-11-28T19:32:14.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.417+0000 7f4766c8c640 1 -- 172.21.15.28:0/3878245745 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4744066470 msgr2=0x7f4744068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:14.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.417+0000 7f4766c8c640 1 --2- 172.21.15.28:0/3878245745 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4744066470 0x7f4744068930 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f4754000f70 tx=0x7f4754009040 comp rx=0 tx=0).stop 2023-11-28T19:32:14.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.417+0000 7f4766c8c640 1 -- 172.21.15.28:0/3878245745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47600b2ce0 msgr2=0x7f47601e54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:14.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.417+0000 7f4766c8c640 1 --2- 172.21.15.28:0/3878245745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47600b2ce0 0x7f47601e54c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f474c0ae040 tx=0x7f474c0192a0 comp rx=0 tx=0).stop 2023-11-28T19:32:14.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.417+0000 7f4766c8c640 1 -- 172.21.15.28:0/3878245745 shutdown_connections 2023-11-28T19:32:14.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.417+0000 7f4766c8c640 1 --2- 172.21.15.28:0/3878245745 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4744066470 0x7f4744068930 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:14.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.417+0000 7f4766c8c640 1 --2- 172.21.15.28:0/3878245745 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4760148510 0x7f47600bc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:14.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.417+0000 7f4766c8c640 1 --2- 172.21.15.28:0/3878245745 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f47600b2ce0 0x7f47601e54c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:14.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.417+0000 7f4766c8c640 1 --2- 172.21.15.28:0/3878245745 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f47600b1d50 0x7f476006f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:14.422 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.417+0000 7f4766c8c640 1 -- 172.21.15.28:0/3878245745 >> 172.21.15.28:0/3878245745 conn(0x7f47600666d0 msgr2=0x7f4760142830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:14.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.417+0000 7f4766c8c640 1 -- 172.21.15.28:0/3878245745 shutdown_connections 2023-11-28T19:32:14.423 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.421+0000 7f4766c8c640 1 -- 172.21.15.28:0/3878245745 wait complete. 2023-11-28T19:32:14.450 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-11-28T19:32:14.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f10042b6640 1 Processor -- start 2023-11-28T19:32:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f10042b6640 1 -- start start 2023-11-28T19:32:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f10042b6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0ffc0b6bc0 0x7f0ffc0b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f10042b6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ffc149670 0x7f0ffc149b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f10042b6640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ffc14a040 con 0x7f0ffc0a20e0 2023-11-28T19:32:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f10042b6640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ffc149190 con 0x7f0ffc0b6bc0 2023-11-28T19:32:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f10042b6640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0b4be0 con 0x7f0ffc149670 2023-11-28T19:32:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001851640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f0ffc0a20e0 0x7f0ffc143060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:52110/0 (socket says 172.21.15.28:52110) 2023-11-28T19:32:14.592 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001851640 1 -- 172.21.15.28:0/3066313851 learned_addr learned my addr 172.21.15.28:0/3066313851 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:14.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1002052640 1 --2- 172.21.15.28:0/3066313851 >> v2:172.21.15.131:3300/0 conn(0x7f0ffc0b6bc0 0x7f0ffc0b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:14.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1002853640 1 --2- 172.21.15.28:0/3066313851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ffc149670 0x7f0ffc149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:14.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 -- 172.21.15.28:0/3066313851 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4051893605 0 0) 0x7f0ffc14a040 con 0x7f0ffc0a20e0 2023-11-28T19:32:14.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 -- 172.21.15.28:0/3066313851 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fec003530 con 0x7f0ffc0a20e0 2023-11-28T19:32:14.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 -- 172.21.15.28:0/3066313851 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3652327873 0 0) 0x7f0fec003530 con 0x7f0ffc0a20e0 2023-11-28T19:32:14.593 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 -- 172.21.15.28:0/3066313851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ffc149670 msgr2=0x7f0ffc149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:14.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 --2- 172.21.15.28:0/3066313851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ffc149670 0x7f0ffc149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:14.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 -- 172.21.15.28:0/3066313851 >> v2:172.21.15.131:3300/0 conn(0x7f0ffc0b6bc0 msgr2=0x7f0ffc0b4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:14.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 --2- 172.21.15.28:0/3066313851 >> v2:172.21.15.131:3300/0 conn(0x7f0ffc0b6bc0 0x7f0ffc0b4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:14.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 -- 172.21.15.28:0/3066313851 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc0b4ec0 con 0x7f0ffc0a20e0 2023-11-28T19:32:14.594 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 -- 172.21.15.28:0/3066313851 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f0ff0001a00 con 0x7f0ffc0a20e0 2023-11-28T19:32:14.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 -- 172.21.15.28:0/3066313851 >> v1:172.21.15.28:6789/0 conn(0x7f0ffc0a20e0 legacy=0x7f0ffc143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:14.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 --2- 172.21.15.28:0/3066313851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fec003980 0x7f0fec003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:14.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 --2- 172.21.15.28:0/3066313851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fec0047d0 0x7f0fec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:14.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 --2- 172.21.15.28:0/3066313851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ffc149670 0x7f0fec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:14.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 -- 172.21.15.28:0/3066313851 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc149190 con 0x7f0fec0047d0 2023-11-28T19:32:14.595 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 -- 172.21.15.28:0/3066313851 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0b4be0 con 0x7f0fec003980 2023-11-28T19:32:14.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001050640 1 -- 172.21.15.28:0/3066313851 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fec00b990 con 0x7f0ffc149670 2023-11-28T19:32:14.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1001851640 1 --2- 172.21.15.28:0/3066313851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fec0047d0 0x7f0fec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:14.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.577+0000 7f1002052640 1 --2- 172.21.15.28:0/3066313851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fec003980 0x7f0fec003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:14.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f1002853640 1 --2- 172.21.15.28:0/3066313851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ffc149670 0x7f0fec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:14.596 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f1001851640 1 -- 172.21.15.28:0/3066313851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ffc149670 msgr2=0x7f0fec005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:14.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f1001851640 1 --2- 172.21.15.28:0/3066313851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ffc149670 0x7f0fec005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:14.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f1001851640 1 -- 172.21.15.28:0/3066313851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fec003980 msgr2=0x7f0fec003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:14.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f1001851640 1 --2- 172.21.15.28:0/3066313851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fec003980 0x7f0fec003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:14.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f1001851640 1 -- 172.21.15.28:0/3066313851 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fec003530 con 0x7f0fec0047d0 2023-11-28T19:32:14.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f1002853640 1 --2- 172.21.15.28:0/3066313851 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ffc149670 0x7f0fec005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:14.597 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f1002052640 1 --2- 172.21.15.28:0/3066313851 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0fec003980 0x7f0fec003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:14.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f1001851640 1 --2- 172.21.15.28:0/3066313851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fec0047d0 0x7f0fec004c50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000a900 tx=0x7f0ff001d390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5212e12362d3dc6 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:14.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f1001050640 1 -- 172.21.15.28:0/3066313851 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00ad630 con 0x7f0fec0047d0 2023-11-28T19:32:14.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f1001050640 1 -- 172.21.15.28:0/3066313851 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff00a8070 con 0x7f0fec0047d0 2023-11-28T19:32:14.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f1001050640 1 -- 172.21.15.28:0/3066313851 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff00ad9d0 con 0x7f0fec0047d0 2023-11-28T19:32:14.598 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f10042b6640 1 -- 172.21.15.28:0/3066313851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fec0047d0 msgr2=0x7f0fec004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:14.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f10042b6640 1 --2- 172.21.15.28:0/3066313851 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0fec0047d0 0x7f0fec004c50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f0ff000a900 tx=0x7f0ff001d390 comp rx=0 tx=0).stop 2023-11-28T19:32:14.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f1002853640 1 -- 172.21.15.28:0/3066313851 reap_dead start 2023-11-28T19:32:14.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f10042b6640 1 -- 172.21.15.28:0/3066313851 shutdown_connections 2023-11-28T19:32:14.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f10042b6640 1 -- 172.21.15.28:0/3066313851 >> 172.21.15.28:0/3066313851 conn(0x7f0ffc0666d0 msgr2=0x7f0ffc06a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:14.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f10042b6640 1 -- 172.21.15.28:0/3066313851 shutdown_connections 2023-11-28T19:32:14.599 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.581+0000 7f10042b6640 1 -- 172.21.15.28:0/3066313851 wait complete. 2023-11-28T19:32:14.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f10042b6640 1 Processor -- start 2023-11-28T19:32:14.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f10042b6640 1 -- start start 2023-11-28T19:32:14.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f10042b6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ffc14c2f0 0x7f0ffc144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:14.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f10042b6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0ffc144d80 0x7f0ffc0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:14.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f10042b6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ffc0b2030 0x7f0ffc0b24b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:14.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f10042b6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc145fc0 con 0x7f0ffc144d80 2023-11-28T19:32:14.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f10042b6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0b35e0 con 0x7f0ffc0b2030 2023-11-28T19:32:14.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f10042b6640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ffc0b3880 con 0x7f0ffc14c2f0 2023-11-28T19:32:14.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f1001851640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0ffc144d80 0x7f0ffc0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:14.600 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f1001851640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0ffc144d80 0x7f0ffc0b1af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:56204/0 (socket says 172.21.15.28:56204) 2023-11-28T19:32:14.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f1001851640 1 -- 172.21.15.28:0/373236907 learned_addr learned my addr 172.21.15.28:0/373236907 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:14.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f1002853640 1 --2- 172.21.15.28:0/373236907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ffc0b2030 0x7f0ffc0b24b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:14.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f1002052640 1 --2- 172.21.15.28:0/373236907 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ffc14c2f0 0x7f0ffc144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:14.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f1001851640 1 -- 172.21.15.28:0/373236907 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ffc14c2f0 msgr2=0x7f0ffc144840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:14.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f1001851640 1 --2- 172.21.15.28:0/373236907 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ffc14c2f0 0x7f0ffc144840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:14.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f1001851640 1 -- 172.21.15.28:0/373236907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ffc0b2030 msgr2=0x7f0ffc0b24b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:14.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f1001851640 1 --2- 172.21.15.28:0/373236907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ffc0b2030 0x7f0ffc0b24b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:14.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f1001851640 1 -- 172.21.15.28:0/373236907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ffc1468f0 con 0x7f0ffc144d80 2023-11-28T19:32:14.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f1001851640 1 --2- 172.21.15.28:0/373236907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0ffc144d80 0x7f0ffc0b1af0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0000f90 tx=0x7f0fec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:14.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f0ffaffd640 1 -- 172.21.15.28:0/373236907 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0001980 con 0x7f0ffc144d80 2023-11-28T19:32:14.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f0ffaffd640 1 -- 172.21.15.28:0/373236907 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ff0001b00 con 0x7f0ffc144d80 2023-11-28T19:32:14.601 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f10042b6640 1 -- 172.21.15.28:0/373236907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ffc14c6d0 con 0x7f0ffc144d80 2023-11-28T19:32:14.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f0ffaffd640 1 -- 172.21.15.28:0/373236907 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ff0007320 con 0x7f0ffc144d80 2023-11-28T19:32:14.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f10042b6640 1 -- 172.21.15.28:0/373236907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ffc143f60 con 0x7f0ffc144d80 2023-11-28T19:32:14.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f10042b6640 1 -- 172.21.15.28:0/373236907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ffc074a90 con 0x7f0ffc144d80 2023-11-28T19:32:14.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f0ffaffd640 1 -- 172.21.15.28:0/373236907 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0ff00aa030 con 0x7f0ffc144d80 2023-11-28T19:32:14.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f0ffaffd640 1 --2- 172.21.15.28:0/373236907 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0fe00664a0 0x7f0fe0068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:14.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.585+0000 7f0ffaffd640 1 -- 172.21.15.28:0/373236907 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f0ff011e480 con 0x7f0ffc144d80 2023-11-28T19:32:14.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.589+0000 7f1002052640 1 --2- 172.21.15.28:0/373236907 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0fe00664a0 0x7f0fe0068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:14.602 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.589+0000 7f1002052640 1 --2- 172.21.15.28:0/373236907 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0fe00664a0 0x7f0fe0068960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009a30 tx=0x7f0fe8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:14.603 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.593+0000 7f0ffaffd640 1 -- 172.21.15.28:0/373236907 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0ff00ef450 con 0x7f0ffc144d80 2023-11-28T19:32:14.761 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:14.757+0000 7f10042b6640 1 -- 172.21.15.28:0/373236907 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0ffc074a90 con 0x7f0ffc144d80 2023-11-28T19:32:15.434 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.429+0000 7f0ffaffd640 1 -- 172.21.15.28:0/373236907 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7f0ff00eefe0 con 0x7f0ffc144d80 2023-11-28T19:32:15.434 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' removed 2023-11-28T19:32:15.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.433+0000 7f10042b6640 1 -- 172.21.15.28:0/373236907 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0fe00664a0 msgr2=0x7f0fe0068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:15.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.433+0000 7f10042b6640 1 --2- 172.21.15.28:0/373236907 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0fe00664a0 0x7f0fe0068960 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009a30 tx=0x7f0fe8008040 comp rx=0 tx=0).stop 2023-11-28T19:32:15.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.433+0000 7f10042b6640 1 -- 172.21.15.28:0/373236907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0ffc144d80 msgr2=0x7f0ffc0b1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:15.436 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.433+0000 7f10042b6640 1 --2- 172.21.15.28:0/373236907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0ffc144d80 0x7f0ffc0b1af0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0000f90 tx=0x7f0fec005800 comp rx=0 tx=0).stop 2023-11-28T19:32:15.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.433+0000 7f10042b6640 1 -- 172.21.15.28:0/373236907 shutdown_connections 2023-11-28T19:32:15.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.433+0000 7f10042b6640 1 --2- 172.21.15.28:0/373236907 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0fe00664a0 0x7f0fe0068960 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:15.437 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.433+0000 7f10042b6640 1 --2- 172.21.15.28:0/373236907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ffc0b2030 0x7f0ffc0b24b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:15.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.433+0000 7f10042b6640 1 --2- 172.21.15.28:0/373236907 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0ffc144d80 0x7f0ffc0b1af0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:15.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.433+0000 7f10042b6640 1 --2- 172.21.15.28:0/373236907 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0ffc14c2f0 0x7f0ffc144840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:15.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.433+0000 7f10042b6640 1 -- 172.21.15.28:0/373236907 >> 172.21.15.28:0/373236907 conn(0x7f0ffc0666d0 msgr2=0x7f0ffc148720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:15.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.437+0000 7f10042b6640 1 -- 172.21.15.28:0/373236907 shutdown_connections 2023-11-28T19:32:15.438 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.437+0000 7f10042b6640 1 -- 172.21.15.28:0/373236907 wait complete. 2023-11-28T19:32:15.465 INFO:tasks.ceph.mds.a:Restarting daemon 2023-11-28T19:32:15.466 INFO:tasks.ceph.mds.a:Stopping old one... 2023-11-28T19:32:15.466 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-11-28T19:32:15.466 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T19:32:15.467 INFO:tasks.ceph.mds.c:Restarting daemon 2023-11-28T19:32:15.467 INFO:tasks.ceph.mds.c:Stopping old one... 2023-11-28T19:32:15.467 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-11-28T19:32:15.468 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T19:32:15.468 INFO:tasks.ceph.mds.b:Restarting daemon 2023-11-28T19:32:15.468 INFO:tasks.ceph.mds.b:Stopping old one... 2023-11-28T19:32:15.468 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-11-28T19:32:15.469 INFO:teuthology.orchestra.run:waiting for 300 2023-11-28T19:32:15.479 INFO:tasks.ceph.mds.a:Stopped 2023-11-28T19:32:15.480 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-11-28T19:32:15.481 INFO:tasks.ceph.mds.c:Stopped 2023-11-28T19:32:15.481 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-11-28T19:32:15.483 INFO:tasks.ceph.mds.b:Stopped 2023-11-28T19:32:15.483 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-11-28T19:32:15.526 INFO:tasks.ceph.mds.b:Started 2023-11-28T19:32:15.526 DEBUG:teuthology.parallel:result is None 2023-11-28T19:32:15.527 INFO:tasks.ceph.mds.a:Started 2023-11-28T19:32:15.528 DEBUG:teuthology.parallel:result is None 2023-11-28T19:32:15.529 INFO:tasks.ceph.mds.c:Started 2023-11-28T19:32:15.529 DEBUG:teuthology.parallel:result is None 2023-11-28T19:32:15.529 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-11-28T19:32:15.600 INFO:tasks.ceph.mds.b.smithi131.stdout:starting mds.b at 2023-11-28T19:32:15.601 INFO:tasks.ceph.mds.a.smithi028.stdout:starting mds.a at 2023-11-28T19:32:15.601 INFO:tasks.ceph.mds.c.smithi028.stdout:starting mds.c at 2023-11-28T19:32:15.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc091e6e640 1 Processor -- start 2023-11-28T19:32:15.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc091e6e640 1 -- start start 2023-11-28T19:32:15.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc091e6e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc08c148a80 0x7fc08c06b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:15.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc091e6e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08c070280 con 0x7fc08c14bbd0 2023-11-28T19:32:15.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc091e6e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc08c070560 con 0x7fc08c0b41b0 2023-11-28T19:32:15.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc091e6e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c148e60 con 0x7fc08c148a80 2023-11-28T19:32:15.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08bfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fc08c14bbd0 0x7fc08c155cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47936/0 (socket says 172.21.15.28:47936) 2023-11-28T19:32:15.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08bfff640 1 -- 172.21.15.28:0/1047628881 learned_addr learned my addr 172.21.15.28:0/1047628881 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:15.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 -- 172.21.15.28:0/1047628881 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2225670846 0 0) 0x7fc08c070280 con 0x7fc08c14bbd0 2023-11-28T19:32:15.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08b7fe640 1 --2- 172.21.15.28:0/1047628881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc08c148a80 0x7fc08c06b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:15.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 -- 172.21.15.28:0/1047628881 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc078003530 con 0x7fc08c14bbd0 2023-11-28T19:32:15.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 -- 172.21.15.28:0/1047628881 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3642430546 0 0) 0x7fc078003530 con 0x7fc08c14bbd0 2023-11-28T19:32:15.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 -- 172.21.15.28:0/1047628881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc08c148a80 msgr2=0x7fc08c06b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:15.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 --2- 172.21.15.28:0/1047628881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc08c148a80 0x7fc08c06b590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:15.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 -- 172.21.15.28:0/1047628881 >> v1:172.21.15.131:6789/0 conn(0x7fc08c0b41b0 legacy=0x7fc08c14b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:15.654 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 -- 172.21.15.28:0/1047628881 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c072600 con 0x7fc08c14bbd0 2023-11-28T19:32:15.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 -- 172.21.15.28:0/1047628881 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7fc084001a00 con 0x7fc08c14bbd0 2023-11-28T19:32:15.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 -- 172.21.15.28:0/1047628881 >> v1:172.21.15.28:6789/0 conn(0x7fc08c14bbd0 legacy=0x7fc08c155cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:15.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 --2- 172.21.15.28:0/1047628881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0780039b0 0x7fc078003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:15.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 --2- 172.21.15.28:0/1047628881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc08c148a80 0x7fc0780047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:15.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 --2- 172.21.15.28:0/1047628881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc078004d10 0x7fc078005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:15.655 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 -- 172.21.15.28:0/1047628881 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c148e60 con 0x7fc078004d10 2023-11-28T19:32:15.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 -- 172.21.15.28:0/1047628881 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc07800bbb0 con 0x7fc0780039b0 2023-11-28T19:32:15.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08a7fc640 1 -- 172.21.15.28:0/1047628881 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc07800bd40 con 0x7fc08c148a80 2023-11-28T19:32:15.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08bfff640 1 --2- 172.21.15.28:0/1047628881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc078004d10 0x7fc078005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:15.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08b7fe640 1 --2- 172.21.15.28:0/1047628881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0780039b0 0x7fc078003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:15.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08affd640 1 --2- 172.21.15.28:0/1047628881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc08c148a80 0x7fc0780047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:15.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08bfff640 1 -- 172.21.15.28:0/1047628881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc08c148a80 msgr2=0x7fc0780047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:15.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08bfff640 1 --2- 172.21.15.28:0/1047628881 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc08c148a80 0x7fc0780047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:15.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08bfff640 1 -- 172.21.15.28:0/1047628881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0780039b0 msgr2=0x7fc078003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:15.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08bfff640 1 --2- 172.21.15.28:0/1047628881 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc0780039b0 0x7fc078003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:15.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.649+0000 7fc08bfff640 1 -- 172.21.15.28:0/1047628881 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc078003530 con 0x7fc078004d10 2023-11-28T19:32:15.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08bfff640 1 --2- 172.21.15.28:0/1047628881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc078004d10 0x7fc078005190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc08400a860 tx=0x7fc08401d320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f5072baf7f79f4c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:15.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08a7fc640 1 -- 172.21.15.28:0/1047628881 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0840072d0 con 0x7fc078004d10 2023-11-28T19:32:15.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08a7fc640 1 -- 172.21.15.28:0/1047628881 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0840a8070 con 0x7fc078004d10 2023-11-28T19:32:15.661 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08a7fc640 1 -- 172.21.15.28:0/1047628881 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0840076b0 con 0x7fc078004d10 2023-11-28T19:32:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc091e6e640 1 -- 172.21.15.28:0/1047628881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc078004d10 msgr2=0x7fc078005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc091e6e640 1 --2- 172.21.15.28:0/1047628881 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc078004d10 0x7fc078005190 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc08400a860 tx=0x7fc08401d320 comp rx=0 tx=0).stop 2023-11-28T19:32:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08bfff640 1 -- 172.21.15.28:0/1047628881 reap_dead start 2023-11-28T19:32:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc091e6e640 1 -- 172.21.15.28:0/1047628881 shutdown_connections 2023-11-28T19:32:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc091e6e640 1 -- 172.21.15.28:0/1047628881 >> 172.21.15.28:0/1047628881 conn(0x7fc08c0b9d90 msgr2=0x7fc08c0ba1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc091e6e640 1 -- 172.21.15.28:0/1047628881 shutdown_connections 2023-11-28T19:32:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc091e6e640 1 -- 172.21.15.28:0/1047628881 wait complete. 2023-11-28T19:32:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc091e6e640 1 Processor -- start 2023-11-28T19:32:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc091e6e640 1 -- start start 2023-11-28T19:32:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc091e6e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc08c1e4280 0x7fc08c0b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:15.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc091e6e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc08c0b5b50 0x7fc08c141920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:15.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc091e6e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc08c1e4660 0x7fc08c141e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:15.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc091e6e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c0b7000 con 0x7fc08c1e4660 2023-11-28T19:32:15.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc091e6e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c13fea0 con 0x7fc08c1e4280 2023-11-28T19:32:15.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc091e6e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc08c1e5130 con 0x7fc08c0b5b50 2023-11-28T19:32:15.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc08c1e4660 0x7fc08c141e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:15.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08bfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc08c1e4660 0x7fc08c141e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52310/0 (socket says 172.21.15.28:52310) 2023-11-28T19:32:15.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08bfff640 1 -- 172.21.15.28:0/2010446960 learned_addr learned my addr 172.21.15.28:0/2010446960 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:15.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08b7fe640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc08c1e4280 0x7fc08c0b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:15.663 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08bfff640 1 -- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc08c0b5b50 msgr2=0x7fc08c141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:15.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08affd640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc08c0b5b50 0x7fc08c141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:15.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08bfff640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc08c0b5b50 0x7fc08c141920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:15.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08bfff640 1 -- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc08c1e4280 msgr2=0x7fc08c0b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:15.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08bfff640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc08c1e4280 0x7fc08c0b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:15.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08bfff640 1 -- 172.21.15.28:0/2010446960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08c1403f0 con 0x7fc08c1e4660 2023-11-28T19:32:15.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.653+0000 7fc08b7fe640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc08c1e4280 0x7fc08c0b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:15.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.657+0000 7fc08bfff640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc08c1e4660 0x7fc08c141e60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc08400a860 tx=0x7fc078005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:15.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.657+0000 7fc083fff640 1 -- 172.21.15.28:0/2010446960 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0840017c0 con 0x7fc08c1e4660 2023-11-28T19:32:15.664 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.657+0000 7fc083fff640 1 -- 172.21.15.28:0/2010446960 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc084001920 con 0x7fc08c1e4660 2023-11-28T19:32:15.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.657+0000 7fc091e6e640 1 -- 172.21.15.28:0/2010446960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08c0b7250 con 0x7fc08c1e4660 2023-11-28T19:32:15.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.657+0000 7fc083fff640 1 -- 172.21.15.28:0/2010446960 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0840072f0 con 0x7fc08c1e4660 2023-11-28T19:32:15.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.657+0000 7fc091e6e640 1 -- 172.21.15.28:0/2010446960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08c1e4c10 con 0x7fc08c1e4660 2023-11-28T19:32:15.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.657+0000 7fc091e6e640 1 -- 172.21.15.28:0/2010446960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc08c071740 con 0x7fc08c1e4660 2023-11-28T19:32:15.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.657+0000 7fc083fff640 1 -- 172.21.15.28:0/2010446960 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc0840aa030 con 0x7fc08c1e4660 2023-11-28T19:32:15.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.657+0000 7fc083fff640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc06c066470 0x7fc06c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:15.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.657+0000 7fc083fff640 1 -- 172.21.15.28:0/2010446960 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc08411d150 con 0x7fc08c1e4660 2023-11-28T19:32:15.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.657+0000 7fc08b7fe640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc06c066470 0x7fc06c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:15.665 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.657+0000 7fc08b7fe640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc06c066470 0x7fc06c068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc074004640 tx=0x7fc074008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:15.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.661+0000 7fc083fff640 1 -- 172.21.15.28:0/2010446960 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc0840ea8d0 con 0x7fc08c1e4660 2023-11-28T19:32:15.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:15.829+0000 7fc091e6e640 1 -- 172.21.15.28:0/2010446960 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc08c06c7b0 con 0x7fc08c1e4660 2023-11-28T19:32:17.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.101+0000 7fc083fff640 1 -- 172.21.15.28:0/2010446960 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc08c06c7b0 con 0x7fc08c1e4660 2023-11-28T19:32:17.102 INFO:teuthology.orchestra.run.smithi028.stderr: removed all blocklist entries 2023-11-28T19:32:17.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.105+0000 7fc091e6e640 1 -- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc06c066470 msgr2=0x7fc06c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:17.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.105+0000 7fc091e6e640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc06c066470 0x7fc06c068930 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc074004640 tx=0x7fc074008040 comp rx=0 tx=0).stop 2023-11-28T19:32:17.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.105+0000 7fc091e6e640 1 -- 172.21.15.28:0/2010446960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc08c1e4660 msgr2=0x7fc08c141e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:17.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.105+0000 7fc091e6e640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc08c1e4660 0x7fc08c141e60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc08400a860 tx=0x7fc078005800 comp rx=0 tx=0).stop 2023-11-28T19:32:17.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.105+0000 7fc091e6e640 1 -- 172.21.15.28:0/2010446960 shutdown_connections 2023-11-28T19:32:17.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.105+0000 7fc091e6e640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc06c066470 0x7fc06c068930 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.105+0000 7fc091e6e640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc08c1e4660 0x7fc08c141e60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.105+0000 7fc091e6e640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc08c0b5b50 0x7fc08c141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.105+0000 7fc091e6e640 1 --2- 172.21.15.28:0/2010446960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc08c1e4280 0x7fc08c0b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.105+0000 7fc091e6e640 1 -- 172.21.15.28:0/2010446960 >> 172.21.15.28:0/2010446960 conn(0x7fc08c0b9d90 msgr2=0x7fc08c0b82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:17.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.105+0000 7fc091e6e640 1 -- 172.21.15.28:0/2010446960 shutdown_connections 2023-11-28T19:32:17.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.105+0000 7fc091e6e640 1 -- 172.21.15.28:0/2010446960 wait complete. 2023-11-28T19:32:17.129 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-11-28T19:32:17.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f33c7f640 1 Processor -- start 2023-11-28T19:32:17.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f33c7f640 1 -- start start 2023-11-28T19:32:17.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f33c7f640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4f2c072630 0x7f4f2c0b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:17.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f33c7f640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f4f2c0b4a60 0x7f4f2c14c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:17.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f33c7f640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f2c0b75f0 con 0x7f4f2c0b4620 2023-11-28T19:32:17.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f33c7f640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f2c0b3880 con 0x7f4f2c072630 2023-11-28T19:32:17.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f33c7f640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f2c0b7bb0 con 0x7f4f2c0b4a60 2023-11-28T19:32:17.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f31a1b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f4f2c072630 0x7f4f2c0b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:17.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f3121a640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f4f2c0b4620 0x7f4f2c142e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47952/0 (socket says 172.21.15.28:47952) 2023-11-28T19:32:17.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f3121a640 1 -- 172.21.15.28:0/1981496357 learned_addr learned my addr 172.21.15.28:0/1981496357 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:17.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f3221c640 1 --2- 172.21.15.28:0/1981496357 >> v2:172.21.15.131:3300/0 conn(0x7f4f2c0b4a60 0x7f4f2c14c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:17.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f31a1b640 1 -- 172.21.15.28:0/1981496357 >> v2:172.21.15.131:3300/0 conn(0x7f4f2c0b4a60 msgr2=0x7f4f2c14c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:17.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f31a1b640 1 --2- 172.21.15.28:0/1981496357 >> v2:172.21.15.131:3300/0 conn(0x7f4f2c0b4a60 0x7f4f2c14c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f31a1b640 1 -- 172.21.15.28:0/1981496357 >> v1:172.21.15.28:6789/0 conn(0x7f4f2c0b4620 legacy=0x7f4f2c142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:17.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f31a1b640 1 -- 172.21.15.28:0/1981496357 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c0ba1b0 con 0x7f4f2c072630 2023-11-28T19:32:17.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.257+0000 7f4f3221c640 1 --2- 172.21.15.28:0/1981496357 >> v2:172.21.15.131:3300/0 conn(0x7f4f2c0b4a60 0x7f4f2c14c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:17.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f31a1b640 1 --2- 172.21.15.28:0/1981496357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f2c072630 0x7f4f2c0b9bb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c06fb00 tx=0x7f4f2801c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cc322b72b2c4eb3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:17.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f30a19640 1 -- 172.21.15.28:0/1981496357 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280ab600 con 0x7f4f2c072630 2023-11-28T19:32:17.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f30a19640 1 -- 172.21.15.28:0/1981496357 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f280a7050 con 0x7f4f2c072630 2023-11-28T19:32:17.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f30a19640 1 -- 172.21.15.28:0/1981496357 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f280ab980 con 0x7f4f2c072630 2023-11-28T19:32:17.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 -- 172.21.15.28:0/1981496357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f2c072630 msgr2=0x7f4f2c0b9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:17.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 --2- 172.21.15.28:0/1981496357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f2c072630 0x7f4f2c0b9bb0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c06fb00 tx=0x7f4f2801c3a0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 -- 172.21.15.28:0/1981496357 shutdown_connections 2023-11-28T19:32:17.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 --2- 172.21.15.28:0/1981496357 >> v2:172.21.15.131:3300/0 conn(0x7f4f2c0b4a60 0x7f4f2c14c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 --2- 172.21.15.28:0/1981496357 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f2c072630 0x7f4f2c0b9bb0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 -- 172.21.15.28:0/1981496357 >> 172.21.15.28:0/1981496357 conn(0x7f4f2c06b860 msgr2=0x7f4f2c06bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:17.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 -- 172.21.15.28:0/1981496357 shutdown_connections 2023-11-28T19:32:17.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 -- 172.21.15.28:0/1981496357 wait complete. 2023-11-28T19:32:17.265 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 Processor -- start 2023-11-28T19:32:17.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 -- start start 2023-11-28T19:32:17.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f2c072630 0x7f4f2c0bbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:17.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f2c0b4620 0x7f4f2c1495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:17.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f2c0b4a60 0x7f4f2c140d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:17.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c0be850 con 0x7f4f2c0b4620 2023-11-28T19:32:17.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c1412d0 con 0x7f4f2c072630 2023-11-28T19:32:17.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2c149140 con 0x7f4f2c0b4a60 2023-11-28T19:32:17.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f3121a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f2c0b4620 0x7f4f2c1495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:17.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f3121a640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f2c0b4620 0x7f4f2c1495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52342/0 (socket says 172.21.15.28:52342) 2023-11-28T19:32:17.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f3121a640 1 -- 172.21.15.28:0/985312076 learned_addr learned my addr 172.21.15.28:0/985312076 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:17.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f31a1b640 1 --2- 172.21.15.28:0/985312076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f2c072630 0x7f4f2c0bbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:17.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f3221c640 1 --2- 172.21.15.28:0/985312076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f2c0b4a60 0x7f4f2c140d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:17.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f3121a640 1 -- 172.21.15.28:0/985312076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f2c0b4a60 msgr2=0x7f4f2c140d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:17.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f3121a640 1 --2- 172.21.15.28:0/985312076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f2c0b4a60 0x7f4f2c140d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f3121a640 1 -- 172.21.15.28:0/985312076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f2c072630 msgr2=0x7f4f2c0bbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:17.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f3121a640 1 --2- 172.21.15.28:0/985312076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f2c072630 0x7f4f2c0bbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f3121a640 1 -- 172.21.15.28:0/985312076 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f28009420 con 0x7f4f2c0b4620 2023-11-28T19:32:17.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f3121a640 1 --2- 172.21.15.28:0/985312076 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f2c0b4620 0x7f4f2c1495d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00c430 tx=0x7f4f1c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:17.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f227fc640 1 -- 172.21.15.28:0/985312076 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c005cf0 con 0x7f4f2c0b4620 2023-11-28T19:32:17.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f227fc640 1 -- 172.21.15.28:0/985312076 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1c005e50 con 0x7f4f2c0b4620 2023-11-28T19:32:17.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f33c7f640 1 -- 172.21.15.28:0/985312076 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2c0bd670 con 0x7f4f2c0b4620 2023-11-28T19:32:17.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.261+0000 7f4f227fc640 1 -- 172.21.15.28:0/985312076 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0072d0 con 0x7f4f2c0b4620 2023-11-28T19:32:17.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.265+0000 7f4f33c7f640 1 -- 172.21.15.28:0/985312076 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2c0be290 con 0x7f4f2c0b4620 2023-11-28T19:32:17.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.265+0000 7f4f33c7f640 1 -- 172.21.15.28:0/985312076 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f2c148f70 con 0x7f4f2c0b4620 2023-11-28T19:32:17.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.265+0000 7f4f227fc640 1 -- 172.21.15.28:0/985312076 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f4f1c007430 con 0x7f4f2c0b4620 2023-11-28T19:32:17.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.265+0000 7f4f227fc640 1 --2- 172.21.15.28:0/985312076 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4f100664a0 0x7f4f10068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:17.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.265+0000 7f4f227fc640 1 -- 172.21.15.28:0/985312076 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4f1c082fb0 con 0x7f4f2c0b4620 2023-11-28T19:32:17.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.265+0000 7f4f31a1b640 1 --2- 172.21.15.28:0/985312076 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4f100664a0 0x7f4f10068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:17.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.265+0000 7f4f31a1b640 1 --2- 172.21.15.28:0/985312076 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4f100664a0 0x7f4f10068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4f280ad000 tx=0x7f4f28008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:17.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.269+0000 7f4f227fc640 1 -- 172.21.15.28:0/985312076 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f4f1c0b4280 con 0x7f4f2c0b4620 2023-11-28T19:32:17.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.481+0000 7f4f33c7f640 1 -- 172.21.15.28:0/985312076 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f4f2c074a90 con 0x7f4f2c0b4620 2023-11-28T19:32:17.486 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.485+0000 7f4f227fc640 1 -- 172.21.15.28:0/985312076 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+5491 (secure 0 0 0) 0x7f4f1c017090 con 0x7f4f2c0b4620 2023-11-28T19:32:17.487 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:17.487 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-11-28T19:32:17.487 INFO:teuthology.orchestra.run.smithi028.stdout: "auth_dump": [ 2023-11-28T19:32:17.487 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.487 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.a", 2023-11-28T19:32:17.487 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDeP2Zl591MFRAAOxOhZuLA1NWAR1I4Jeiz+Q==", 2023-11-28T19:32:17.487 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.487 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-11-28T19:32:17.487 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-11-28T19:32:17.487 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-11-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.b", 2023-11-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDeP2ZlwUpAJBAAtz4e+4IvKfM5l3iPSuDFZQ==", 2023-11-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-11-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-11-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-11-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.488 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mds.c", 2023-11-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDeP2ZlzfDbHRAAUO+9EmfsNrmSy/+yDI3h/A==", 2023-11-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-11-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-11-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-11-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.489 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.0", 2023-11-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDfP2ZlaWg3MRAAB4RX7CAUPIKnqAOx2vr4Gg==", 2023-11-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.490 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.491 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.1", 2023-11-28T19:32:17.491 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDiP2ZlzJN0OBAAmk4xsoHz7AYAvBpWR4XMCg==", 2023-11-28T19:32:17.491 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.491 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-28T19:32:17.491 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-28T19:32:17.491 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-28T19:32:17.491 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.491 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.491 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.491 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.2", 2023-11-28T19:32:17.491 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDmP2ZlQz4PBhAAUalDxk0dgsUmTx3lpNymvw==", 2023-11-28T19:32:17.492 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.492 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-28T19:32:17.492 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-28T19:32:17.492 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-28T19:32:17.492 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.492 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.492 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.492 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.3", 2023-11-28T19:32:17.492 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDpP2ZleTDGDhAAzMBYQFMyN575crG+dGjWlQ==", 2023-11-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.4", 2023-11-28T19:32:17.493 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDvP2Zl3goPDxAAf2xEgXaChvM3GLz4SKtGLA==", 2023-11-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.5", 2023-11-28T19:32:17.494 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDyP2ZlGFC3FRAA4AH5bUxN4axp+Jn1YDBRCA==", 2023-11-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-28T19:32:17.495 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.496 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.496 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.496 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.6", 2023-11-28T19:32:17.496 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQD1P2ZlgQnWHRAA1/JtVkEyhJxTgbKAyn+LRQ==", 2023-11-28T19:32:17.496 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.496 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-28T19:32:17.496 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-28T19:32:17.496 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-28T19:32:17.496 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.496 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.496 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.496 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "osd.7", 2023-11-28T19:32:17.497 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQD4P2Zl4BGCJhAAsH+BFvLtCaecx2MnpxgAJA==", 2023-11-28T19:32:17.497 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.497 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow profile osd", 2023-11-28T19:32:17.497 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile osd", 2023-11-28T19:32:17.497 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-28T19:32:17.497 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.497 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.497 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.498 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.0", 2023-11-28T19:32:17.498 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDeP2ZlIJB6KhAAD1X87Jdr4Z4RDtIDK8BvXg==", 2023-11-28T19:32:17.498 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.498 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow", 2023-11-28T19:32:17.498 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow r", 2023-11-28T19:32:17.498 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow rw", 2023-11-28T19:32:17.498 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow rwx" 2023-11-28T19:32:17.498 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.admin", 2023-11-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDdP2ZlbxBENBAAPWOr8aN2mLMM5rsjI2r/lA==", 2023-11-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-11-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi028.stdout: "mgr": "allow *", 2023-11-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow *", 2023-11-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.499 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-mds", 2023-11-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQAIQGZlLp4JFhAAXjvJHLEEeLqqLB3bqXHing==", 2023-11-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-mds" 2023-11-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-mgr", 2023-11-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQAIQGZlzbcJFhAAQA+/8UeWx4pYpRpsMDmvVw==", 2023-11-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-mgr" 2023-11-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.500 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-osd", 2023-11-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQAIQGZlB84JFhAAy8E9tQ4J48skvEl/TwRtgQ==", 2023-11-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-osd" 2023-11-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-rbd", 2023-11-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQAIQGZlcuMJFhAAaEAUc6dY3ilFsCfhhHqVzA==", 2023-11-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.501 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-rbd" 2023-11-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-11-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQAIQGZlO/oJFhAAy5NWE3IYfUpjo7VjoUADtw==", 2023-11-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-11-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "client.bootstrap-rgw", 2023-11-28T19:32:17.502 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQAIQGZlGBYKFhAAKHB9D58ZdxsHYhqedfwLmQ==", 2023-11-28T19:32:17.503 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.503 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile bootstrap-rgw" 2023-11-28T19:32:17.503 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.503 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.503 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.503 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mgr.x", 2023-11-28T19:32:17.503 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDeP2Zlqr/bERAA+VjORirozyy7qNdSyPcd4g==", 2023-11-28T19:32:17.503 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.503 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-11-28T19:32:17.503 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile mgr", 2023-11-28T19:32:17.503 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-28T19:32:17.503 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.504 INFO:teuthology.orchestra.run.smithi028.stdout: }, 2023-11-28T19:32:17.504 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:17.504 INFO:teuthology.orchestra.run.smithi028.stdout: "entity": "mgr.y", 2023-11-28T19:32:17.504 INFO:teuthology.orchestra.run.smithi028.stdout: "key": "AQDeP2ZlKHQhDxAALbbcyw6L6kA8hZsdTtQdbA==", 2023-11-28T19:32:17.504 INFO:teuthology.orchestra.run.smithi028.stdout: "caps": { 2023-11-28T19:32:17.504 INFO:teuthology.orchestra.run.smithi028.stdout: "mds": "allow *", 2023-11-28T19:32:17.504 INFO:teuthology.orchestra.run.smithi028.stdout: "mon": "allow profile mgr", 2023-11-28T19:32:17.504 INFO:teuthology.orchestra.run.smithi028.stdout: "osd": "allow *" 2023-11-28T19:32:17.504 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.504 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:17.504 INFO:teuthology.orchestra.run.smithi028.stdout: ] 2023-11-28T19:32:17.504 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-11-28T19:32:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.485+0000 7f4f33c7f640 1 -- 172.21.15.28:0/985312076 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4f100664a0 msgr2=0x7f4f10068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.485+0000 7f4f33c7f640 1 --2- 172.21.15.28:0/985312076 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4f100664a0 0x7f4f10068960 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4f280ad000 tx=0x7f4f28008040 comp rx=0 tx=0).stop 2023-11-28T19:32:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.485+0000 7f4f33c7f640 1 -- 172.21.15.28:0/985312076 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f2c0b4620 msgr2=0x7f4f2c1495d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.485+0000 7f4f33c7f640 1 --2- 172.21.15.28:0/985312076 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f2c0b4620 0x7f4f2c1495d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00c430 tx=0x7f4f1c00c8f0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.485+0000 7f4f33c7f640 1 -- 172.21.15.28:0/985312076 shutdown_connections 2023-11-28T19:32:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.485+0000 7f4f33c7f640 1 --2- 172.21.15.28:0/985312076 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f4f100664a0 0x7f4f10068960 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.485+0000 7f4f33c7f640 1 --2- 172.21.15.28:0/985312076 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f4f2c0b4a60 0x7f4f2c140d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.485+0000 7f4f33c7f640 1 --2- 172.21.15.28:0/985312076 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f4f2c0b4620 0x7f4f2c1495d0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.485+0000 7f4f33c7f640 1 --2- 172.21.15.28:0/985312076 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f2c072630 0x7f4f2c0bbc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.485+0000 7f4f33c7f640 1 -- 172.21.15.28:0/985312076 >> 172.21.15.28:0/985312076 conn(0x7f4f2c06b860 msgr2=0x7f4f2c0b9570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:17.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.485+0000 7f4f33c7f640 1 -- 172.21.15.28:0/985312076 shutdown_connections 2023-11-28T19:32:17.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.485+0000 7f4f33c7f640 1 -- 172.21.15.28:0/985312076 wait complete. 2023-11-28T19:32:17.508 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-11-28T19:32:17.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.629+0000 7fe087c65640 1 Processor -- start 2023-11-28T19:32:17.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.629+0000 7fe087c65640 1 -- start start 2023-11-28T19:32:17.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.629+0000 7fe087c65640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe080142560 0x7fe0800b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:17.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.629+0000 7fe087c65640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0800b4610 0x7fe0800b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.629+0000 7fe087c65640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0800b4aa0 con 0x7fe0800b5dd0 2023-11-28T19:32:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.629+0000 7fe087c65640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe08006f950 con 0x7fe080142560 2023-11-28T19:32:17.633 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.629+0000 7fe087c65640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800b70c0 con 0x7fe0800b4610 2023-11-28T19:32:17.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.629+0000 7fe085a01640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe080142560 0x7fe0800b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:17.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.629+0000 7fe086202640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0800b4610 0x7fe0800b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:17.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.629+0000 7fe086202640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0800b4610 0x7fe0800b6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:33270/0 (socket says 172.21.15.28:33270) 2023-11-28T19:32:17.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.629+0000 7fe086202640 1 -- 172.21.15.28:0/273706275 learned_addr learned my addr 172.21.15.28:0/273706275 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:17.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.629+0000 7fe085200640 1 --1- 172.21.15.28:0/273706275 >> v1:172.21.15.131:6789/0 conn(0x7fe0800b5dd0 0x7fe0800b6470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:60196/0 (socket says 172.21.15.28:60196) 2023-11-28T19:32:17.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe086202640 1 -- 172.21.15.28:0/273706275 >> v2:172.21.15.131:3300/0 conn(0x7fe080142560 msgr2=0x7fe0800b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:17.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe086202640 1 --2- 172.21.15.28:0/273706275 >> v2:172.21.15.131:3300/0 conn(0x7fe080142560 0x7fe0800b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe086202640 1 -- 172.21.15.28:0/273706275 >> v1:172.21.15.131:6789/0 conn(0x7fe0800b5dd0 legacy=0x7fe0800b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:17.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe086202640 1 -- 172.21.15.28:0/273706275 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe080142940 con 0x7fe0800b4610 2023-11-28T19:32:17.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe085a01640 1 --2- 172.21.15.28:0/273706275 >> v2:172.21.15.131:3300/0 conn(0x7fe080142560 0x7fe0800b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:32:17.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe086202640 1 --2- 172.21.15.28:0/273706275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0800b4610 0x7fe0800b6b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe078009e50 tx=0x7fe07801f1f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1247dcf48ed75094 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:17.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe0849ff640 1 -- 172.21.15.28:0/273706275 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0780af400 con 0x7fe0800b4610 2023-11-28T19:32:17.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe0849ff640 1 -- 172.21.15.28:0/273706275 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0780ab050 con 0x7fe0800b4610 2023-11-28T19:32:17.636 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe0849ff640 1 -- 172.21.15.28:0/273706275 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0780af780 con 0x7fe0800b4610 2023-11-28T19:32:17.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe087c65640 1 -- 172.21.15.28:0/273706275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0800b4610 msgr2=0x7fe0800b6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:17.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe087c65640 1 --2- 172.21.15.28:0/273706275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0800b4610 0x7fe0800b6b80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe078009e50 tx=0x7fe07801f1f0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.637 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe087c65640 1 -- 172.21.15.28:0/273706275 shutdown_connections 2023-11-28T19:32:17.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe087c65640 1 --2- 172.21.15.28:0/273706275 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0800b4610 0x7fe0800b6b80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe087c65640 1 --2- 172.21.15.28:0/273706275 >> v2:172.21.15.131:3300/0 conn(0x7fe080142560 0x7fe0800b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe087c65640 1 -- 172.21.15.28:0/273706275 >> 172.21.15.28:0/273706275 conn(0x7fe0800bcb40 msgr2=0x7fe0800bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:17.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe087c65640 1 -- 172.21.15.28:0/273706275 shutdown_connections 2023-11-28T19:32:17.638 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.633+0000 7fe087c65640 1 -- 172.21.15.28:0/273706275 wait complete. 2023-11-28T19:32:17.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe087c65640 1 Processor -- start 2023-11-28T19:32:17.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe087c65640 1 -- start start 2023-11-28T19:32:17.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe087c65640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0800b4610 0x7fe0800bbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:17.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe087c65640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0800b5dd0 0x7fe0801ddcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:17.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe087c65640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe080142560 0x7fe080137850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:17.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe087c65640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0800bc130 con 0x7fe0800b5dd0 2023-11-28T19:32:17.640 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe087c65640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe080070ea0 con 0x7fe080142560 2023-11-28T19:32:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe087c65640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe080071460 con 0x7fe0800b4610 2023-11-28T19:32:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe085200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0800b5dd0 0x7fe0801ddcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe085200640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0800b5dd0 0x7fe0801ddcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52346/0 (socket says 172.21.15.28:52346) 2023-11-28T19:32:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe085200640 1 -- 172.21.15.28:0/1185677578 learned_addr learned my addr 172.21.15.28:0/1185677578 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe085a01640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0800b4610 0x7fe0800bbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe086202640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe080142560 0x7fe080137850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe085200640 1 -- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0800b4610 msgr2=0x7fe0800bbbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe085200640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0800b4610 0x7fe0800bbbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe085200640 1 -- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe080142560 msgr2=0x7fe080137850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe085200640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe080142560 0x7fe080137850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe085200640 1 -- 172.21.15.28:0/1185677578 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c009420 con 0x7fe0800b5dd0 2023-11-28T19:32:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe086202640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe080142560 0x7fe080137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:17.641 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe085200640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0800b5dd0 0x7fe0801ddcd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe07000c460 tx=0x7fe07000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:17.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe0767fc640 1 -- 172.21.15.28:0/1185677578 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070007480 con 0x7fe0800b5dd0 2023-11-28T19:32:17.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe0767fc640 1 -- 172.21.15.28:0/1185677578 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0700075e0 con 0x7fe0800b5dd0 2023-11-28T19:32:17.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe087c65640 1 -- 172.21.15.28:0/1185677578 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe078009b30 con 0x7fe0800b5dd0 2023-11-28T19:32:17.642 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe0767fc640 1 -- 172.21.15.28:0/1185677578 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe070004a30 con 0x7fe0800b5dd0 2023-11-28T19:32:17.643 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe087c65640 1 -- 172.21.15.28:0/1185677578 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe080141be0 con 0x7fe0800b5dd0 2023-11-28T19:32:17.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe087c65640 1 -- 172.21.15.28:0/1185677578 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0800715f0 con 0x7fe0800b5dd0 2023-11-28T19:32:17.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe0767fc640 1 -- 172.21.15.28:0/1185677578 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe070004b90 con 0x7fe0800b5dd0 2023-11-28T19:32:17.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.637+0000 7fe0767fc640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe064066470 0x7fe064068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:17.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.641+0000 7fe0767fc640 1 -- 172.21.15.28:0/1185677578 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe070082e70 con 0x7fe0800b5dd0 2023-11-28T19:32:17.646 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.641+0000 7fe085a01640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe064066470 0x7fe064068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:17.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.641+0000 7fe085a01640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe064066470 0x7fe064068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009be0 tx=0x7fe07c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:17.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.645+0000 7fe0767fc640 1 -- 172.21.15.28:0/1185677578 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe0700506d0 con 0x7fe0800b5dd0 2023-11-28T19:32:17.856 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.853+0000 7fe087c65640 1 -- 172.21.15.28:0/1185677578 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fe080074a90 con 0x7fe0800b5dd0 2023-11-28T19:32:17.861 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.857+0000 7fe0767fc640 1 -- 172.21.15.28:0/1185677578 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fe0700180a0 con 0x7fe0800b5dd0 2023-11-28T19:32:17.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.861+0000 7fe087c65640 1 -- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe064066470 msgr2=0x7fe064068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:17.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.861+0000 7fe087c65640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe064066470 0x7fe064068930 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe07c009be0 tx=0x7fe07c008040 comp rx=0 tx=0).stop 2023-11-28T19:32:17.862 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.861+0000 7fe087c65640 1 -- 172.21.15.28:0/1185677578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0800b5dd0 msgr2=0x7fe0801ddcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:17.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.861+0000 7fe087c65640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0800b5dd0 0x7fe0801ddcd0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe07000c460 tx=0x7fe07000c920 comp rx=0 tx=0).stop 2023-11-28T19:32:17.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.861+0000 7fe087c65640 1 -- 172.21.15.28:0/1185677578 shutdown_connections 2023-11-28T19:32:17.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.861+0000 7fe087c65640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe064066470 0x7fe064068930 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.861+0000 7fe087c65640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe080142560 0x7fe080137850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.861+0000 7fe087c65640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe0800b5dd0 0x7fe0801ddcd0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.861+0000 7fe087c65640 1 --2- 172.21.15.28:0/1185677578 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe0800b4610 0x7fe0800bbbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:17.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.861+0000 7fe087c65640 1 -- 172.21.15.28:0/1185677578 >> 172.21.15.28:0/1185677578 conn(0x7fe0800bcb40 msgr2=0x7fe08013c8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:17.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.861+0000 7fe087c65640 1 -- 172.21.15.28:0/1185677578 shutdown_connections 2023-11-28T19:32:17.863 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:17.861+0000 7fe087c65640 1 -- 172.21.15.28:0/1185677578 wait complete. 2023-11-28T19:32:17.880 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-11-28T19:32:18.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.005+0000 7fd7f4b5e640 1 Processor -- start 2023-11-28T19:32:18.008 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.005+0000 7fd7f4b5e640 1 -- start start 2023-11-28T19:32:18.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.005+0000 7fd7f4b5e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd7f014ccc0 0x7fd7f0154c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.005+0000 7fd7f4b5e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f006f780 con 0x7fd7f014c860 2023-11-28T19:32:18.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.005+0000 7fd7f4b5e640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f0072320 con 0x7fd7f00b8f30 2023-11-28T19:32:18.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.005+0000 7fd7f4b5e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7f0143aa0 con 0x7fd7f014ccc0 2023-11-28T19:32:18.010 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.005+0000 7fd7eed9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd7f014ccc0 0x7fd7f0154c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.005+0000 7fd7eed9d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd7f014ccc0 0x7fd7f0154c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52352/0 (socket says 172.21.15.28:52352) 2023-11-28T19:32:18.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.005+0000 7fd7eed9d640 1 -- 172.21.15.28:0/3037305429 learned_addr learned my addr 172.21.15.28:0/3037305429 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:18.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.005+0000 7fd7edd9b640 1 --1- 172.21.15.28:0/3037305429 >> v1:172.21.15.28:6789/0 conn(0x7fd7f014c860 0x7fd7f00b6250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47962/0 (socket says 172.21.15.28:47962) 2023-11-28T19:32:18.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.005+0000 7fd7eed9d640 1 -- 172.21.15.28:0/3037305429 >> v1:172.21.15.131:6789/0 conn(0x7fd7f00b8f30 legacy=0x7fd7f0071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:18.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.005+0000 7fd7eed9d640 1 -- 172.21.15.28:0/3037305429 >> v1:172.21.15.28:6789/0 conn(0x7fd7f014c860 legacy=0x7fd7f00b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.011 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.005+0000 7fd7eed9d640 1 -- 172.21.15.28:0/3037305429 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f006fcf0 con 0x7fd7f014ccc0 2023-11-28T19:32:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7eed9d640 1 --2- 172.21.15.28:0/3037305429 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7f014ccc0 0x7fd7f0154c00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009870 tx=0x7fd7e801c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7a10a72fd10675 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:18.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7ed59a640 1 -- 172.21.15.28:0/3037305429 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80ab600 con 0x7fd7f014ccc0 2023-11-28T19:32:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7ed59a640 1 -- 172.21.15.28:0/3037305429 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e80a7050 con 0x7fd7f014ccc0 2023-11-28T19:32:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7ed59a640 1 -- 172.21.15.28:0/3037305429 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80ab980 con 0x7fd7f014ccc0 2023-11-28T19:32:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/3037305429 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7f014ccc0 msgr2=0x7fd7f0154c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 --2- 172.21.15.28:0/3037305429 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7f014ccc0 0x7fd7f0154c00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8009870 tx=0x7fd7e801c500 comp rx=0 tx=0).stop 2023-11-28T19:32:18.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/3037305429 shutdown_connections 2023-11-28T19:32:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 --2- 172.21.15.28:0/3037305429 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7f014ccc0 0x7fd7f0154c00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/3037305429 >> 172.21.15.28:0/3037305429 conn(0x7fd7f00bcb40 msgr2=0x7fd7f00bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/3037305429 shutdown_connections 2023-11-28T19:32:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/3037305429 wait complete. 2023-11-28T19:32:18.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 Processor -- start 2023-11-28T19:32:18.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 -- start start 2023-11-28T19:32:18.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7f00b8f30 0x7fd7f013d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7f014c860 0x7fd7f0138010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7f014ccc0 0x7fd7f0135a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f013d7c0 con 0x7fd7f014ccc0 2023-11-28T19:32:18.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f01e5510 con 0x7fd7f014c860 2023-11-28T19:32:18.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.009+0000 7fd7f4b5e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f01e6460 con 0x7fd7f00b8f30 2023-11-28T19:32:18.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7eed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7f014ccc0 0x7fd7f0135a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7eed9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7f014ccc0 0x7fd7f0135a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52358/0 (socket says 172.21.15.28:52358) 2023-11-28T19:32:18.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7eed9d640 1 -- 172.21.15.28:0/2184962940 learned_addr learned my addr 172.21.15.28:0/2184962940 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:18.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7ee59c640 1 --2- 172.21.15.28:0/2184962940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7f00b8f30 0x7fd7f013d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7edd9b640 1 --2- 172.21.15.28:0/2184962940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7f014c860 0x7fd7f0138010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7eed9d640 1 -- 172.21.15.28:0/2184962940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7f00b8f30 msgr2=0x7fd7f013d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7eed9d640 1 --2- 172.21.15.28:0/2184962940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7f00b8f30 0x7fd7f013d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7eed9d640 1 -- 172.21.15.28:0/2184962940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7f014c860 msgr2=0x7fd7f0138010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7eed9d640 1 --2- 172.21.15.28:0/2184962940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7f014c860 0x7fd7f0138010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7eed9d640 1 -- 172.21.15.28:0/2184962940 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e80094d0 con 0x7fd7f014ccc0 2023-11-28T19:32:18.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7eed9d640 1 --2- 172.21.15.28:0/2184962940 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7f014ccc0 0x7fd7f0135a40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8019110 tx=0x7fd7e801ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:18.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7e6ffd640 1 -- 172.21.15.28:0/2184962940 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80b6620 con 0x7fd7f014ccc0 2023-11-28T19:32:18.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7e6ffd640 1 -- 172.21.15.28:0/2184962940 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e80b6780 con 0x7fd7f014ccc0 2023-11-28T19:32:18.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7e6ffd640 1 -- 172.21.15.28:0/2184962940 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e80b6b30 con 0x7fd7f014ccc0 2023-11-28T19:32:18.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/2184962940 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f01477a0 con 0x7fd7f014ccc0 2023-11-28T19:32:18.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/2184962940 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f0136ca0 con 0x7fd7f014ccc0 2023-11-28T19:32:18.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/2184962940 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f0074a90 con 0x7fd7f014ccc0 2023-11-28T19:32:18.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7e6ffd640 1 -- 172.21.15.28:0/2184962940 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd7e80b2040 con 0x7fd7f014ccc0 2023-11-28T19:32:18.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7e6ffd640 1 --2- 172.21.15.28:0/2184962940 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd7d0066470 0x7fd7d0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7e6ffd640 1 -- 172.21.15.28:0/2184962940 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd7e811dc50 con 0x7fd7f014ccc0 2023-11-28T19:32:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.013+0000 7fd7ee59c640 1 --2- 172.21.15.28:0/2184962940 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd7d0066470 0x7fd7d0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.017+0000 7fd7ee59c640 1 --2- 172.21.15.28:0/2184962940 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd7d0066470 0x7fd7d0068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0005530 tx=0x7fd7e0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:18.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.017+0000 7fd7e6ffd640 1 -- 172.21.15.28:0/2184962940 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd7e80eb380 con 0x7fd7f014ccc0 2023-11-28T19:32:18.235 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.233+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/2184962940 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd7f0072320 con 0x7fd7f014ccc0 2023-11-28T19:32:18.238 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.237+0000 7fd7e6ffd640 1 -- 172.21.15.28:0/2184962940 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd7f0072320 con 0x7fd7f014ccc0 2023-11-28T19:32:18.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.237+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/2184962940 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd7d0066470 msgr2=0x7fd7d0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.241+0000 7fd7f4b5e640 1 --2- 172.21.15.28:0/2184962940 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd7d0066470 0x7fd7d0068930 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0005530 tx=0x7fd7e0009040 comp rx=0 tx=0).stop 2023-11-28T19:32:18.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.241+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/2184962940 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7f014ccc0 msgr2=0x7fd7f0135a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.241+0000 7fd7f4b5e640 1 --2- 172.21.15.28:0/2184962940 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7f014ccc0 0x7fd7f0135a40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8019110 tx=0x7fd7e801ad40 comp rx=0 tx=0).stop 2023-11-28T19:32:18.242 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.241+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/2184962940 shutdown_connections 2023-11-28T19:32:18.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.241+0000 7fd7f4b5e640 1 --2- 172.21.15.28:0/2184962940 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd7d0066470 0x7fd7d0068930 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.241+0000 7fd7f4b5e640 1 --2- 172.21.15.28:0/2184962940 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7f014ccc0 0x7fd7f0135a40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.241+0000 7fd7f4b5e640 1 --2- 172.21.15.28:0/2184962940 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7f014c860 0x7fd7f0138010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.241+0000 7fd7f4b5e640 1 --2- 172.21.15.28:0/2184962940 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7f00b8f30 0x7fd7f013d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.241+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/2184962940 >> 172.21.15.28:0/2184962940 conn(0x7fd7f00bcb40 msgr2=0x7fd7f00bb930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:18.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.241+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/2184962940 shutdown_connections 2023-11-28T19:32:18.243 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.241+0000 7fd7f4b5e640 1 -- 172.21.15.28:0/2184962940 wait complete. 2023-11-28T19:32:18.259 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-11-28T19:32:18.379 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f6619ec1640 1 Processor -- start 2023-11-28T19:32:18.380 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f6619ec1640 1 -- start start 2023-11-28T19:32:18.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f6619ec1640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6614148140 0x7f6614153260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f6619ec1640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6614142000 con 0x7f66140b5ee0 2023-11-28T19:32:18.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f6619ec1640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66140b64e0 con 0x7f66140b8c40 2023-11-28T19:32:18.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f6619ec1640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66140b6d90 con 0x7f6614148140 2023-11-28T19:32:18.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f6612ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f66140b5ee0 0x7f66141418f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47978/0 (socket says 172.21.15.28:47978) 2023-11-28T19:32:18.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f6612ffd640 1 -- 172.21.15.28:0/2028750819 learned_addr learned my addr 172.21.15.28:0/2028750819 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:18.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f6613fff640 1 --2- 172.21.15.28:0/2028750819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6614148140 0x7f6614153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 -- 172.21.15.28:0/2028750819 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4165831469 0 0) 0x7f6614142000 con 0x7f66140b5ee0 2023-11-28T19:32:18.381 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 -- 172.21.15.28:0/2028750819 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6600003530 con 0x7f66140b5ee0 2023-11-28T19:32:18.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 -- 172.21.15.28:0/2028750819 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3368796468 0 0) 0x7f6600003530 con 0x7f66140b5ee0 2023-11-28T19:32:18.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 -- 172.21.15.28:0/2028750819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6614148140 msgr2=0x7f6614153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:18.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 --2- 172.21.15.28:0/2028750819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6614148140 0x7f6614153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 -- 172.21.15.28:0/2028750819 >> v1:172.21.15.131:6789/0 conn(0x7f66140b8c40 legacy=0x7f66140b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 -- 172.21.15.28:0/2028750819 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66140b67c0 con 0x7f66140b5ee0 2023-11-28T19:32:18.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 -- 172.21.15.28:0/2028750819 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f65fc001680 con 0x7f66140b5ee0 2023-11-28T19:32:18.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 -- 172.21.15.28:0/2028750819 >> v1:172.21.15.28:6789/0 conn(0x7f66140b5ee0 legacy=0x7f66141418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 --2- 172.21.15.28:0/2028750819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66000039b0 0x7f6600003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.383 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 --2- 172.21.15.28:0/2028750819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66000047d0 0x7f6600004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 --2- 172.21.15.28:0/2028750819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6614148140 0x7f6600005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 -- 172.21.15.28:0/2028750819 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660000dce0 con 0x7f66000039b0 2023-11-28T19:32:18.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 -- 172.21.15.28:0/2028750819 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660000de20 con 0x7f66000047d0 2023-11-28T19:32:18.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66127fc640 1 -- 172.21.15.28:0/2028750819 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660000dfe0 con 0x7f6614148140 2023-11-28T19:32:18.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.377+0000 7f66137fe640 1 --2- 172.21.15.28:0/2028750819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66000039b0 0x7f6600003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f6612ffd640 1 --2- 172.21.15.28:0/2028750819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66000047d0 0x7f6600004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f66137fe640 1 -- 172.21.15.28:0/2028750819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6614148140 msgr2=0x7f6600005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:18.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f66137fe640 1 --2- 172.21.15.28:0/2028750819 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6614148140 0x7f6600005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.384 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f66137fe640 1 -- 172.21.15.28:0/2028750819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66000047d0 msgr2=0x7f6600004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:18.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f66137fe640 1 --2- 172.21.15.28:0/2028750819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66000047d0 0x7f6600004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f66137fe640 1 -- 172.21.15.28:0/2028750819 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6600003530 con 0x7f66000039b0 2023-11-28T19:32:18.385 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f6612ffd640 1 --2- 172.21.15.28:0/2028750819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66000047d0 0x7f6600004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:18.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f66137fe640 1 --2- 172.21.15.28:0/2028750819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66000039b0 0x7f6600003dd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6604001e40 tx=0x7f660401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec0884aa96790f1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:18.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f66127fc640 1 -- 172.21.15.28:0/2028750819 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604003b80 con 0x7f66000039b0 2023-11-28T19:32:18.388 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f66127fc640 1 -- 172.21.15.28:0/2028750819 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6604003ce0 con 0x7f66000039b0 2023-11-28T19:32:18.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f66127fc640 1 -- 172.21.15.28:0/2028750819 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6604005310 con 0x7f66000039b0 2023-11-28T19:32:18.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f6619ec1640 1 -- 172.21.15.28:0/2028750819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66000039b0 msgr2=0x7f6600003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f6619ec1640 1 --2- 172.21.15.28:0/2028750819 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66000039b0 0x7f6600003dd0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6604001e40 tx=0x7f660401c540 comp rx=0 tx=0).stop 2023-11-28T19:32:18.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f6613fff640 1 -- 172.21.15.28:0/2028750819 reap_dead start 2023-11-28T19:32:18.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f6619ec1640 1 -- 172.21.15.28:0/2028750819 shutdown_connections 2023-11-28T19:32:18.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f6619ec1640 1 -- 172.21.15.28:0/2028750819 >> 172.21.15.28:0/2028750819 conn(0x7f66140bcb40 msgr2=0x7f66140bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:18.389 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f6619ec1640 1 -- 172.21.15.28:0/2028750819 shutdown_connections 2023-11-28T19:32:18.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.381+0000 7f6619ec1640 1 -- 172.21.15.28:0/2028750819 wait complete. 2023-11-28T19:32:18.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6619ec1640 1 Processor -- start 2023-11-28T19:32:18.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6619ec1640 1 -- start start 2023-11-28T19:32:18.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6619ec1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66000039b0 0x7f6614071190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6619ec1640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140b2dd0 0x7f6614143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6619ec1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66141443d0 0x7f66141e4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6619ec1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66140716d0 con 0x7f66141443d0 2023-11-28T19:32:18.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6619ec1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6614142df0 con 0x7f66000039b0 2023-11-28T19:32:18.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6619ec1640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6614144d40 con 0x7f66140b2dd0 2023-11-28T19:32:18.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6613fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66141443d0 0x7f66141e4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6613fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66141443d0 0x7f66141e4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52374/0 (socket says 172.21.15.28:52374) 2023-11-28T19:32:18.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6613fff640 1 -- 172.21.15.28:0/4101377454 learned_addr learned my addr 172.21.15.28:0/4101377454 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:18.390 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6612ffd640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140b2dd0 0x7f6614143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f66137fe640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66000039b0 0x7f6614071190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6613fff640 1 -- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140b2dd0 msgr2=0x7f6614143e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6613fff640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140b2dd0 0x7f6614143e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6613fff640 1 -- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66000039b0 msgr2=0x7f6614071190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6613fff640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66000039b0 0x7f6614071190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6613fff640 1 -- 172.21.15.28:0/4101377454 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66141422c0 con 0x7f66141443d0 2023-11-28T19:32:18.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f66137fe640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66000039b0 0x7f6614071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:18.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6613fff640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66141443d0 0x7f66141e4120 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f660c00a590 tx=0x7f660c00e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:18.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f660bfff640 1 -- 172.21.15.28:0/4101377454 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c0108e0 con 0x7f66141443d0 2023-11-28T19:32:18.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f660bfff640 1 -- 172.21.15.28:0/4101377454 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f660c010a40 con 0x7f66141443d0 2023-11-28T19:32:18.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6619ec1640 1 -- 172.21.15.28:0/4101377454 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6614144f50 con 0x7f66141443d0 2023-11-28T19:32:18.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f660bfff640 1 -- 172.21.15.28:0/4101377454 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f660c010dd0 con 0x7f66141443d0 2023-11-28T19:32:18.391 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6619ec1640 1 -- 172.21.15.28:0/4101377454 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6614145230 con 0x7f66141443d0 2023-11-28T19:32:18.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f6619ec1640 1 -- 172.21.15.28:0/4101377454 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66141427a0 con 0x7f66141443d0 2023-11-28T19:32:18.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.385+0000 7f660bfff640 1 -- 172.21.15.28:0/4101377454 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f660c01d460 con 0x7f66141443d0 2023-11-28T19:32:18.392 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.389+0000 7f660bfff640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f65f40664a0 0x7f65f4068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.389+0000 7f660bfff640 1 -- 172.21.15.28:0/4101377454 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f660c083320 con 0x7f66141443d0 2023-11-28T19:32:18.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.389+0000 7f66137fe640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f65f40664a0 0x7f65f4068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.393 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.389+0000 7f66137fe640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f65f40664a0 0x7f65f4068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f66040ad000 tx=0x7f6604001520 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:18.394 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.393+0000 7f660bfff640 1 -- 172.21.15.28:0/4101377454 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f66141427a0 con 0x7f66141443d0 2023-11-28T19:32:18.606 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.601+0000 7f6619ec1640 1 -- 172.21.15.28:0/4101377454 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f66141427a0 con 0x7f66141443d0 2023-11-28T19:32:18.609 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.609+0000 7f660bfff640 1 -- 172.21.15.28:0/4101377454 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f660c050af0 con 0x7f66141443d0 2023-11-28T19:32:18.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.609+0000 7f6619ec1640 1 -- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f65f40664a0 msgr2=0x7f65f4068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.612 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.609+0000 7f6619ec1640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f65f40664a0 0x7f65f4068960 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f66040ad000 tx=0x7f6604001520 comp rx=0 tx=0).stop 2023-11-28T19:32:18.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.609+0000 7f6619ec1640 1 -- 172.21.15.28:0/4101377454 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66141443d0 msgr2=0x7f66141e4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.609+0000 7f6619ec1640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66141443d0 0x7f66141e4120 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f660c00a590 tx=0x7f660c00e9a0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.609+0000 7f6619ec1640 1 -- 172.21.15.28:0/4101377454 shutdown_connections 2023-11-28T19:32:18.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.609+0000 7f6619ec1640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f65f40664a0 0x7f65f4068960 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.609+0000 7f6619ec1640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f66141443d0 0x7f66141e4120 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.609+0000 7f6619ec1640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f66140b2dd0 0x7f6614143e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.609+0000 7f6619ec1640 1 --2- 172.21.15.28:0/4101377454 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f66000039b0 0x7f6614071190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.609+0000 7f6619ec1640 1 -- 172.21.15.28:0/4101377454 >> 172.21.15.28:0/4101377454 conn(0x7f66140bcb40 msgr2=0x7f66140b7230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:18.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.609+0000 7f6619ec1640 1 -- 172.21.15.28:0/4101377454 shutdown_connections 2023-11-28T19:32:18.613 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.609+0000 7f6619ec1640 1 -- 172.21.15.28:0/4101377454 wait complete. 2023-11-28T19:32:18.628 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-11-28T19:32:18.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.741+0000 7fdd3a094640 1 Processor -- start 2023-11-28T19:32:18.744 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.741+0000 7fdd3a094640 1 -- start start 2023-11-28T19:32:18.745 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.741+0000 7fdd3a094640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd340b5dd0 0x7fdd340b6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.745 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.741+0000 7fdd3a094640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd34142940 con 0x7fdd34142560 2023-11-28T19:32:18.745 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.741+0000 7fdd3a094640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd3414bb40 con 0x7fdd340b47e0 2023-11-28T19:32:18.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.741+0000 7fdd3a094640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3406f950 con 0x7fdd340b5dd0 2023-11-28T19:32:18.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.741+0000 7fdd337fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fdd34142560 0x7fdd340b40d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47994/0 (socket says 172.21.15.28:47994) 2023-11-28T19:32:18.746 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.741+0000 7fdd337fe640 1 -- 172.21.15.28:0/4164452100 learned_addr learned my addr 172.21.15.28:0/4164452100 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:18.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd32ffd640 1 --2- 172.21.15.28:0/4164452100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd340b5dd0 0x7fdd340b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.747 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 -- 172.21.15.28:0/4164452100 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2442254544 0 0) 0x7fdd34142940 con 0x7fdd34142560 2023-11-28T19:32:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 -- 172.21.15.28:0/4164452100 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd1c003530 con 0x7fdd34142560 2023-11-28T19:32:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 -- 172.21.15.28:0/4164452100 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 86901997 0 0) 0x7fdd1c003530 con 0x7fdd34142560 2023-11-28T19:32:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 -- 172.21.15.28:0/4164452100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd340b5dd0 msgr2=0x7fdd340b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 --2- 172.21.15.28:0/4164452100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd340b5dd0 0x7fdd340b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 -- 172.21.15.28:0/4164452100 >> v1:172.21.15.131:6789/0 conn(0x7fdd340b47e0 legacy=0x7fdd340b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 -- 172.21.15.28:0/4164452100 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd3414be20 con 0x7fdd34142560 2023-11-28T19:32:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 -- 172.21.15.28:0/4164452100 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7fdd24001a00 con 0x7fdd34142560 2023-11-28T19:32:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 -- 172.21.15.28:0/4164452100 >> v1:172.21.15.28:6789/0 conn(0x7fdd34142560 legacy=0x7fdd340b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 --2- 172.21.15.28:0/4164452100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd1c0039b0 0x7fdd1c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 --2- 172.21.15.28:0/4164452100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd1c0047d0 0x7fdd1c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 --2- 172.21.15.28:0/4164452100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd340b5dd0 0x7fdd1c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 -- 172.21.15.28:0/4164452100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd3406f950 con 0x7fdd1c0039b0 2023-11-28T19:32:18.748 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 -- 172.21.15.28:0/4164452100 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c00bb00 con 0x7fdd1c0047d0 2023-11-28T19:32:18.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 -- 172.21.15.28:0/4164452100 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd1c00bcc0 con 0x7fdd340b5dd0 2023-11-28T19:32:18.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd337fe640 1 --2- 172.21.15.28:0/4164452100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd1c0039b0 0x7fdd1c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd32ffd640 1 --2- 172.21.15.28:0/4164452100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd1c0047d0 0x7fdd1c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd337fe640 1 -- 172.21.15.28:0/4164452100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd340b5dd0 msgr2=0x7fdd1c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:18.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd337fe640 1 --2- 172.21.15.28:0/4164452100 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd340b5dd0 0x7fdd1c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd337fe640 1 -- 172.21.15.28:0/4164452100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd1c0047d0 msgr2=0x7fdd1c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:18.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd337fe640 1 --2- 172.21.15.28:0/4164452100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd1c0047d0 0x7fdd1c004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.749 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd337fe640 1 -- 172.21.15.28:0/4164452100 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1c003530 con 0x7fdd1c0039b0 2023-11-28T19:32:18.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd337fe640 1 --2- 172.21.15.28:0/4164452100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd1c0039b0 0x7fdd1c003dd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdd24002240 tx=0x7fdd2401f980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1adee64a54470e40 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:18.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 -- 172.21.15.28:0/4164452100 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd240ac630 con 0x7fdd1c0039b0 2023-11-28T19:32:18.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 -- 172.21.15.28:0/4164452100 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd240ac790 con 0x7fdd1c0039b0 2023-11-28T19:32:18.750 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.745+0000 7fdd327fc640 1 -- 172.21.15.28:0/4164452100 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd240acb80 con 0x7fdd1c0039b0 2023-11-28T19:32:18.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 -- 172.21.15.28:0/4164452100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd1c0039b0 msgr2=0x7fdd1c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 --2- 172.21.15.28:0/4164452100 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd1c0039b0 0x7fdd1c003dd0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fdd24002240 tx=0x7fdd2401f980 comp rx=0 tx=0).stop 2023-11-28T19:32:18.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd33fff640 1 -- 172.21.15.28:0/4164452100 reap_dead start 2023-11-28T19:32:18.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 -- 172.21.15.28:0/4164452100 shutdown_connections 2023-11-28T19:32:18.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 -- 172.21.15.28:0/4164452100 >> 172.21.15.28:0/4164452100 conn(0x7fdd340bcb40 msgr2=0x7fdd340bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:18.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 -- 172.21.15.28:0/4164452100 shutdown_connections 2023-11-28T19:32:18.751 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 -- 172.21.15.28:0/4164452100 wait complete. 2023-11-28T19:32:18.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 Processor -- start 2023-11-28T19:32:18.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 -- start start 2023-11-28T19:32:18.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd341d2870 0x7fdd340bb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd340bb9f0 0x7fdd341e4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.753 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd341e4c70 0x7fdd341e50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd340bb060 con 0x7fdd340bb9f0 2023-11-28T19:32:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd340b8580 con 0x7fdd341d2870 2023-11-28T19:32:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd34149e20 con 0x7fdd341e4c70 2023-11-28T19:32:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd32ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd340bb9f0 0x7fdd341e4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd32ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd340bb9f0 0x7fdd341e4730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52390/0 (socket says 172.21.15.28:52390) 2023-11-28T19:32:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd32ffd640 1 -- 172.21.15.28:0/3263030036 learned_addr learned my addr 172.21.15.28:0/3263030036 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd337fe640 1 --2- 172.21.15.28:0/3263030036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd341d2870 0x7fdd340bb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd32ffd640 1 -- 172.21.15.28:0/3263030036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd341e4c70 msgr2=0x7fdd341e50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd33fff640 1 --2- 172.21.15.28:0/3263030036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd341e4c70 0x7fdd341e50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd32ffd640 1 --2- 172.21.15.28:0/3263030036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd341e4c70 0x7fdd341e50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd32ffd640 1 -- 172.21.15.28:0/3263030036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd341d2870 msgr2=0x7fdd340bb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd32ffd640 1 --2- 172.21.15.28:0/3263030036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd341d2870 0x7fdd340bb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.754 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd32ffd640 1 -- 172.21.15.28:0/3263030036 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd340b3320 con 0x7fdd340bb9f0 2023-11-28T19:32:18.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd32ffd640 1 --2- 172.21.15.28:0/3263030036 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd340bb9f0 0x7fdd341e4730 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdd280108c0 tx=0x7fdd28010d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:18.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd1bfff640 1 -- 172.21.15.28:0/3263030036 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd2800eb60 con 0x7fdd340bb9f0 2023-11-28T19:32:18.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd1bfff640 1 -- 172.21.15.28:0/3263030036 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd2800ecc0 con 0x7fdd340bb9f0 2023-11-28T19:32:18.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 -- 172.21.15.28:0/3263030036 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd3413a260 con 0x7fdd340bb9f0 2023-11-28T19:32:18.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd1bfff640 1 -- 172.21.15.28:0/3263030036 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd28010eb0 con 0x7fdd340bb9f0 2023-11-28T19:32:18.755 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.749+0000 7fdd3a094640 1 -- 172.21.15.28:0/3263030036 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd341d2c50 con 0x7fdd340bb9f0 2023-11-28T19:32:18.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.753+0000 7fdd3a094640 1 -- 172.21.15.28:0/3263030036 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd3413a450 con 0x7fdd340bb9f0 2023-11-28T19:32:18.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.753+0000 7fdd1bfff640 1 -- 172.21.15.28:0/3263030036 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdd2801c400 con 0x7fdd340bb9f0 2023-11-28T19:32:18.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.753+0000 7fdd1bfff640 1 --2- 172.21.15.28:0/3263030036 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdd20066470 0x7fdd20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:18.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.753+0000 7fdd1bfff640 1 -- 172.21.15.28:0/3263030036 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdd28083f50 con 0x7fdd340bb9f0 2023-11-28T19:32:18.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.753+0000 7fdd337fe640 1 --2- 172.21.15.28:0/3263030036 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdd20066470 0x7fdd20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:18.756 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.753+0000 7fdd337fe640 1 --2- 172.21.15.28:0/3263030036 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdd20066470 0x7fdd20068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd240b0000 tx=0x7fdd24009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:18.759 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.757+0000 7fdd1bfff640 1 -- 172.21.15.28:0/3263030036 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdd28051860 con 0x7fdd340bb9f0 2023-11-28T19:32:18.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.973+0000 7fdd3a094640 1 -- 172.21.15.28:0/3263030036 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fdd34074a90 con 0x7fdd340bb9f0 2023-11-28T19:32:18.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.977+0000 7fdd1bfff640 1 -- 172.21.15.28:0/3263030036 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fdd28054e80 con 0x7fdd340bb9f0 2023-11-28T19:32:18.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.977+0000 7fdd3a094640 1 -- 172.21.15.28:0/3263030036 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdd20066470 msgr2=0x7fdd20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.981 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.977+0000 7fdd3a094640 1 --2- 172.21.15.28:0/3263030036 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdd20066470 0x7fdd20068930 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fdd240b0000 tx=0x7fdd24009040 comp rx=0 tx=0).stop 2023-11-28T19:32:18.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.977+0000 7fdd3a094640 1 -- 172.21.15.28:0/3263030036 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd340bb9f0 msgr2=0x7fdd341e4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:18.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.977+0000 7fdd3a094640 1 --2- 172.21.15.28:0/3263030036 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd340bb9f0 0x7fdd341e4730 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdd280108c0 tx=0x7fdd28010d80 comp rx=0 tx=0).stop 2023-11-28T19:32:18.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.977+0000 7fdd3a094640 1 -- 172.21.15.28:0/3263030036 shutdown_connections 2023-11-28T19:32:18.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.977+0000 7fdd3a094640 1 --2- 172.21.15.28:0/3263030036 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdd20066470 0x7fdd20068930 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.977+0000 7fdd3a094640 1 --2- 172.21.15.28:0/3263030036 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdd341e4c70 0x7fdd341e50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.977+0000 7fdd3a094640 1 --2- 172.21.15.28:0/3263030036 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdd340bb9f0 0x7fdd341e4730 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.982 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.977+0000 7fdd3a094640 1 --2- 172.21.15.28:0/3263030036 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd341d2870 0x7fdd340bb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:18.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.977+0000 7fdd3a094640 1 -- 172.21.15.28:0/3263030036 >> 172.21.15.28:0/3263030036 conn(0x7fdd340bcb40 msgr2=0x7fdd3413ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:18.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.977+0000 7fdd3a094640 1 -- 172.21.15.28:0/3263030036 shutdown_connections 2023-11-28T19:32:18.983 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:18.977+0000 7fdd3a094640 1 -- 172.21.15.28:0/3263030036 wait complete. 2023-11-28T19:32:18.998 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-11-28T19:32:19.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a7c5e640 1 Processor -- start 2023-11-28T19:32:19.119 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a7c5e640 1 -- start start 2023-11-28T19:32:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a7c5e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd5a0070510 0x7fd5a00b99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a7c5e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd5a00bac10 0x7fd5a00b4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a7c5e640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5a0071110 con 0x7fd5a01481c0 2023-11-28T19:32:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a7c5e640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a0071e50 con 0x7fd5a0070510 2023-11-28T19:32:19.121 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a7c5e640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5a00ba780 con 0x7fd5a00bac10 2023-11-28T19:32:19.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a61fb640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fd5a01481c0 0x7fd5a0142100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:47998/0 (socket says 172.21.15.28:47998) 2023-11-28T19:32:19.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a61fb640 1 -- 172.21.15.28:0/3301852977 learned_addr learned my addr 172.21.15.28:0/3301852977 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:19.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a59fa640 1 --2- 172.21.15.28:0/3301852977 >> v2:172.21.15.28:3300/0 conn(0x7fd5a0070510 0x7fd5a00b99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a51f9640 1 --2- 172.21.15.28:0/3301852977 >> v2:172.21.15.131:3300/0 conn(0x7fd5a00bac10 0x7fd5a00b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a49f8640 1 -- 172.21.15.28:0/3301852977 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3795759500 0 0) 0x7fd5a0071110 con 0x7fd5a01481c0 2023-11-28T19:32:19.122 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a49f8640 1 -- 172.21.15.28:0/3301852977 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd58c003530 con 0x7fd5a01481c0 2023-11-28T19:32:19.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a59fa640 1 -- 172.21.15.28:0/3301852977 >> v2:172.21.15.131:3300/0 conn(0x7fd5a00bac10 msgr2=0x7fd5a00b4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:19.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a59fa640 1 --2- 172.21.15.28:0/3301852977 >> v2:172.21.15.131:3300/0 conn(0x7fd5a00bac10 0x7fd5a00b4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a59fa640 1 -- 172.21.15.28:0/3301852977 >> v1:172.21.15.28:6789/0 conn(0x7fd5a01481c0 legacy=0x7fd5a0142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.123 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.117+0000 7fd5a59fa640 1 -- 172.21.15.28:0/3301852977 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a0071360 con 0x7fd5a0070510 2023-11-28T19:32:19.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a59fa640 1 --2- 172.21.15.28:0/3301852977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5a0070510 0x7fd5a00b99a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00bb780 tx=0x7fd59c01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40444d8b076dd3b3 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:19.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a49f8640 1 -- 172.21.15.28:0/3301852977 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0a5850 con 0x7fd5a0070510 2023-11-28T19:32:19.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a49f8640 1 -- 172.21.15.28:0/3301852977 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59c0a59b0 con 0x7fd5a0070510 2023-11-28T19:32:19.128 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a49f8640 1 -- 172.21.15.28:0/3301852977 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59c0a5d20 con 0x7fd5a0070510 2023-11-28T19:32:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/3301852977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5a0070510 msgr2=0x7fd5a00b99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 --2- 172.21.15.28:0/3301852977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5a0070510 0x7fd5a00b99a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd5a00bb780 tx=0x7fd59c01c880 comp rx=0 tx=0).stop 2023-11-28T19:32:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/3301852977 shutdown_connections 2023-11-28T19:32:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 --2- 172.21.15.28:0/3301852977 >> v2:172.21.15.131:3300/0 conn(0x7fd5a00bac10 0x7fd5a00b4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 --2- 172.21.15.28:0/3301852977 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5a0070510 0x7fd5a00b99a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/3301852977 >> 172.21.15.28:0/3301852977 conn(0x7fd5a006e7a0 msgr2=0x7fd5a006b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/3301852977 shutdown_connections 2023-11-28T19:32:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/3301852977 wait complete. 2023-11-28T19:32:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 Processor -- start 2023-11-28T19:32:19.129 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 -- start start 2023-11-28T19:32:19.130 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5a0070510 0x7fd5a0138ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5a00bac10 0x7fd5a0137ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5a01481c0 0x7fd5a00b6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a00b5d40 con 0x7fd5a00bac10 2023-11-28T19:32:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a0136d60 con 0x7fd5a0070510 2023-11-28T19:32:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a7c5e640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a0136ff0 con 0x7fd5a01481c0 2023-11-28T19:32:19.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a51f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5a00bac10 0x7fd5a0137ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a51f9640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5a00bac10 0x7fd5a0137ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52414/0 (socket says 172.21.15.28:52414) 2023-11-28T19:32:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.121+0000 7fd5a51f9640 1 -- 172.21.15.28:0/509978806 learned_addr learned my addr 172.21.15.28:0/509978806 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5a59fa640 1 --2- 172.21.15.28:0/509978806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5a0070510 0x7fd5a0138ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5a61fb640 1 --2- 172.21.15.28:0/509978806 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5a01481c0 0x7fd5a00b6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5a51f9640 1 -- 172.21.15.28:0/509978806 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5a01481c0 msgr2=0x7fd5a00b6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5a51f9640 1 --2- 172.21.15.28:0/509978806 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5a01481c0 0x7fd5a00b6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5a51f9640 1 -- 172.21.15.28:0/509978806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5a0070510 msgr2=0x7fd5a0138ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5a51f9640 1 --2- 172.21.15.28:0/509978806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5a0070510 0x7fd5a0138ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5a51f9640 1 -- 172.21.15.28:0/509978806 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59c009a70 con 0x7fd5a00bac10 2023-11-28T19:32:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5a51f9640 1 --2- 172.21.15.28:0/509978806 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5a00bac10 0x7fd5a0137ca0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd59000d800 tx=0x7fd59000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5967fc640 1 -- 172.21.15.28:0/509978806 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000b6c0 con 0x7fd5a00bac10 2023-11-28T19:32:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5967fc640 1 -- 172.21.15.28:0/509978806 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd59000b820 con 0x7fd5a00bac10 2023-11-28T19:32:19.132 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5967fc640 1 -- 172.21.15.28:0/509978806 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd59000bb90 con 0x7fd5a00bac10 2023-11-28T19:32:19.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/509978806 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a01372d0 con 0x7fd5a00bac10 2023-11-28T19:32:19.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/509978806 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a01393e0 con 0x7fd5a00bac10 2023-11-28T19:32:19.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/509978806 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a0139600 con 0x7fd5a00bac10 2023-11-28T19:32:19.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5967fc640 1 -- 172.21.15.28:0/509978806 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd59000bcf0 con 0x7fd5a00bac10 2023-11-28T19:32:19.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5967fc640 1 --2- 172.21.15.28:0/509978806 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd584066470 0x7fd584068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5967fc640 1 -- 172.21.15.28:0/509978806 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd590083fc0 con 0x7fd5a00bac10 2023-11-28T19:32:19.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5a59fa640 1 --2- 172.21.15.28:0/509978806 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd584066470 0x7fd584068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.125+0000 7fd5a59fa640 1 --2- 172.21.15.28:0/509978806 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd584066470 0x7fd584068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0af000 tx=0x7fd59c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:19.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.129+0000 7fd5967fc640 1 -- 172.21.15.28:0/509978806 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd5900b5280 con 0x7fd5a00bac10 2023-11-28T19:32:19.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.345+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/509978806 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fd5a0074a90 con 0x7fd5a00bac10 2023-11-28T19:32:19.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.349+0000 7fd5967fc640 1 -- 172.21.15.28:0/509978806 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd5900552b0 con 0x7fd5a00bac10 2023-11-28T19:32:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.353+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/509978806 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd584066470 msgr2=0x7fd584068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.353+0000 7fd5a7c5e640 1 --2- 172.21.15.28:0/509978806 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd584066470 0x7fd584068930 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fd59c0af000 tx=0x7fd59c0a7070 comp rx=0 tx=0).stop 2023-11-28T19:32:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.353+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/509978806 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5a00bac10 msgr2=0x7fd5a0137ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.353+0000 7fd5a7c5e640 1 --2- 172.21.15.28:0/509978806 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5a00bac10 0x7fd5a0137ca0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd59000d800 tx=0x7fd59000dcc0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.353+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/509978806 shutdown_connections 2023-11-28T19:32:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.353+0000 7fd5a7c5e640 1 --2- 172.21.15.28:0/509978806 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd584066470 0x7fd584068930 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.353+0000 7fd5a7c5e640 1 --2- 172.21.15.28:0/509978806 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd5a01481c0 0x7fd5a00b6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.353+0000 7fd5a7c5e640 1 --2- 172.21.15.28:0/509978806 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd5a00bac10 0x7fd5a0137ca0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.353+0000 7fd5a7c5e640 1 --2- 172.21.15.28:0/509978806 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5a0070510 0x7fd5a0138ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.353+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/509978806 >> 172.21.15.28:0/509978806 conn(0x7fd5a006e7a0 msgr2=0x7fd5a00bbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.353+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/509978806 shutdown_connections 2023-11-28T19:32:19.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.353+0000 7fd5a7c5e640 1 -- 172.21.15.28:0/509978806 wait complete. 2023-11-28T19:32:19.373 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-11-28T19:32:19.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.497+0000 7f89bf41b640 1 Processor -- start 2023-11-28T19:32:19.502 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bf41b640 1 -- start start 2023-11-28T19:32:19.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bf41b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f89b8142560 0x7f89b80b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.503 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bf41b640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f89b80b5dd0 0x7f89b80b4610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bf41b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89b80b6470 0x7f89b80b6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bf41b640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b806f950 con 0x7f89b80b5dd0 2023-11-28T19:32:19.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bf41b640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b8142940 con 0x7f89b8142560 2023-11-28T19:32:19.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bf41b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b814bb40 con 0x7f89b80b6470 2023-11-28T19:32:19.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bc9b6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f89b80b5dd0 0x7f89b80b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bc9b6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f89b80b5dd0 0x7f89b80b4610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52428/0 (socket says 172.21.15.28:52428) 2023-11-28T19:32:19.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bc9b6640 1 -- 172.21.15.28:0/1220713859 learned_addr learned my addr 172.21.15.28:0/1220713859 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:19.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bd1b7640 1 --2- 172.21.15.28:0/1220713859 >> v2:172.21.15.131:3300/0 conn(0x7f89b8142560 0x7f89b80b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bd9b8640 1 --2- 172.21.15.28:0/1220713859 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89b80b6470 0x7f89b80b6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bc9b6640 1 -- 172.21.15.28:0/1220713859 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89b80b6470 msgr2=0x7f89b80b6900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:19.504 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bc9b6640 1 --2- 172.21.15.28:0/1220713859 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89b80b6470 0x7f89b80b6900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.505 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bc9b6640 1 -- 172.21.15.28:0/1220713859 >> v2:172.21.15.131:3300/0 conn(0x7f89b8142560 msgr2=0x7f89b80b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:19.505 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bc9b6640 1 --2- 172.21.15.28:0/1220713859 >> v2:172.21.15.131:3300/0 conn(0x7f89b8142560 0x7f89b80b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.505 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.501+0000 7f89bc9b6640 1 -- 172.21.15.28:0/1220713859 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b814be20 con 0x7f89b80b5dd0 2023-11-28T19:32:19.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bc9b6640 1 --2- 172.21.15.28:0/1220713859 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b80b5dd0 0x7f89b80b4610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f89b806cd30 tx=0x7f89a80213c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b3dc9a67e45ca server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:19.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89affff640 1 -- 172.21.15.28:0/1220713859 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80b1600 con 0x7f89b80b5dd0 2023-11-28T19:32:19.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89affff640 1 -- 172.21.15.28:0/1220713859 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a80ad050 con 0x7f89b80b5dd0 2023-11-28T19:32:19.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89affff640 1 -- 172.21.15.28:0/1220713859 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a80b1980 con 0x7f89b80b5dd0 2023-11-28T19:32:19.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 -- 172.21.15.28:0/1220713859 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b80b5dd0 msgr2=0x7f89b80b4610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 --2- 172.21.15.28:0/1220713859 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b80b5dd0 0x7f89b80b4610 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f89b806cd30 tx=0x7f89a80213c0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 -- 172.21.15.28:0/1220713859 shutdown_connections 2023-11-28T19:32:19.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 --2- 172.21.15.28:0/1220713859 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89b80b6470 0x7f89b80b6900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 --2- 172.21.15.28:0/1220713859 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b80b5dd0 0x7f89b80b4610 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 --2- 172.21.15.28:0/1220713859 >> v2:172.21.15.131:3300/0 conn(0x7f89b8142560 0x7f89b80b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 -- 172.21.15.28:0/1220713859 >> 172.21.15.28:0/1220713859 conn(0x7f89b80bcb40 msgr2=0x7f89b80bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:19.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 -- 172.21.15.28:0/1220713859 shutdown_connections 2023-11-28T19:32:19.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 -- 172.21.15.28:0/1220713859 wait complete. 2023-11-28T19:32:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 Processor -- start 2023-11-28T19:32:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 -- start start 2023-11-28T19:32:19.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b80b5dd0 0x7f89b80bb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89b80b6470 0x7f89b8072220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89b8142560 0x7f89b8140070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b80bba70 con 0x7f89b80b5dd0 2023-11-28T19:32:19.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b81411d0 con 0x7f89b80b6470 2023-11-28T19:32:19.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bf41b640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8141d10 con 0x7f89b8142560 2023-11-28T19:32:19.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bd1b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b80b5dd0 0x7f89b80bb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bd1b7640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b80b5dd0 0x7f89b80bb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52444/0 (socket says 172.21.15.28:52444) 2023-11-28T19:32:19.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bd1b7640 1 -- 172.21.15.28:0/962931897 learned_addr learned my addr 172.21.15.28:0/962931897 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:19.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bd9b8640 1 --2- 172.21.15.28:0/962931897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89b8142560 0x7f89b8140070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bc9b6640 1 --2- 172.21.15.28:0/962931897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89b80b6470 0x7f89b8072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bd1b7640 1 -- 172.21.15.28:0/962931897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89b8142560 msgr2=0x7f89b8140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bd1b7640 1 --2- 172.21.15.28:0/962931897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89b8142560 0x7f89b8140070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bd1b7640 1 -- 172.21.15.28:0/962931897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89b80b6470 msgr2=0x7f89b8072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bd1b7640 1 --2- 172.21.15.28:0/962931897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89b80b6470 0x7f89b8072220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.505+0000 7f89bd1b7640 1 -- 172.21.15.28:0/962931897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a800b770 con 0x7f89b80b5dd0 2023-11-28T19:32:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.509+0000 7f89bd1b7640 1 --2- 172.21.15.28:0/962931897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b80b5dd0 0x7f89b80bb530 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f89b400d5f0 tx=0x7f89b400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.509+0000 7f89adffb640 1 -- 172.21.15.28:0/962931897 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b40125f0 con 0x7f89b80b5dd0 2023-11-28T19:32:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.509+0000 7f89adffb640 1 -- 172.21.15.28:0/962931897 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b4012750 con 0x7f89b80b5dd0 2023-11-28T19:32:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.509+0000 7f89bf41b640 1 -- 172.21.15.28:0/962931897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b81413e0 con 0x7f89b80b5dd0 2023-11-28T19:32:19.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.509+0000 7f89adffb640 1 -- 172.21.15.28:0/962931897 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4012ae0 con 0x7f89b80b5dd0 2023-11-28T19:32:19.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.509+0000 7f89bf41b640 1 -- 172.21.15.28:0/962931897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b8141770 con 0x7f89b80b5dd0 2023-11-28T19:32:19.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.509+0000 7f89bf41b640 1 -- 172.21.15.28:0/962931897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b80b9220 con 0x7f89b80b5dd0 2023-11-28T19:32:19.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.509+0000 7f89adffb640 1 -- 172.21.15.28:0/962931897 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f89b4012c40 con 0x7f89b80b5dd0 2023-11-28T19:32:19.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.509+0000 7f89adffb640 1 --2- 172.21.15.28:0/962931897 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f899c066470 0x7f899c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.509+0000 7f89adffb640 1 -- 172.21.15.28:0/962931897 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f89b4084040 con 0x7f89b80b5dd0 2023-11-28T19:32:19.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.509+0000 7f89bc9b6640 1 --2- 172.21.15.28:0/962931897 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f899c066470 0x7f899c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.509+0000 7f89bc9b6640 1 --2- 172.21.15.28:0/962931897 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f899c066470 0x7f899c068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f89a80b3000 tx=0x7f89a80ac000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:19.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.513+0000 7f89adffb640 1 -- 172.21.15.28:0/962931897 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f89b40b5280 con 0x7f89b80b5dd0 2023-11-28T19:32:19.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.725+0000 7f89bf41b640 1 -- 172.21.15.28:0/962931897 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f89b813e750 con 0x7f89b80b5dd0 2023-11-28T19:32:19.733 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.729+0000 7f89adffb640 1 -- 172.21.15.28:0/962931897 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f89b4051800 con 0x7f89b80b5dd0 2023-11-28T19:32:19.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.733+0000 7f89bf41b640 1 -- 172.21.15.28:0/962931897 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f899c066470 msgr2=0x7f899c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.733+0000 7f89bf41b640 1 --2- 172.21.15.28:0/962931897 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f899c066470 0x7f899c068930 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f89a80b3000 tx=0x7f89a80ac000 comp rx=0 tx=0).stop 2023-11-28T19:32:19.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.733+0000 7f89bf41b640 1 -- 172.21.15.28:0/962931897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b80b5dd0 msgr2=0x7f89b80bb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.733+0000 7f89bf41b640 1 --2- 172.21.15.28:0/962931897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b80b5dd0 0x7f89b80bb530 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f89b400d5f0 tx=0x7f89b400dab0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.733+0000 7f89bf41b640 1 -- 172.21.15.28:0/962931897 shutdown_connections 2023-11-28T19:32:19.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.733+0000 7f89bf41b640 1 --2- 172.21.15.28:0/962931897 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f899c066470 0x7f899c068930 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.733+0000 7f89bf41b640 1 --2- 172.21.15.28:0/962931897 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f89b8142560 0x7f89b8140070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.737 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.733+0000 7f89bf41b640 1 --2- 172.21.15.28:0/962931897 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f89b80b6470 0x7f89b8072220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.733+0000 7f89bf41b640 1 --2- 172.21.15.28:0/962931897 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f89b80b5dd0 0x7f89b80bb530 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.733+0000 7f89bf41b640 1 -- 172.21.15.28:0/962931897 >> 172.21.15.28:0/962931897 conn(0x7f89b80bcb40 msgr2=0x7f89b80b8150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:19.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.733+0000 7f89bf41b640 1 -- 172.21.15.28:0/962931897 shutdown_connections 2023-11-28T19:32:19.738 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.733+0000 7f89bf41b640 1 -- 172.21.15.28:0/962931897 wait complete. 2023-11-28T19:32:19.754 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:32:19.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.873+0000 7f10f1f7c640 1 Processor -- start 2023-11-28T19:32:19.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.873+0000 7f10f1f7c640 1 -- start start 2023-11-28T19:32:19.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.873+0000 7f10f1f7c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10ec072870 0x7f10ec14b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.873+0000 7f10f1f7c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec0b6a30 con 0x7f10ec14bec0 2023-11-28T19:32:19.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.873+0000 7f10f1f7c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10ec0b50a0 con 0x7f10ec072490 2023-11-28T19:32:19.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.873+0000 7f10f1f7c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec0b4c00 con 0x7f10ec072870 2023-11-28T19:32:19.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.873+0000 7f10ebfff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f10ec14bec0 0x7f10ec155e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48014/0 (socket says 172.21.15.28:48014) 2023-11-28T19:32:19.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.873+0000 7f10ebfff640 1 -- 172.21.15.28:0/532380757 learned_addr learned my addr 172.21.15.28:0/532380757 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:19.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.873+0000 7f10eaffd640 1 --2- 172.21.15.28:0/532380757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10ec072870 0x7f10ec14b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.873+0000 7f10ea7fc640 1 -- 172.21.15.28:0/532380757 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2562094607 0 0) 0x7f10e4001120 con 0x7f10ec14bec0 2023-11-28T19:32:19.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.873+0000 7f10ea7fc640 1 -- 172.21.15.28:0/532380757 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10d8003530 con 0x7f10ec14bec0 2023-11-28T19:32:19.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.873+0000 7f10eaffd640 1 -- 172.21.15.28:0/532380757 >> v1:172.21.15.131:6789/0 conn(0x7f10ec072490 legacy=0x7f10ec0b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.873+0000 7f10eaffd640 1 -- 172.21.15.28:0/532380757 >> v1:172.21.15.28:6789/0 conn(0x7f10ec14bec0 legacy=0x7f10ec155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.873+0000 7f10eaffd640 1 -- 172.21.15.28:0/532380757 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec14c350 con 0x7f10ec072870 2023-11-28T19:32:19.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.877+0000 7f10eaffd640 1 --2- 172.21.15.28:0/532380757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10ec072870 0x7f10ec14b980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009dc0 tx=0x7f10dc01c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2bbc33e5f3512b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:19.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.877+0000 7f10ea7fc640 1 -- 172.21.15.28:0/532380757 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc0a5920 con 0x7f10ec072870 2023-11-28T19:32:19.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.877+0000 7f10ea7fc640 1 -- 172.21.15.28:0/532380757 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc0a5a80 con 0x7f10ec072870 2023-11-28T19:32:19.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.877+0000 7f10ea7fc640 1 -- 172.21.15.28:0/532380757 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc0a5e10 con 0x7f10ec072870 2023-11-28T19:32:19.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.877+0000 7f10f1f7c640 1 -- 172.21.15.28:0/532380757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10ec072870 msgr2=0x7f10ec14b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.877+0000 7f10f1f7c640 1 --2- 172.21.15.28:0/532380757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10ec072870 0x7f10ec14b980 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f10dc009dc0 tx=0x7f10dc01c970 comp rx=0 tx=0).stop 2023-11-28T19:32:19.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.877+0000 7f10f1f7c640 1 -- 172.21.15.28:0/532380757 shutdown_connections 2023-11-28T19:32:19.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.877+0000 7f10f1f7c640 1 --2- 172.21.15.28:0/532380757 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10ec072870 0x7f10ec14b980 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.877+0000 7f10f1f7c640 1 -- 172.21.15.28:0/532380757 >> 172.21.15.28:0/532380757 conn(0x7f10ec0bcb40 msgr2=0x7f10ec0bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:19.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.877+0000 7f10f1f7c640 1 -- 172.21.15.28:0/532380757 shutdown_connections 2023-11-28T19:32:19.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.877+0000 7f10f1f7c640 1 -- 172.21.15.28:0/532380757 wait complete. 2023-11-28T19:32:19.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10f1f7c640 1 Processor -- start 2023-11-28T19:32:19.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10f1f7c640 1 -- start start 2023-11-28T19:32:19.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10f1f7c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10ec072490 0x7f10ec1e3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10f1f7c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10ec072870 0x7f10ec1e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10f1f7c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10ec14bec0 0x7f10ec13e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10f1f7c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec1e7050 con 0x7f10ec072870 2023-11-28T19:32:19.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10f1f7c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec13e800 con 0x7f10ec072490 2023-11-28T19:32:19.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10f1f7c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec070f10 con 0x7f10ec14bec0 2023-11-28T19:32:19.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10eaffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10ec072870 0x7f10ec1e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10eaffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10ec072870 0x7f10ec1e7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52448/0 (socket says 172.21.15.28:52448) 2023-11-28T19:32:19.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10eaffd640 1 -- 172.21.15.28:0/191858046 learned_addr learned my addr 172.21.15.28:0/191858046 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:19.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10eb7fe640 1 --2- 172.21.15.28:0/191858046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10ec072490 0x7f10ec1e3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10ebfff640 1 --2- 172.21.15.28:0/191858046 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10ec14bec0 0x7f10ec13e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10eaffd640 1 -- 172.21.15.28:0/191858046 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10ec14bec0 msgr2=0x7f10ec13e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10eaffd640 1 --2- 172.21.15.28:0/191858046 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10ec14bec0 0x7f10ec13e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.888 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10eaffd640 1 -- 172.21.15.28:0/191858046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10ec072490 msgr2=0x7f10ec1e3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:19.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10eaffd640 1 --2- 172.21.15.28:0/191858046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10ec072490 0x7f10ec1e3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:19.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10eaffd640 1 -- 172.21.15.28:0/191858046 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc009a70 con 0x7f10ec072870 2023-11-28T19:32:19.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10eaffd640 1 --2- 172.21.15.28:0/191858046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10ec072870 0x7f10ec1e7aa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0b0040 tx=0x7f10dc019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:19.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10e3fff640 1 -- 172.21.15.28:0/191858046 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc0ad850 con 0x7f10ec072870 2023-11-28T19:32:19.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10e3fff640 1 -- 172.21.15.28:0/191858046 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10dc0ad9d0 con 0x7f10ec072870 2023-11-28T19:32:19.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10f1f7c640 1 -- 172.21.15.28:0/191858046 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec0711f0 con 0x7f10ec072870 2023-11-28T19:32:19.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10e3fff640 1 -- 172.21.15.28:0/191858046 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10dc0add80 con 0x7f10ec072870 2023-11-28T19:32:19.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10f1f7c640 1 -- 172.21.15.28:0/191858046 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec1e7580 con 0x7f10ec072870 2023-11-28T19:32:19.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10f1f7c640 1 -- 172.21.15.28:0/191858046 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ec071380 con 0x7f10ec072870 2023-11-28T19:32:19.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10e3fff640 1 -- 172.21.15.28:0/191858046 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f10dc0b4050 con 0x7f10ec072870 2023-11-28T19:32:19.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.881+0000 7f10e3fff640 1 --2- 172.21.15.28:0/191858046 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f10cc066470 0x7f10cc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:19.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.885+0000 7f10e3fff640 1 -- 172.21.15.28:0/191858046 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f10dc11ea60 con 0x7f10ec072870 2023-11-28T19:32:19.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.885+0000 7f10eb7fe640 1 --2- 172.21.15.28:0/191858046 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f10cc066470 0x7f10cc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:19.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.885+0000 7f10eb7fe640 1 --2- 172.21.15.28:0/191858046 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f10cc066470 0x7f10cc068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10d4001650 tx=0x7f10d4009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:19.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:19.889+0000 7f10e3fff640 1 -- 172.21.15.28:0/191858046 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10dc0ec220 con 0x7f10ec072870 2023-11-28T19:32:20.047 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.045+0000 7f10f1f7c640 1 -- 172.21.15.28:0/191858046 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10ec074a90 con 0x7f10ec072870 2023-11-28T19:32:20.048 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.045+0000 7f10e3fff640 1 -- 172.21.15.28:0/191858046 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12857 (secure 0 0 0) 0x7f10dc0ef840 con 0x7f10ec072870 2023-11-28T19:32:20.048 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:20.048 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":28,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:32:17.099363+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:32:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.049+0000 7f10f1f7c640 1 -- 172.21.15.28:0/191858046 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f10cc066470 msgr2=0x7f10cc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.049+0000 7f10f1f7c640 1 --2- 172.21.15.28:0/191858046 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f10cc066470 0x7f10cc068930 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f10d4001650 tx=0x7f10d4009040 comp rx=0 tx=0).stop 2023-11-28T19:32:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.049+0000 7f10f1f7c640 1 -- 172.21.15.28:0/191858046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10ec072870 msgr2=0x7f10ec1e7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.049+0000 7f10f1f7c640 1 --2- 172.21.15.28:0/191858046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10ec072870 0x7f10ec1e7aa0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f10dc0b0040 tx=0x7f10dc019710 comp rx=0 tx=0).stop 2023-11-28T19:32:20.050 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.049+0000 7f10f1f7c640 1 -- 172.21.15.28:0/191858046 shutdown_connections 2023-11-28T19:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.049+0000 7f10f1f7c640 1 --2- 172.21.15.28:0/191858046 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f10cc066470 0x7f10cc068930 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.049+0000 7f10f1f7c640 1 --2- 172.21.15.28:0/191858046 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10ec14bec0 0x7f10ec13e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.049+0000 7f10f1f7c640 1 --2- 172.21.15.28:0/191858046 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10ec072870 0x7f10ec1e7aa0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.049+0000 7f10f1f7c640 1 --2- 172.21.15.28:0/191858046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10ec072490 0x7f10ec1e3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.049+0000 7f10f1f7c640 1 -- 172.21.15.28:0/191858046 >> 172.21.15.28:0/191858046 conn(0x7f10ec0bcb40 msgr2=0x7f10ec14aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.049+0000 7f10f1f7c640 1 -- 172.21.15.28:0/191858046 shutdown_connections 2023-11-28T19:32:20.051 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.049+0000 7f10f1f7c640 1 -- 172.21.15.28:0/191858046 wait complete. 2023-11-28T19:32:20.067 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-11-28T19:31:33.212362+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-11-28T19:32:20.068 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-11-28T19:32:20.197 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.193+0000 7f9a39e2c640 1 Processor -- start 2023-11-28T19:32:20.198 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.193+0000 7f9a39e2c640 1 -- start start 2023-11-28T19:32:20.201 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a39e2c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a340bc120 0x7f9a340bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a39e2c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9a34072940 0x7f9a34153c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a39e2c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a34143b60 con 0x7f9a340a2d60 2023-11-28T19:32:20.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a39e2c640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a340b6f30 con 0x7f9a34072940 2023-11-28T19:32:20.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a39e2c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340b7aa0 con 0x7f9a340bc120 2023-11-28T19:32:20.202 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a32ffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f9a340a2d60 0x7f9a3414c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48018/0 (socket says 172.21.15.28:48018) 2023-11-28T19:32:20.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a32ffd640 1 -- 172.21.15.28:0/1718869803 learned_addr learned my addr 172.21.15.28:0/1718869803 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:20.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a337fe640 1 --2- 172.21.15.28:0/1718869803 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a340bc120 0x7f9a340bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 -- 172.21.15.28:0/1718869803 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1111925893 0 0) 0x7f9a34143b60 con 0x7f9a340a2d60 2023-11-28T19:32:20.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 -- 172.21.15.28:0/1718869803 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a1c003530 con 0x7f9a340a2d60 2023-11-28T19:32:20.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a33fff640 1 --2- 172.21.15.28:0/1718869803 >> v2:172.21.15.131:3300/0 conn(0x7f9a34072940 0x7f9a34153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 -- 172.21.15.28:0/1718869803 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3842885121 0 0) 0x7f9a1c003530 con 0x7f9a340a2d60 2023-11-28T19:32:20.203 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 -- 172.21.15.28:0/1718869803 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a340bc120 msgr2=0x7f9a340bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:20.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 --2- 172.21.15.28:0/1718869803 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a340bc120 0x7f9a340bd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 -- 172.21.15.28:0/1718869803 >> v2:172.21.15.131:3300/0 conn(0x7f9a34072940 msgr2=0x7f9a34153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:20.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 --2- 172.21.15.28:0/1718869803 >> v2:172.21.15.131:3300/0 conn(0x7f9a34072940 0x7f9a34153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 -- 172.21.15.28:0/1718869803 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a340b7d60 con 0x7f9a340a2d60 2023-11-28T19:32:20.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 -- 172.21.15.28:0/1718869803 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f9a28001680 con 0x7f9a340a2d60 2023-11-28T19:32:20.204 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 -- 172.21.15.28:0/1718869803 >> v1:172.21.15.28:6789/0 conn(0x7f9a340a2d60 legacy=0x7f9a3414c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 --2- 172.21.15.28:0/1718869803 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a340bc120 0x7f9a1c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 --2- 172.21.15.28:0/1718869803 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a1c003f00 0x7f9a1c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 --2- 172.21.15.28:0/1718869803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a1c004d10 0x7f9a1c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 -- 172.21.15.28:0/1718869803 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340b6f30 con 0x7f9a1c003f00 2023-11-28T19:32:20.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 -- 172.21.15.28:0/1718869803 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a340b7aa0 con 0x7f9a1c004d10 2023-11-28T19:32:20.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a327fc640 1 -- 172.21.15.28:0/1718869803 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1c00b9c0 con 0x7f9a340bc120 2023-11-28T19:32:20.205 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a32ffd640 1 --2- 172.21.15.28:0/1718869803 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a1c003f00 0x7f9a1c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a337fe640 1 --2- 172.21.15.28:0/1718869803 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a340bc120 0x7f9a1c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a33fff640 1 --2- 172.21.15.28:0/1718869803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a1c004d10 0x7f9a1c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a32ffd640 1 -- 172.21.15.28:0/1718869803 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a340bc120 msgr2=0x7f9a1c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:20.206 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a32ffd640 1 --2- 172.21.15.28:0/1718869803 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a340bc120 0x7f9a1c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a32ffd640 1 -- 172.21.15.28:0/1718869803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a1c004d10 msgr2=0x7f9a1c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:20.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a32ffd640 1 --2- 172.21.15.28:0/1718869803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a1c004d10 0x7f9a1c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a32ffd640 1 -- 172.21.15.28:0/1718869803 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a1c003530 con 0x7f9a1c003f00 2023-11-28T19:32:20.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.197+0000 7f9a33fff640 1 --2- 172.21.15.28:0/1718869803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a1c004d10 0x7f9a1c005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:20.208 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a32ffd640 1 --2- 172.21.15.28:0/1718869803 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a1c003f00 0x7f9a1c0047d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800c240 tx=0x7f9a2801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f684a76c24087838 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:20.214 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a327fc640 1 -- 172.21.15.28:0/1718869803 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280a5960 con 0x7f9a1c003f00 2023-11-28T19:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a327fc640 1 -- 172.21.15.28:0/1718869803 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a280a5ac0 con 0x7f9a1c003f00 2023-11-28T19:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a327fc640 1 -- 172.21.15.28:0/1718869803 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a280058e0 con 0x7f9a1c003f00 2023-11-28T19:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 -- 172.21.15.28:0/1718869803 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a1c003f00 msgr2=0x7f9a1c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 --2- 172.21.15.28:0/1718869803 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a1c003f00 0x7f9a1c0047d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800c240 tx=0x7f9a2801cc60 comp rx=0 tx=0).stop 2023-11-28T19:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a33fff640 1 -- 172.21.15.28:0/1718869803 reap_dead start 2023-11-28T19:32:20.215 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 -- 172.21.15.28:0/1718869803 shutdown_connections 2023-11-28T19:32:20.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 -- 172.21.15.28:0/1718869803 >> 172.21.15.28:0/1718869803 conn(0x7f9a3406ab80 msgr2=0x7f9a340bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:20.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 -- 172.21.15.28:0/1718869803 shutdown_connections 2023-11-28T19:32:20.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 -- 172.21.15.28:0/1718869803 wait complete. 2023-11-28T19:32:20.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 Processor -- start 2023-11-28T19:32:20.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 -- start start 2023-11-28T19:32:20.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a1c003f00 0x7f9a3413e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a34146630 0x7f9a341e1a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a341e1f40 0x7f9a34139a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.217 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34145000 con 0x7f9a1c003f00 2023-11-28T19:32:20.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3413eb70 con 0x7f9a34146630 2023-11-28T19:32:20.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a341449b0 con 0x7f9a341e1f40 2023-11-28T19:32:20.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a337fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a1c003f00 0x7f9a3413e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a337fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a1c003f00 0x7f9a3413e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52466/0 (socket says 172.21.15.28:52466) 2023-11-28T19:32:20.218 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a337fe640 1 -- 172.21.15.28:0/3235571512 learned_addr learned my addr 172.21.15.28:0/3235571512 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:20.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a33fff640 1 --2- 172.21.15.28:0/3235571512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a341e1f40 0x7f9a34139a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a32ffd640 1 --2- 172.21.15.28:0/3235571512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a34146630 0x7f9a341e1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a337fe640 1 -- 172.21.15.28:0/3235571512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a341e1f40 msgr2=0x7f9a34139a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a337fe640 1 --2- 172.21.15.28:0/3235571512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a341e1f40 0x7f9a34139a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a337fe640 1 -- 172.21.15.28:0/3235571512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a34146630 msgr2=0x7f9a341e1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a337fe640 1 --2- 172.21.15.28:0/3235571512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a34146630 0x7f9a341e1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a337fe640 1 -- 172.21.15.28:0/3235571512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a341e23c0 con 0x7f9a1c003f00 2023-11-28T19:32:20.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a337fe640 1 --2- 172.21.15.28:0/3235571512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a1c003f00 0x7f9a3413e630 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9a240115e0 tx=0x7f9a24011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:20.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a1bfff640 1 -- 172.21.15.28:0/3235571512 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24015870 con 0x7f9a1c003f00 2023-11-28T19:32:20.219 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a1bfff640 1 -- 172.21.15.28:0/3235571512 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a240159d0 con 0x7f9a1c003f00 2023-11-28T19:32:20.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 -- 172.21.15.28:0/3235571512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a34144080 con 0x7f9a1c003f00 2023-11-28T19:32:20.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a1bfff640 1 -- 172.21.15.28:0/3235571512 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a24015d40 con 0x7f9a1c003f00 2023-11-28T19:32:20.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.201+0000 7f9a39e2c640 1 -- 172.21.15.28:0/3235571512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a34144640 con 0x7f9a1c003f00 2023-11-28T19:32:20.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.205+0000 7f9a39e2c640 1 -- 172.21.15.28:0/3235571512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a34067a20 con 0x7f9a1c003f00 2023-11-28T19:32:20.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.205+0000 7f9a1bfff640 1 -- 172.21.15.28:0/3235571512 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f9a2400f460 con 0x7f9a1c003f00 2023-11-28T19:32:20.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.205+0000 7f9a1bfff640 1 --2- 172.21.15.28:0/3235571512 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9a20066470 0x7f9a20068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.205+0000 7f9a1bfff640 1 -- 172.21.15.28:0/3235571512 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9a24083ed0 con 0x7f9a1c003f00 2023-11-28T19:32:20.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.205+0000 7f9a32ffd640 1 --2- 172.21.15.28:0/3235571512 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9a20066470 0x7f9a20068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.205+0000 7f9a32ffd640 1 --2- 172.21.15.28:0/3235571512 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9a20066470 0x7f9a20068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9a280aa000 tx=0x7f9a28001a80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:20.220 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.209+0000 7f9a1bfff640 1 -- 172.21.15.28:0/3235571512 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f9a240516a0 con 0x7f9a1c003f00 2023-11-28T19:32:20.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.365+0000 7f9a39e2c640 1 -- 172.21.15.28:0/3235571512 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a34146b70 con 0x7f9a1c003f00 2023-11-28T19:32:20.368 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.365+0000 7f9a1bfff640 1 -- 172.21.15.28:0/3235571512 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a240220a0 con 0x7f9a1c003f00 2023-11-28T19:32:20.368 INFO:teuthology.orchestra.run.smithi028.stdout:pg_num: 1 2023-11-28T19:32:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.369+0000 7f9a39e2c640 1 -- 172.21.15.28:0/3235571512 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9a20066470 msgr2=0x7f9a20068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.369+0000 7f9a39e2c640 1 --2- 172.21.15.28:0/3235571512 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9a20066470 0x7f9a20068930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9a280aa000 tx=0x7f9a28001a80 comp rx=0 tx=0).stop 2023-11-28T19:32:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.369+0000 7f9a39e2c640 1 -- 172.21.15.28:0/3235571512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a1c003f00 msgr2=0x7f9a3413e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.369+0000 7f9a39e2c640 1 --2- 172.21.15.28:0/3235571512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a1c003f00 0x7f9a3413e630 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9a240115e0 tx=0x7f9a24011aa0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.369+0000 7f9a39e2c640 1 -- 172.21.15.28:0/3235571512 shutdown_connections 2023-11-28T19:32:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.369+0000 7f9a39e2c640 1 --2- 172.21.15.28:0/3235571512 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f9a20066470 0x7f9a20068930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.369+0000 7f9a39e2c640 1 --2- 172.21.15.28:0/3235571512 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f9a341e1f40 0x7f9a34139a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.369+0000 7f9a39e2c640 1 --2- 172.21.15.28:0/3235571512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9a34146630 0x7f9a341e1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.369+0000 7f9a39e2c640 1 --2- 172.21.15.28:0/3235571512 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f9a1c003f00 0x7f9a3413e630 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.371 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.369+0000 7f9a39e2c640 1 -- 172.21.15.28:0/3235571512 >> 172.21.15.28:0/3235571512 conn(0x7f9a3406ab80 msgr2=0x7f9a340b9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:20.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.369+0000 7f9a39e2c640 1 -- 172.21.15.28:0/3235571512 shutdown_connections 2023-11-28T19:32:20.372 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.369+0000 7f9a39e2c640 1 -- 172.21.15.28:0/3235571512 wait complete. 2023-11-28T19:32:20.388 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-11-28T19:32:20.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.505+0000 7efc78a83640 1 Processor -- start 2023-11-28T19:32:20.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.505+0000 7efc78a83640 1 -- start start 2023-11-28T19:32:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.505+0000 7efc78a83640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efc7406ab60 0x7efc7414b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.505+0000 7efc78a83640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc740bce60 con 0x7efc7406af40 2023-11-28T19:32:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.505+0000 7efc78a83640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc740a6b70 con 0x7efc740bbad0 2023-11-28T19:32:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.505+0000 7efc78a83640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc740bd5d0 con 0x7efc7406ab60 2023-11-28T19:32:20.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.505+0000 7efc7259c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7efc7406ab60 0x7efc7414b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.505+0000 7efc72d9d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7efc7406af40 0x7efc74155e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48034/0 (socket says 172.21.15.28:48034) 2023-11-28T19:32:20.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.505+0000 7efc72d9d640 1 -- 172.21.15.28:0/2857595132 learned_addr learned my addr 172.21.15.28:0/2857595132 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:20.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.505+0000 7efc7259c640 1 -- 172.21.15.28:0/2857595132 >> v1:172.21.15.131:6789/0 conn(0x7efc740bbad0 legacy=0x7efc740a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:20.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.505+0000 7efc7259c640 1 -- 172.21.15.28:0/2857595132 >> v1:172.21.15.28:6789/0 conn(0x7efc7406af40 legacy=0x7efc74155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.505+0000 7efc7259c640 1 -- 172.21.15.28:0/2857595132 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc740bff70 con 0x7efc7406ab60 2023-11-28T19:32:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc7259c640 1 --2- 172.21.15.28:0/2857595132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7406ab60 0x7efc7414b5f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efc640097c0 tx=0x7efc6401c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f46537a070d393d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc7159a640 1 -- 172.21.15.28:0/2857595132 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640ab600 con 0x7efc7406ab60 2023-11-28T19:32:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc7159a640 1 -- 172.21.15.28:0/2857595132 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc640a7050 con 0x7efc7406ab60 2023-11-28T19:32:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc7159a640 1 -- 172.21.15.28:0/2857595132 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640ab980 con 0x7efc7406ab60 2023-11-28T19:32:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 -- 172.21.15.28:0/2857595132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7406ab60 msgr2=0x7efc7414b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 --2- 172.21.15.28:0/2857595132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7406ab60 0x7efc7414b5f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7efc640097c0 tx=0x7efc6401c2d0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 -- 172.21.15.28:0/2857595132 shutdown_connections 2023-11-28T19:32:20.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 --2- 172.21.15.28:0/2857595132 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7406ab60 0x7efc7414b5f0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 -- 172.21.15.28:0/2857595132 >> 172.21.15.28:0/2857595132 conn(0x7efc740c0c90 msgr2=0x7efc740c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:20.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 -- 172.21.15.28:0/2857595132 shutdown_connections 2023-11-28T19:32:20.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 -- 172.21.15.28:0/2857595132 wait complete. 2023-11-28T19:32:20.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 Processor -- start 2023-11-28T19:32:20.513 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 -- start start 2023-11-28T19:32:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7406ab60 0x7efc7414dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc7406af40 0x7efc740b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc740bbad0 0x7efc740b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc740ba3c0 con 0x7efc7406ab60 2023-11-28T19:32:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc740b5590 con 0x7efc7406af40 2023-11-28T19:32:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc78a83640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc740ba660 con 0x7efc740bbad0 2023-11-28T19:32:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc7259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7406ab60 0x7efc7414dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc7259c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7406ab60 0x7efc7414dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52494/0 (socket says 172.21.15.28:52494) 2023-11-28T19:32:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc7259c640 1 -- 172.21.15.28:0/179827437 learned_addr learned my addr 172.21.15.28:0/179827437 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc7259c640 1 -- 172.21.15.28:0/179827437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc740bbad0 msgr2=0x7efc740b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc7259c640 1 --2- 172.21.15.28:0/179827437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc740bbad0 0x7efc740b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc7259c640 1 -- 172.21.15.28:0/179827437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc7406af40 msgr2=0x7efc740b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc71d9b640 1 --2- 172.21.15.28:0/179827437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc7406af40 0x7efc740b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc7259c640 1 --2- 172.21.15.28:0/179827437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc7406af40 0x7efc740b59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc7259c640 1 -- 172.21.15.28:0/179827437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64009420 con 0x7efc7406ab60 2023-11-28T19:32:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc71d9b640 1 --2- 172.21.15.28:0/179827437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc7406af40 0x7efc740b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc7259c640 1 --2- 172.21.15.28:0/179827437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7406ab60 0x7efc7414dc40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7efc640ae040 tx=0x7efc6401ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc62ffd640 1 -- 172.21.15.28:0/179827437 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640aa8b0 con 0x7efc7406ab60 2023-11-28T19:32:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.509+0000 7efc62ffd640 1 -- 172.21.15.28:0/179827437 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc640aaa10 con 0x7efc7406ab60 2023-11-28T19:32:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.513+0000 7efc78a83640 1 -- 172.21.15.28:0/179827437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc740ba940 con 0x7efc7406ab60 2023-11-28T19:32:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.513+0000 7efc62ffd640 1 -- 172.21.15.28:0/179827437 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc640aadc0 con 0x7efc7406ab60 2023-11-28T19:32:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.513+0000 7efc78a83640 1 -- 172.21.15.28:0/179827437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc740bae60 con 0x7efc7406ab60 2023-11-28T19:32:20.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.513+0000 7efc78a83640 1 -- 172.21.15.28:0/179827437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc740c1ae0 con 0x7efc7406ab60 2023-11-28T19:32:20.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.513+0000 7efc62ffd640 1 -- 172.21.15.28:0/179827437 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7efc640c2460 con 0x7efc7406ab60 2023-11-28T19:32:20.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.513+0000 7efc62ffd640 1 --2- 172.21.15.28:0/179827437 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efc54066470 0x7efc54068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.513+0000 7efc62ffd640 1 -- 172.21.15.28:0/179827437 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efc6411e880 con 0x7efc7406ab60 2023-11-28T19:32:20.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.513+0000 7efc71d9b640 1 --2- 172.21.15.28:0/179827437 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efc54066470 0x7efc54068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.519 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.513+0000 7efc71d9b640 1 --2- 172.21.15.28:0/179827437 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efc54066470 0x7efc54068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efc740a6780 tx=0x7efc68008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:20.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.517+0000 7efc62ffd640 1 -- 172.21.15.28:0/179827437 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7efc740c1ae0 con 0x7efc7406ab60 2023-11-28T19:32:20.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.673+0000 7efc78a83640 1 -- 172.21.15.28:0/179827437 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7efc740c1ae0 con 0x7efc7406ab60 2023-11-28T19:32:20.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.673+0000 7efc62ffd640 1 -- 172.21.15.28:0/179827437 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7efc740c1ae0 con 0x7efc7406ab60 2023-11-28T19:32:20.679 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:20.680 INFO:teuthology.orchestra.run.smithi028.stdout:[ 2023-11-28T19:32:20.681 INFO:teuthology.orchestra.run.smithi028.stdout: { 2023-11-28T19:32:20.681 INFO:teuthology.orchestra.run.smithi028.stdout: "poolnum": 1, 2023-11-28T19:32:20.681 INFO:teuthology.orchestra.run.smithi028.stdout: "poolname": ".mgr" 2023-11-28T19:32:20.682 INFO:teuthology.orchestra.run.smithi028.stdout: } 2023-11-28T19:32:20.682 INFO:teuthology.orchestra.run.smithi028.stdout:] 2023-11-28T19:32:20.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.677+0000 7efc78a83640 1 -- 172.21.15.28:0/179827437 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efc54066470 msgr2=0x7efc54068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.683 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.677+0000 7efc78a83640 1 --2- 172.21.15.28:0/179827437 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efc54066470 0x7efc54068930 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efc740a6780 tx=0x7efc68008040 comp rx=0 tx=0).stop 2023-11-28T19:32:20.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.677+0000 7efc78a83640 1 -- 172.21.15.28:0/179827437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7406ab60 msgr2=0x7efc7414dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.677+0000 7efc78a83640 1 --2- 172.21.15.28:0/179827437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7406ab60 0x7efc7414dc40 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7efc640ae040 tx=0x7efc6401ab10 comp rx=0 tx=0).stop 2023-11-28T19:32:20.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.677+0000 7efc78a83640 1 -- 172.21.15.28:0/179827437 shutdown_connections 2023-11-28T19:32:20.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.677+0000 7efc78a83640 1 --2- 172.21.15.28:0/179827437 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7efc54066470 0x7efc54068930 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.677+0000 7efc78a83640 1 --2- 172.21.15.28:0/179827437 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7efc740bbad0 0x7efc740b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.677+0000 7efc78a83640 1 --2- 172.21.15.28:0/179827437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efc7406af40 0x7efc740b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.684 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.677+0000 7efc78a83640 1 --2- 172.21.15.28:0/179827437 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7efc7406ab60 0x7efc7414dc40 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.677+0000 7efc78a83640 1 -- 172.21.15.28:0/179827437 >> 172.21.15.28:0/179827437 conn(0x7efc740c0c90 msgr2=0x7efc740a09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:20.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.677+0000 7efc78a83640 1 -- 172.21.15.28:0/179827437 shutdown_connections 2023-11-28T19:32:20.685 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.677+0000 7efc78a83640 1 -- 172.21.15.28:0/179827437 wait complete. 2023-11-28T19:32:20.695 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-11-28T19:32:20.695 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-11-28T19:32:20.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.821+0000 7f813c1ff640 1 Processor -- start 2023-11-28T19:32:20.823 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.821+0000 7f813c1ff640 1 -- start start 2023-11-28T19:32:20.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.821+0000 7f813c1ff640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8134149d80 0x7f81340b4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.824 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.821+0000 7f813c1ff640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8134149190 con 0x7f81340b6bc0 2023-11-28T19:32:20.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.821+0000 7f813c1ff640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81340b4be0 con 0x7f81340a20e0 2023-11-28T19:32:20.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.821+0000 7f813c1ff640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81340b4ec0 con 0x7f8134149d80 2023-11-28T19:32:20.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.821+0000 7f813a79c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8134149d80 0x7f81340b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.821+0000 7f8139f9b640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f81340b6bc0 0x7f8134143060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48050/0 (socket says 172.21.15.28:48050) 2023-11-28T19:32:20.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.821+0000 7f8139f9b640 1 -- 172.21.15.28:0/2965558783 learned_addr learned my addr 172.21.15.28:0/2965558783 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:20.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.821+0000 7f813a79c640 1 -- 172.21.15.28:0/2965558783 >> v1:172.21.15.131:6789/0 conn(0x7f81340a20e0 legacy=0x7f8134149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.821+0000 7f813a79c640 1 -- 172.21.15.28:0/2965558783 >> v1:172.21.15.28:6789/0 conn(0x7f81340b6bc0 legacy=0x7f8134143060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.821+0000 7f813a79c640 1 -- 172.21.15.28:0/2965558783 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81340b51a0 con 0x7f8134149d80 2023-11-28T19:32:20.825 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.821+0000 7f8138f99640 1 -- 172.21.15.28:0/2965558783 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2048080440 0 0) 0x7f8134149190 con 0x7f81340b6bc0 2023-11-28T19:32:20.826 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813a79c640 1 --2- 172.21.15.28:0/2965558783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8134149d80 0x7f81340b4570 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f81240097c0 tx=0x7f812401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7285cb1311992a35 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:20.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f8138f99640 1 -- 172.21.15.28:0/2965558783 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81240ab610 con 0x7f8134149d80 2023-11-28T19:32:20.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f8138f99640 1 -- 172.21.15.28:0/2965558783 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81240ab770 con 0x7f8134149d80 2023-11-28T19:32:20.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f8138f99640 1 -- 172.21.15.28:0/2965558783 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81240abb00 con 0x7f8134149d80 2023-11-28T19:32:20.827 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 -- 172.21.15.28:0/2965558783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8134149d80 msgr2=0x7f81340b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 --2- 172.21.15.28:0/2965558783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8134149d80 0x7f81340b4570 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f81240097c0 tx=0x7f812401c3f0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 -- 172.21.15.28:0/2965558783 shutdown_connections 2023-11-28T19:32:20.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 --2- 172.21.15.28:0/2965558783 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8134149d80 0x7f81340b4570 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 -- 172.21.15.28:0/2965558783 >> 172.21.15.28:0/2965558783 conn(0x7f81340666d0 msgr2=0x7f813406a580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:20.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 -- 172.21.15.28:0/2965558783 shutdown_connections 2023-11-28T19:32:20.828 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 -- 172.21.15.28:0/2965558783 wait complete. 2023-11-28T19:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 Processor -- start 2023-11-28T19:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 -- start start 2023-11-28T19:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81340a20e0 0x7f813414be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81340b6bc0 0x7f813413b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8134149d80 0x7f813413be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813414c3a0 con 0x7f8134149d80 2023-11-28T19:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813414d250 con 0x7f81340b6bc0 2023-11-28T19:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813c1ff640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813414a330 con 0x7f81340a20e0 2023-11-28T19:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813a79c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8134149d80 0x7f813413be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.831 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813a79c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8134149d80 0x7f813413be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52520/0 (socket says 172.21.15.28:52520) 2023-11-28T19:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813a79c640 1 -- 172.21.15.28:0/345685610 learned_addr learned my addr 172.21.15.28:0/345685610 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f8139f9b640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81340a20e0 0x7f813414be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813a79c640 1 -- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81340a20e0 msgr2=0x7f813414be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813a79c640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81340a20e0 0x7f813414be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813a79c640 1 -- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81340b6bc0 msgr2=0x7f813413b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813979a640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81340b6bc0 0x7f813413b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813a79c640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81340b6bc0 0x7f813413b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f813a79c640 1 -- 172.21.15.28:0/345685610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8124009420 con 0x7f8134149d80 2023-11-28T19:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.825+0000 7f8139f9b640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81340a20e0 0x7f813414be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.829+0000 7f813a79c640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8134149d80 0x7f813413be20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f81240ad040 tx=0x7f812401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.829+0000 7f81327fc640 1 -- 172.21.15.28:0/345685610 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81240bf610 con 0x7f8134149d80 2023-11-28T19:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.829+0000 7f81327fc640 1 -- 172.21.15.28:0/345685610 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81240bf770 con 0x7f8134149d80 2023-11-28T19:32:20.832 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.829+0000 7f813c1ff640 1 -- 172.21.15.28:0/345685610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8134143ee0 con 0x7f8134149d80 2023-11-28T19:32:20.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.829+0000 7f81327fc640 1 -- 172.21.15.28:0/345685610 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81240bfb00 con 0x7f8134149d80 2023-11-28T19:32:20.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.829+0000 7f813c1ff640 1 -- 172.21.15.28:0/345685610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81341e4540 con 0x7f8134149d80 2023-11-28T19:32:20.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.829+0000 7f813c1ff640 1 -- 172.21.15.28:0/345685610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f813414a5f0 con 0x7f8134149d80 2023-11-28T19:32:20.833 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.829+0000 7f81327fc640 1 -- 172.21.15.28:0/345685610 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f81240b5400 con 0x7f8134149d80 2023-11-28T19:32:20.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.829+0000 7f81327fc640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8120066470 0x7f8120068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:20.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.829+0000 7f81327fc640 1 -- 172.21.15.28:0/345685610 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f812411eac0 con 0x7f8134149d80 2023-11-28T19:32:20.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.829+0000 7f8139f9b640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8120066470 0x7f8120068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:20.834 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.829+0000 7f8139f9b640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8120066470 0x7f8120068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f812c007fd0 tx=0x7f812c009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:20.836 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.833+0000 7f81327fc640 1 -- 172.21.15.28:0/345685610 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f813414a5f0 con 0x7f8134149d80 2023-11-28T19:32:20.991 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:20.989+0000 7f813c1ff640 1 -- 172.21.15.28:0/345685610 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f813414a5f0 con 0x7f8134149d80 2023-11-28T19:32:21.484 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.481+0000 7f81327fc640 1 -- 172.21.15.28:0/345685610 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f813414a5f0 con 0x7f8134149d80 2023-11-28T19:32:21.484 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_metadata' created 2023-11-28T19:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.485+0000 7f813c1ff640 1 -- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8120066470 msgr2=0x7f8120068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.485+0000 7f813c1ff640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8120066470 0x7f8120068930 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f812c007fd0 tx=0x7f812c009040 comp rx=0 tx=0).stop 2023-11-28T19:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.485+0000 7f813c1ff640 1 -- 172.21.15.28:0/345685610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8134149d80 msgr2=0x7f813413be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.485+0000 7f813c1ff640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8134149d80 0x7f813413be20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f81240ad040 tx=0x7f812401ac30 comp rx=0 tx=0).stop 2023-11-28T19:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.485+0000 7f813c1ff640 1 -- 172.21.15.28:0/345685610 shutdown_connections 2023-11-28T19:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.485+0000 7f813c1ff640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8120066470 0x7f8120068930 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:21.489 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.485+0000 7f813c1ff640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8134149d80 0x7f813413be20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:21.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.485+0000 7f813c1ff640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81340b6bc0 0x7f813413b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:21.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.485+0000 7f813c1ff640 1 --2- 172.21.15.28:0/345685610 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f81340a20e0 0x7f813414be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:21.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.485+0000 7f813c1ff640 1 -- 172.21.15.28:0/345685610 >> 172.21.15.28:0/345685610 conn(0x7f81340666d0 msgr2=0x7f813413dd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:21.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.485+0000 7f813c1ff640 1 -- 172.21.15.28:0/345685610 shutdown_connections 2023-11-28T19:32:21.490 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.485+0000 7f813c1ff640 1 -- 172.21.15.28:0/345685610 wait complete. 2023-11-28T19:32:21.512 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-11-28T19:32:21.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c85b6640 1 Processor -- start 2023-11-28T19:32:21.647 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c85b6640 1 -- start start 2023-11-28T19:32:21.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c85b6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00bc120 0x7fc6c00bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:21.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c85b6640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc6c00a2d60 0x7fc6c014c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:21.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c85b6640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc6c0072940 0x7fc6c014cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:21.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c85b6640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c00b6f30 con 0x7fc6c00a2d60 2023-11-28T19:32:21.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c85b6640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6c0143b60 con 0x7fc6c0072940 2023-11-28T19:32:21.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c85b6640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c00b7aa0 con 0x7fc6c00bc120 2023-11-28T19:32:21.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c5b51640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc6c00a2d60 0x7fc6c014c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:21.649 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c5b51640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc6c00a2d60 0x7fc6c014c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52528/0 (socket says 172.21.15.28:52528) 2023-11-28T19:32:21.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c5b51640 1 -- 172.21.15.28:0/1377096979 learned_addr learned my addr 172.21.15.28:0/1377096979 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:21.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c6b53640 1 --2- 172.21.15.28:0/1377096979 >> v2:172.21.15.131:3300/0 conn(0x7fc6c0072940 0x7fc6c014cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:21.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c6352640 1 --2- 172.21.15.28:0/1377096979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00bc120 0x7fc6c00bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:21.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c5b51640 1 -- 172.21.15.28:0/1377096979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00bc120 msgr2=0x7fc6c00bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:21.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c5b51640 1 --2- 172.21.15.28:0/1377096979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00bc120 0x7fc6c00bd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:21.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c5b51640 1 -- 172.21.15.28:0/1377096979 >> v2:172.21.15.131:3300/0 conn(0x7fc6c0072940 msgr2=0x7fc6c014cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:21.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c5b51640 1 --2- 172.21.15.28:0/1377096979 >> v2:172.21.15.131:3300/0 conn(0x7fc6c0072940 0x7fc6c014cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:21.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c5b51640 1 -- 172.21.15.28:0/1377096979 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c00b7d60 con 0x7fc6c00a2d60 2023-11-28T19:32:21.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c6b53640 1 --2- 172.21.15.28:0/1377096979 >> v2:172.21.15.131:3300/0 conn(0x7fc6c0072940 0x7fc6c014cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:21.650 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.645+0000 7fc6c6352640 1 --2- 172.21.15.28:0/1377096979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00bc120 0x7fc6c00bd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:21.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c5b51640 1 --2- 172.21.15.28:0/1377096979 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c00a2d60 0x7fc6c014c9a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00bc7d0 tx=0x7fc6bc01f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1407287ef3cb07e8 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:21.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c5350640 1 -- 172.21.15.28:0/1377096979 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0af400 con 0x7fc6c00a2d60 2023-11-28T19:32:21.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c5350640 1 -- 172.21.15.28:0/1377096979 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6bc0ab050 con 0x7fc6c00a2d60 2023-11-28T19:32:21.651 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c5350640 1 -- 172.21.15.28:0/1377096979 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6bc0af780 con 0x7fc6c00a2d60 2023-11-28T19:32:21.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1377096979 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c00a2d60 msgr2=0x7fc6c014c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:21.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 --2- 172.21.15.28:0/1377096979 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c00a2d60 0x7fc6c014c9a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fc6c00bc7d0 tx=0x7fc6bc01f1c0 comp rx=0 tx=0).stop 2023-11-28T19:32:21.652 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1377096979 shutdown_connections 2023-11-28T19:32:21.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 --2- 172.21.15.28:0/1377096979 >> v2:172.21.15.131:3300/0 conn(0x7fc6c0072940 0x7fc6c014cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:21.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 --2- 172.21.15.28:0/1377096979 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c00a2d60 0x7fc6c014c9a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:21.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 --2- 172.21.15.28:0/1377096979 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00bc120 0x7fc6c00bd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:21.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1377096979 >> 172.21.15.28:0/1377096979 conn(0x7fc6c006ab80 msgr2=0x7fc6c00bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:21.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1377096979 shutdown_connections 2023-11-28T19:32:21.653 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1377096979 wait complete. 2023-11-28T19:32:21.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 Processor -- start 2023-11-28T19:32:21.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 -- start start 2023-11-28T19:32:21.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c0072940 0x7fc6c01443a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:21.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c00a2d60 0x7fc6c01464a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:21.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00bc120 0x7fc6c01de910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:21.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c01448e0 con 0x7fc6c0072940 2023-11-28T19:32:21.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c01df530 con 0x7fc6c00a2d60 2023-11-28T19:32:21.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.649+0000 7fc6c85b6640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6c01df810 con 0x7fc6c00bc120 2023-11-28T19:32:21.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c6352640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c0072940 0x7fc6c01443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:21.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c6352640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c0072940 0x7fc6c01443a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52530/0 (socket says 172.21.15.28:52530) 2023-11-28T19:32:21.656 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c6352640 1 -- 172.21.15.28:0/1526117860 learned_addr learned my addr 172.21.15.28:0/1526117860 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:21.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c5b51640 1 --2- 172.21.15.28:0/1526117860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c00a2d60 0x7fc6c01464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:21.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c6b53640 1 --2- 172.21.15.28:0/1526117860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00bc120 0x7fc6c01de910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:21.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c6352640 1 -- 172.21.15.28:0/1526117860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00bc120 msgr2=0x7fc6c01de910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:21.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c6352640 1 --2- 172.21.15.28:0/1526117860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00bc120 0x7fc6c01de910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:21.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c6352640 1 -- 172.21.15.28:0/1526117860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c00a2d60 msgr2=0x7fc6c01464a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:21.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c6352640 1 --2- 172.21.15.28:0/1526117860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c00a2d60 0x7fc6c01464a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:21.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c6352640 1 -- 172.21.15.28:0/1526117860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6bc009b30 con 0x7fc6c0072940 2023-11-28T19:32:21.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c6352640 1 --2- 172.21.15.28:0/1526117860 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c0072940 0x7fc6c01443a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400c7c0 tx=0x7fc6b400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:21.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6b2ffd640 1 -- 172.21.15.28:0/1526117860 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b4007a30 con 0x7fc6c0072940 2023-11-28T19:32:21.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6b2ffd640 1 -- 172.21.15.28:0/1526117860 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6b4007b90 con 0x7fc6c0072940 2023-11-28T19:32:21.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1526117860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c013e670 con 0x7fc6c0072940 2023-11-28T19:32:21.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6b2ffd640 1 -- 172.21.15.28:0/1526117860 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6b400ce70 con 0x7fc6c0072940 2023-11-28T19:32:21.657 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1526117860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6c01469e0 con 0x7fc6c0072940 2023-11-28T19:32:21.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1526117860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6c0146c30 con 0x7fc6c0072940 2023-11-28T19:32:21.658 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6b2ffd640 1 -- 172.21.15.28:0/1526117860 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc6b40113f0 con 0x7fc6c0072940 2023-11-28T19:32:21.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6b2ffd640 1 --2- 172.21.15.28:0/1526117860 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc6a4066470 0x7fc6a4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:21.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6b2ffd640 1 -- 172.21.15.28:0/1526117860 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fc6b4084120 con 0x7fc6c0072940 2023-11-28T19:32:21.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.653+0000 7fc6c5b51640 1 --2- 172.21.15.28:0/1526117860 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc6a4066470 0x7fc6a4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:21.659 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.657+0000 7fc6c5b51640 1 --2- 172.21.15.28:0/1526117860 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc6a4066470 0x7fc6a4068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0b1000 tx=0x7fc6bc0aa000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:21.662 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.657+0000 7fc6b2ffd640 1 -- 172.21.15.28:0/1526117860 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc6b4051780 con 0x7fc6c0072940 2023-11-28T19:32:21.818 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:21.817+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1526117860 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fc6c0074a90 con 0x7fc6c0072940 2023-11-28T19:32:22.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.493+0000 7fc6b2ffd640 1 -- 172.21.15.28:0/1526117860 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7fc6b4054da0 con 0x7fc6c0072940 2023-11-28T19:32:22.497 INFO:teuthology.orchestra.run.smithi028.stderr:pool 'cephfs_data' created 2023-11-28T19:32:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.497+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1526117860 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc6a4066470 msgr2=0x7fc6a4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.497+0000 7fc6c85b6640 1 --2- 172.21.15.28:0/1526117860 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc6a4066470 0x7fc6a4068930 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fc6bc0b1000 tx=0x7fc6bc0aa000 comp rx=0 tx=0).stop 2023-11-28T19:32:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.497+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1526117860 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c0072940 msgr2=0x7fc6c01443a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.497+0000 7fc6c85b6640 1 --2- 172.21.15.28:0/1526117860 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c0072940 0x7fc6c01443a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fc6b400c7c0 tx=0x7fc6b400cc80 comp rx=0 tx=0).stop 2023-11-28T19:32:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.497+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1526117860 shutdown_connections 2023-11-28T19:32:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.497+0000 7fc6c85b6640 1 --2- 172.21.15.28:0/1526117860 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc6a4066470 0x7fc6a4068930 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.497+0000 7fc6c85b6640 1 --2- 172.21.15.28:0/1526117860 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc6c00bc120 0x7fc6c01de910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.497+0000 7fc6c85b6640 1 --2- 172.21.15.28:0/1526117860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc6c00a2d60 0x7fc6c01464a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:22.500 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.497+0000 7fc6c85b6640 1 --2- 172.21.15.28:0/1526117860 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc6c0072940 0x7fc6c01443a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.497+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1526117860 >> 172.21.15.28:0/1526117860 conn(0x7fc6c006ab80 msgr2=0x7fc6c00b3620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.497+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1526117860 shutdown_connections 2023-11-28T19:32:22.501 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.497+0000 7fc6c85b6640 1 -- 172.21.15.28:0/1526117860 wait complete. 2023-11-28T19:32:22.541 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-11-28T19:32:22.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.661+0000 7fd7aa963640 1 Processor -- start 2023-11-28T19:32:22.666 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.661+0000 7fd7aa963640 1 -- start start 2023-11-28T19:32:22.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.665+0000 7fd7aa963640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd7a40b5ad0 0x7fd7a40b5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:22.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.665+0000 7fd7aa963640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a4145600 con 0x7fd7a4150210 2023-11-28T19:32:22.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.665+0000 7fd7aa963640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7a40b9270 con 0x7fd7a4145220 2023-11-28T19:32:22.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.665+0000 7fd7aa963640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7a40b4d30 con 0x7fd7a40b5ad0 2023-11-28T19:32:22.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.665+0000 7fd7a37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd7a40b5ad0 0x7fd7a40b5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:22.667 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.665+0000 7fd7a37fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fd7a40b5ad0 0x7fd7a40b5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52532/0 (socket says 172.21.15.28:52532) 2023-11-28T19:32:22.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.665+0000 7fd7a37fe640 1 -- 172.21.15.28:0/1086374326 learned_addr learned my addr 172.21.15.28:0/1086374326 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:22.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.665+0000 7fd7a37fe640 1 -- 172.21.15.28:0/1086374326 >> v1:172.21.15.131:6789/0 conn(0x7fd7a4145220 legacy=0x7fd7a40ba7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:22.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.665+0000 7fd7a2ffd640 1 -- 172.21.15.28:0/1086374326 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561165090 0 0) 0x7fd7a4145600 con 0x7fd7a4150210 2023-11-28T19:32:22.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.665+0000 7fd7a37fe640 1 -- 172.21.15.28:0/1086374326 >> v1:172.21.15.28:6789/0 conn(0x7fd7a4150210 legacy=0x7fd7a4152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:22.668 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.665+0000 7fd7a37fe640 1 -- 172.21.15.28:0/1086374326 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7a40b6530 con 0x7fd7a40b5ad0 2023-11-28T19:32:22.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.665+0000 7fd7a37fe640 1 --2- 172.21.15.28:0/1086374326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7a40b5ad0 0x7fd7a40b5f40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00aa10 tx=0x7fd78c01d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fc066ade22a8395 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:22.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a2ffd640 1 -- 172.21.15.28:0/1086374326 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0a67a0 con 0x7fd7a40b5ad0 2023-11-28T19:32:22.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a2ffd640 1 -- 172.21.15.28:0/1086374326 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c0a6900 con 0x7fd7a40b5ad0 2023-11-28T19:32:22.670 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a2ffd640 1 -- 172.21.15.28:0/1086374326 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0a6c90 con 0x7fd7a40b5ad0 2023-11-28T19:32:22.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 -- 172.21.15.28:0/1086374326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7a40b5ad0 msgr2=0x7fd7a40b5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:22.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 --2- 172.21.15.28:0/1086374326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7a40b5ad0 0x7fd7a40b5f40 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00aa10 tx=0x7fd78c01d880 comp rx=0 tx=0).stop 2023-11-28T19:32:22.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 -- 172.21.15.28:0/1086374326 shutdown_connections 2023-11-28T19:32:22.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 --2- 172.21.15.28:0/1086374326 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7a40b5ad0 0x7fd7a40b5f40 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:22.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 -- 172.21.15.28:0/1086374326 >> 172.21.15.28:0/1086374326 conn(0x7fd7a406ab80 msgr2=0x7fd7a40bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:22.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 -- 172.21.15.28:0/1086374326 shutdown_connections 2023-11-28T19:32:22.671 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 -- 172.21.15.28:0/1086374326 wait complete. 2023-11-28T19:32:22.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 Processor -- start 2023-11-28T19:32:22.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 -- start start 2023-11-28T19:32:22.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7a40b5ad0 0x7fd7a414a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:22.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7a4145220 0x7fd7a41e4070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:22.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7a4150210 0x7fd7a41e45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:22.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a414abe0 con 0x7fd7a4145220 2023-11-28T19:32:22.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a406f1a0 con 0x7fd7a4150210 2023-11-28T19:32:22.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a4070320 con 0x7fd7a40b5ad0 2023-11-28T19:32:22.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7a4145220 0x7fd7a41e4070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:22.675 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a37fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7a4145220 0x7fd7a41e4070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52536/0 (socket says 172.21.15.28:52536) 2023-11-28T19:32:22.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a37fe640 1 -- 172.21.15.28:0/140850972 learned_addr learned my addr 172.21.15.28:0/140850972 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:22.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a8f00640 1 --2- 172.21.15.28:0/140850972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7a4150210 0x7fd7a41e45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:22.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a37fe640 1 -- 172.21.15.28:0/140850972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7a40b5ad0 msgr2=0x7fd7a414a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:22.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a37fe640 1 --2- 172.21.15.28:0/140850972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7a40b5ad0 0x7fd7a414a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:22.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a37fe640 1 -- 172.21.15.28:0/140850972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7a4150210 msgr2=0x7fd7a41e45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:22.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a37fe640 1 --2- 172.21.15.28:0/140850972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7a4150210 0x7fd7a41e45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:22.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a37fe640 1 -- 172.21.15.28:0/140850972 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd78c00a670 con 0x7fd7a4145220 2023-11-28T19:32:22.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a8f00640 1 --2- 172.21.15.28:0/140850972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7a4150210 0x7fd7a41e45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:22.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a37fe640 1 --2- 172.21.15.28:0/140850972 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7a4145220 0x7fd7a41e4070 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00a1c0 tx=0x7fd78c01a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:22.676 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a0ff9640 1 -- 172.21.15.28:0/140850972 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0ae8d0 con 0x7fd7a4145220 2023-11-28T19:32:22.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a0ff9640 1 -- 172.21.15.28:0/140850972 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd78c0aea50 con 0x7fd7a4145220 2023-11-28T19:32:22.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 -- 172.21.15.28:0/140850972 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7a4148f90 con 0x7fd7a4145220 2023-11-28T19:32:22.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7a0ff9640 1 -- 172.21.15.28:0/140850972 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd78c0aee00 con 0x7fd7a4145220 2023-11-28T19:32:22.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.669+0000 7fd7aa963640 1 -- 172.21.15.28:0/140850972 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a4070590 con 0x7fd7a4145220 2023-11-28T19:32:22.677 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.673+0000 7fd7aa963640 1 -- 172.21.15.28:0/140850972 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7a40b8f90 con 0x7fd7a4145220 2023-11-28T19:32:22.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.673+0000 7fd7a0ff9640 1 -- 172.21.15.28:0/140850972 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fd78c0b63f0 con 0x7fd7a4145220 2023-11-28T19:32:22.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.673+0000 7fd7a0ff9640 1 --2- 172.21.15.28:0/140850972 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd784066470 0x7fd784068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:22.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.673+0000 7fd7a0ff9640 1 -- 172.21.15.28:0/140850972 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fd78c11e6b0 con 0x7fd7a4145220 2023-11-28T19:32:22.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.673+0000 7fd7a3fff640 1 --2- 172.21.15.28:0/140850972 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd784066470 0x7fd784068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:22.678 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.673+0000 7fd7a3fff640 1 --2- 172.21.15.28:0/140850972 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd784066470 0x7fd784068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd79c000f70 tx=0x7fd79c0079c0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:22.680 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.677+0000 7fd7a0ff9640 1 -- 172.21.15.28:0/140850972 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fd78c0ebc20 con 0x7fd7a4145220 2023-11-28T19:32:22.869 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:22.865+0000 7fd7aa963640 1 -- 172.21.15.28:0/140850972 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd7a40b3fd0 con 0x7fd7a4145220 2023-11-28T19:32:23.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.545+0000 7fd7a0ff9640 1 -- 172.21.15.28:0/140850972 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd78c0ef240 con 0x7fd7a4145220 2023-11-28T19:32:23.552 INFO:teuthology.orchestra.run.smithi028.stderr:new fs with metadata pool 4 and data pool 5 2023-11-28T19:32:23.556 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.553+0000 7fd7aa963640 1 -- 172.21.15.28:0/140850972 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd784066470 msgr2=0x7fd784068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:23.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.553+0000 7fd7aa963640 1 --2- 172.21.15.28:0/140850972 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd784066470 0x7fd784068930 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fd79c000f70 tx=0x7fd79c0079c0 comp rx=0 tx=0).stop 2023-11-28T19:32:23.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.553+0000 7fd7aa963640 1 -- 172.21.15.28:0/140850972 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7a4145220 msgr2=0x7fd7a41e4070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:23.557 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.553+0000 7fd7aa963640 1 --2- 172.21.15.28:0/140850972 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7a4145220 0x7fd7a41e4070 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fd78c00a1c0 tx=0x7fd78c01a620 comp rx=0 tx=0).stop 2023-11-28T19:32:23.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.553+0000 7fd7aa963640 1 -- 172.21.15.28:0/140850972 shutdown_connections 2023-11-28T19:32:23.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.553+0000 7fd7aa963640 1 --2- 172.21.15.28:0/140850972 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fd784066470 0x7fd784068930 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:23.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.553+0000 7fd7aa963640 1 --2- 172.21.15.28:0/140850972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd7a4150210 0x7fd7a41e45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:23.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.553+0000 7fd7aa963640 1 --2- 172.21.15.28:0/140850972 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fd7a4145220 0x7fd7a41e4070 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:23.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.553+0000 7fd7aa963640 1 --2- 172.21.15.28:0/140850972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fd7a40b5ad0 0x7fd7a414a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:23.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.553+0000 7fd7aa963640 1 -- 172.21.15.28:0/140850972 >> 172.21.15.28:0/140850972 conn(0x7fd7a406ab80 msgr2=0x7fd7a40bbe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:23.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.553+0000 7fd7aa963640 1 -- 172.21.15.28:0/140850972 shutdown_connections 2023-11-28T19:32:23.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.553+0000 7fd7aa963640 1 -- 172.21.15.28:0/140850972 wait complete. 2023-11-28T19:32:23.585 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:32:23.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.701+0000 7f1b94677640 1 Processor -- start 2023-11-28T19:32:23.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.701+0000 7f1b94677640 1 -- start start 2023-11-28T19:32:23.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.701+0000 7f1b94677640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1b8c142560 0x7f1b8c0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:23.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.701+0000 7f1b94677640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b8c0b4a80 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.701+0000 7f1b94677640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b8c142940 con 0x7f1b8c0b4610 2023-11-28T19:32:23.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.701+0000 7f1b94677640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b8c06f950 con 0x7f1b8c142560 2023-11-28T19:32:23.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.701+0000 7f1b92413640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f1b8c142560 0x7f1b8c0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:23.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.701+0000 7f1b91c12640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f1b8c0b5dd0 0x7f1b8c0b6470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48070/0 (socket says 172.21.15.28:48070) 2023-11-28T19:32:23.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.701+0000 7f1b91c12640 1 -- 172.21.15.28:0/261369054 learned_addr learned my addr 172.21.15.28:0/261369054 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:23.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.701+0000 7f1b92413640 1 -- 172.21.15.28:0/261369054 >> v1:172.21.15.131:6789/0 conn(0x7f1b8c0b4610 legacy=0x7f1b8c152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:23.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.701+0000 7f1b92413640 1 -- 172.21.15.28:0/261369054 >> v1:172.21.15.28:6789/0 conn(0x7f1b8c0b5dd0 legacy=0x7f1b8c0b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:23.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.701+0000 7f1b91411640 1 -- 172.21.15.28:0/261369054 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2185343901 0 0) 0x7f1b8c0b4a80 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.705 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.701+0000 7f1b92413640 1 -- 172.21.15.28:0/261369054 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b8c14bb40 con 0x7f1b8c142560 2023-11-28T19:32:23.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b92413640 1 --2- 172.21.15.28:0/261369054 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b8c142560 0x7f1b8c0b40d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1b880097c0 tx=0x7f1b8801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de90c159e8cc66cd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:23.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b91411640 1 -- 172.21.15.28:0/261369054 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b880a8930 con 0x7f1b8c142560 2023-11-28T19:32:23.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b91411640 1 -- 172.21.15.28:0/261369054 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b880a8a90 con 0x7f1b8c142560 2023-11-28T19:32:23.707 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b91411640 1 -- 172.21.15.28:0/261369054 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b880a8e20 con 0x7f1b8c142560 2023-11-28T19:32:23.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 -- 172.21.15.28:0/261369054 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b8c142560 msgr2=0x7f1b8c0b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:23.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 --2- 172.21.15.28:0/261369054 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b8c142560 0x7f1b8c0b40d0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1b880097c0 tx=0x7f1b8801ec30 comp rx=0 tx=0).stop 2023-11-28T19:32:23.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 -- 172.21.15.28:0/261369054 shutdown_connections 2023-11-28T19:32:23.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 --2- 172.21.15.28:0/261369054 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b8c142560 0x7f1b8c0b40d0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:23.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 -- 172.21.15.28:0/261369054 >> 172.21.15.28:0/261369054 conn(0x7f1b8c0bcb40 msgr2=0x7f1b8c0bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:23.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 -- 172.21.15.28:0/261369054 shutdown_connections 2023-11-28T19:32:23.708 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 -- 172.21.15.28:0/261369054 wait complete. 2023-11-28T19:32:23.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 Processor -- start 2023-11-28T19:32:23.709 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 -- start start 2023-11-28T19:32:23.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b8c0b4610 0x7f1b8c13b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:23.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b8c0b5dd0 0x7f1b8c0bc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:23.711 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b8c142560 0x7f1b8c141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:23.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c0bc800 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c13a7c0 con 0x7f1b8c142560 2023-11-28T19:32:23.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b94677640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8c1411f0 con 0x7f1b8c0b4610 2023-11-28T19:32:23.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.705+0000 7f1b91c12640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b8c0b5dd0 0x7f1b8c0bc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:23.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b91c12640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b8c0b5dd0 0x7f1b8c0bc2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52566/0 (socket says 172.21.15.28:52566) 2023-11-28T19:32:23.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b91c12640 1 -- 172.21.15.28:0/3754382084 learned_addr learned my addr 172.21.15.28:0/3754382084 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:23.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b92c14640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b8c142560 0x7f1b8c141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:23.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b92413640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b8c0b4610 0x7f1b8c13b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:23.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b91c12640 1 -- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b8c0b4610 msgr2=0x7f1b8c13b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:23.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b91c12640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b8c0b4610 0x7f1b8c13b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:23.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b91c12640 1 -- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b8c142560 msgr2=0x7f1b8c141680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:23.712 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b91c12640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b8c142560 0x7f1b8c141680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:23.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b91c12640 1 -- 172.21.15.28:0/3754382084 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b88009420 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b92c14640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b8c142560 0x7f1b8c141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:23.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b91c12640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b8c0b5dd0 0x7f1b8c0bc2c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00c4b0 tx=0x7f1b7c00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:23.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b82ffd640 1 -- 172.21.15.28:0/3754382084 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c0074e0 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b82ffd640 1 -- 172.21.15.28:0/3754382084 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c007660 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b94677640 1 -- 172.21.15.28:0/3754382084 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8c13af90 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b82ffd640 1 -- 172.21.15.28:0/3754382084 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c004a30 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b94677640 1 -- 172.21.15.28:0/3754382084 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b8c0ba320 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.713 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b94677640 1 -- 172.21.15.28:0/3754382084 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8c14c0c0 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b82ffd640 1 -- 172.21.15.28:0/3754382084 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f1b7c004b90 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b82ffd640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1b70066470 0x7f1b70068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:23.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b82ffd640 1 -- 172.21.15.28:0/3754382084 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b7c083070 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.709+0000 7f1b92413640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1b70066470 0x7f1b70068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:23.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.713+0000 7f1b92413640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1b70066470 0x7f1b70068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1b880b2000 tx=0x7f1b88008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:23.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.713+0000 7f1b82ffd640 1 -- 172.21.15.28:0/3754382084 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f1b7c050590 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.876 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.873+0000 7f1b94677640 1 -- 172.21.15.28:0/3754382084 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b8c074a90 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.878 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.877+0000 7f1b82ffd640 1 -- 172.21.15.28:0/3754382084 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16582 (secure 0 0 0) 0x7f1b7c018090 con 0x7f1b8c0b5dd0 2023-11-28T19:32:23.879 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:23.879 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":31,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:32:22.870530+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:32:21.030929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T19:32:21.859160+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.877+0000 7f1b94677640 1 -- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1b70066470 msgr2=0x7f1b70068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.877+0000 7f1b94677640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1b70066470 0x7f1b70068930 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1b880b2000 tx=0x7f1b88008040 comp rx=0 tx=0).stop 2023-11-28T19:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.877+0000 7f1b94677640 1 -- 172.21.15.28:0/3754382084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b8c0b5dd0 msgr2=0x7f1b8c0bc2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.877+0000 7f1b94677640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b8c0b5dd0 0x7f1b8c0bc2c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c00c4b0 tx=0x7f1b7c00c970 comp rx=0 tx=0).stop 2023-11-28T19:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.877+0000 7f1b94677640 1 -- 172.21.15.28:0/3754382084 shutdown_connections 2023-11-28T19:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.877+0000 7f1b94677640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f1b70066470 0x7f1b70068930 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:23.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.877+0000 7f1b94677640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b8c142560 0x7f1b8c141680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.877+0000 7f1b94677640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f1b8c0b5dd0 0x7f1b8c0bc2c0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.877+0000 7f1b94677640 1 --2- 172.21.15.28:0/3754382084 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f1b8c0b4610 0x7f1b8c13b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.877+0000 7f1b94677640 1 -- 172.21.15.28:0/3754382084 >> 172.21.15.28:0/3754382084 conn(0x7f1b8c0bcb40 msgr2=0x7f1b8c0b9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.877+0000 7f1b94677640 1 -- 172.21.15.28:0/3754382084 shutdown_connections 2023-11-28T19:32:23.882 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:23.877+0000 7f1b94677640 1 -- 172.21.15.28:0/3754382084 wait complete. 2023-11-28T19:32:23.899 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:32:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.013+0000 7ff364672640 1 Processor -- start 2023-11-28T19:32:24.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.013+0000 7ff364672640 1 -- start start 2023-11-28T19:32:24.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff364672640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff35c142510 0x7ff35c0ba8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:24.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff364672640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff35c0b3540 0x7ff35c14b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:24.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff364672640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff35c0a3fb0 con 0x7ff35c0ba0d0 2023-11-28T19:32:24.019 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff364672640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35c0b48a0 con 0x7ff35c142510 2023-11-28T19:32:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff364672640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff35c0b4cc0 con 0x7ff35c0b3540 2023-11-28T19:32:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff36240e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff35c142510 0x7ff35c0ba8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff36240e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ff35c142510 0x7ff35c0ba8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52582/0 (socket says 172.21.15.28:52582) 2023-11-28T19:32:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff36240e640 1 -- 172.21.15.28:0/2456011050 learned_addr learned my addr 172.21.15.28:0/2456011050 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff361c0d640 1 --2- 172.21.15.28:0/2456011050 >> v2:172.21.15.131:3300/0 conn(0x7ff35c0b3540 0x7ff35c14b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff36240e640 1 -- 172.21.15.28:0/2456011050 >> v2:172.21.15.131:3300/0 conn(0x7ff35c0b3540 msgr2=0x7ff35c14b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff36240e640 1 --2- 172.21.15.28:0/2456011050 >> v2:172.21.15.131:3300/0 conn(0x7ff35c0b3540 0x7ff35c14b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff36240e640 1 -- 172.21.15.28:0/2456011050 >> v1:172.21.15.131:6789/0 conn(0x7ff35c0ba0d0 legacy=0x7ff35c0b8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff36240e640 1 -- 172.21.15.28:0/2456011050 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c1428f0 con 0x7ff35c142510 2023-11-28T19:32:24.020 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff361c0d640 1 --2- 172.21.15.28:0/2456011050 >> v2:172.21.15.131:3300/0 conn(0x7ff35c0b3540 0x7ff35c14b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:24.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff36240e640 1 --2- 172.21.15.28:0/2456011050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff35c142510 0x7ff35c0ba8d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff35c14c760 tx=0x7ff358021380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d340b0152b7b55 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:24.021 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff36140c640 1 -- 172.21.15.28:0/2456011050 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3580b1600 con 0x7ff35c142510 2023-11-28T19:32:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff36140c640 1 -- 172.21.15.28:0/2456011050 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3580ad050 con 0x7ff35c142510 2023-11-28T19:32:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.017+0000 7ff36140c640 1 -- 172.21.15.28:0/2456011050 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3580b1980 con 0x7ff35c142510 2023-11-28T19:32:24.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 -- 172.21.15.28:0/2456011050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff35c142510 msgr2=0x7ff35c0ba8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:24.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 --2- 172.21.15.28:0/2456011050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff35c142510 0x7ff35c0ba8d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff35c14c760 tx=0x7ff358021380 comp rx=0 tx=0).stop 2023-11-28T19:32:24.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 -- 172.21.15.28:0/2456011050 shutdown_connections 2023-11-28T19:32:24.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 --2- 172.21.15.28:0/2456011050 >> v2:172.21.15.131:3300/0 conn(0x7ff35c0b3540 0x7ff35c14b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:24.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 --2- 172.21.15.28:0/2456011050 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff35c142510 0x7ff35c0ba8d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:24.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 -- 172.21.15.28:0/2456011050 >> 172.21.15.28:0/2456011050 conn(0x7ff35c06b860 msgr2=0x7ff35c06bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:24.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 -- 172.21.15.28:0/2456011050 shutdown_connections 2023-11-28T19:32:24.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 -- 172.21.15.28:0/2456011050 wait complete. 2023-11-28T19:32:24.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 Processor -- start 2023-11-28T19:32:24.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 -- start start 2023-11-28T19:32:24.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff35c0ba0d0 0x7ff35c144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:24.025 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff35c142510 0x7ff35c0bcac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff35c0bd000 0x7ff35c0bddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c1430b0 con 0x7ff35c0bd000 2023-11-28T19:32:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c145190 con 0x7ff35c142510 2023-11-28T19:32:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c0be7f0 con 0x7ff35c0ba0d0 2023-11-28T19:32:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff362c0f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff35c0bd000 0x7ff35c0bddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff361c0d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff35c142510 0x7ff35c0bcac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff362c0f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff35c0bd000 0x7ff35c0bddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52586/0 (socket says 172.21.15.28:52586) 2023-11-28T19:32:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff362c0f640 1 -- 172.21.15.28:0/416093519 learned_addr learned my addr 172.21.15.28:0/416093519 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff36240e640 1 --2- 172.21.15.28:0/416093519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff35c0ba0d0 0x7ff35c144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff362c0f640 1 -- 172.21.15.28:0/416093519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff35c0ba0d0 msgr2=0x7ff35c144550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff362c0f640 1 --2- 172.21.15.28:0/416093519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff35c0ba0d0 0x7ff35c144550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:24.026 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff362c0f640 1 -- 172.21.15.28:0/416093519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff35c142510 msgr2=0x7ff35c0bcac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff362c0f640 1 --2- 172.21.15.28:0/416093519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff35c142510 0x7ff35c0bcac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff362c0f640 1 -- 172.21.15.28:0/416093519 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35800b770 con 0x7ff35c0bd000 2023-11-28T19:32:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff362c0f640 1 --2- 172.21.15.28:0/416093519 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff35c0bd000 0x7ff35c0bddd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff35400c780 tx=0x7ff35400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff352ffd640 1 -- 172.21.15.28:0/416093519 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35400a9f0 con 0x7ff35c0bd000 2023-11-28T19:32:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff352ffd640 1 -- 172.21.15.28:0/416093519 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35400ce90 con 0x7ff35c0bd000 2023-11-28T19:32:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff352ffd640 1 -- 172.21.15.28:0/416093519 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35400add0 con 0x7ff35c0bd000 2023-11-28T19:32:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 -- 172.21.15.28:0/416093519 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff35c145750 con 0x7ff35c0bd000 2023-11-28T19:32:24.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.021+0000 7ff364672640 1 -- 172.21.15.28:0/416093519 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff35c144eb0 con 0x7ff35c0bd000 2023-11-28T19:32:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.025+0000 7ff364672640 1 -- 172.21.15.28:0/416093519 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff35c1455b0 con 0x7ff35c0bd000 2023-11-28T19:32:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.025+0000 7ff352ffd640 1 -- 172.21.15.28:0/416093519 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff354012420 con 0x7ff35c0bd000 2023-11-28T19:32:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.025+0000 7ff352ffd640 1 --2- 172.21.15.28:0/416093519 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff3400664a0 0x7ff340068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.025+0000 7ff352ffd640 1 -- 172.21.15.28:0/416093519 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff354083e20 con 0x7ff35c0bd000 2023-11-28T19:32:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.025+0000 7ff36240e640 1 --2- 172.21.15.28:0/416093519 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff3400664a0 0x7ff340068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:24.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.025+0000 7ff36240e640 1 --2- 172.21.15.28:0/416093519 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff3400664a0 0x7ff340068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff3580b3000 tx=0x7ff3580ac000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:24.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.029+0000 7ff352ffd640 1 -- 172.21.15.28:0/416093519 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff35c1455b0 con 0x7ff35c0bd000 2023-11-28T19:32:24.186 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.185+0000 7ff364672640 1 -- 172.21.15.28:0/416093519 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff35c1455b0 con 0x7ff35c0bd000 2023-11-28T19:32:24.188 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.185+0000 7ff352ffd640 1 -- 172.21.15.28:0/416093519 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+16582 (secure 0 0 0) 0x7ff35c1455b0 con 0x7ff35c0bd000 2023-11-28T19:32:24.189 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:24.189 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":31,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:32:22.870530+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:32:21.030929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T19:32:21.859160+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:32:24.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.189+0000 7ff364672640 1 -- 172.21.15.28:0/416093519 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff3400664a0 msgr2=0x7ff340068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:24.191 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.189+0000 7ff364672640 1 --2- 172.21.15.28:0/416093519 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff3400664a0 0x7ff340068960 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7ff3580b3000 tx=0x7ff3580ac000 comp rx=0 tx=0).stop 2023-11-28T19:32:24.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.189+0000 7ff364672640 1 -- 172.21.15.28:0/416093519 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff35c0bd000 msgr2=0x7ff35c0bddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:24.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.189+0000 7ff364672640 1 --2- 172.21.15.28:0/416093519 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff35c0bd000 0x7ff35c0bddd0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff35400c780 tx=0x7ff35400cc40 comp rx=0 tx=0).stop 2023-11-28T19:32:24.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.189+0000 7ff364672640 1 -- 172.21.15.28:0/416093519 shutdown_connections 2023-11-28T19:32:24.192 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.189+0000 7ff364672640 1 --2- 172.21.15.28:0/416093519 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff3400664a0 0x7ff340068960 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:24.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.189+0000 7ff364672640 1 --2- 172.21.15.28:0/416093519 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff35c0bd000 0x7ff35c0bddd0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:24.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.189+0000 7ff364672640 1 --2- 172.21.15.28:0/416093519 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff35c142510 0x7ff35c0bcac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:24.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.189+0000 7ff364672640 1 --2- 172.21.15.28:0/416093519 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff35c0ba0d0 0x7ff35c144550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:24.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.189+0000 7ff364672640 1 -- 172.21.15.28:0/416093519 >> 172.21.15.28:0/416093519 conn(0x7ff35c06b860 msgr2=0x7ff35c0b9320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:24.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.189+0000 7ff364672640 1 -- 172.21.15.28:0/416093519 shutdown_connections 2023-11-28T19:32:24.193 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.189+0000 7ff364672640 1 -- 172.21.15.28:0/416093519 wait complete. 2023-11-28T19:32:24.210 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-11-28T19:32:24.342 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b820c5640 1 Processor -- start 2023-11-28T19:32:24.343 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b820c5640 1 -- start start 2023-11-28T19:32:24.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b820c5640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6b7c0bc120 0x7f6b7c0bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:24.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b820c5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b7c072940 0x7f6b7c153c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:24.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b820c5640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b7c143b60 con 0x7f6b7c0a2d60 2023-11-28T19:32:24.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b820c5640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b7c0b6f30 con 0x7f6b7c0bc120 2023-11-28T19:32:24.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b820c5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c0b7aa0 con 0x7f6b7c072940 2023-11-28T19:32:24.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b7b7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6b7c0bc120 0x7f6b7c0bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:24.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b7bfff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b7c072940 0x7f6b7c153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:24.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b7b7fe640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6b7c0bc120 0x7f6b7c0bd0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:32940/0 (socket says 172.21.15.28:32940) 2023-11-28T19:32:24.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b7bfff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b7c072940 0x7f6b7c153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:33472/0 (socket says 172.21.15.28:33472) 2023-11-28T19:32:24.344 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b7affd640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6b7c0a2d60 0x7f6b7c14c9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:60286/0 (socket says 172.21.15.28:60286) 2023-11-28T19:32:24.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b7b7fe640 1 -- 172.21.15.28:0/3012660607 learned_addr learned my addr 172.21.15.28:0/3012660607 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:24.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b7b7fe640 1 -- 172.21.15.28:0/3012660607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b7c072940 msgr2=0x7f6b7c153c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:24.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b7b7fe640 1 --2- 172.21.15.28:0/3012660607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b7c072940 0x7f6b7c153c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:24.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b7b7fe640 1 -- 172.21.15.28:0/3012660607 >> v1:172.21.15.131:6789/0 conn(0x7f6b7c0a2d60 legacy=0x7f6b7c14c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:24.345 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.341+0000 7f6b7b7fe640 1 -- 172.21.15.28:0/3012660607 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7c0b7d60 con 0x7f6b7c0bc120 2023-11-28T19:32:24.346 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b7b7fe640 1 --2- 172.21.15.28:0/3012660607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b7c0bc120 0x7f6b7c0bd0e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0b7070 tx=0x7f6b6c01ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bddf2e32172a020d server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:24.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b7a7fc640 1 -- 172.21.15.28:0/3012660607 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c0a8a10 con 0x7f6b7c0bc120 2023-11-28T19:32:24.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b7a7fc640 1 -- 172.21.15.28:0/3012660607 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c0a8b70 con 0x7f6b7c0bc120 2023-11-28T19:32:24.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b7a7fc640 1 -- 172.21.15.28:0/3012660607 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c0b0440 con 0x7f6b7c0bc120 2023-11-28T19:32:24.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 -- 172.21.15.28:0/3012660607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b7c0bc120 msgr2=0x7f6b7c0bd0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:24.348 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 --2- 172.21.15.28:0/3012660607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b7c0bc120 0x7f6b7c0bd0e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6b7c0b7070 tx=0x7f6b6c01ed10 comp rx=0 tx=0).stop 2023-11-28T19:32:24.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 -- 172.21.15.28:0/3012660607 shutdown_connections 2023-11-28T19:32:24.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 --2- 172.21.15.28:0/3012660607 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b7c072940 0x7f6b7c153c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:24.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 --2- 172.21.15.28:0/3012660607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b7c0bc120 0x7f6b7c0bd0e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:24.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 -- 172.21.15.28:0/3012660607 >> 172.21.15.28:0/3012660607 conn(0x7f6b7c06ab80 msgr2=0x7f6b7c0bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:24.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 -- 172.21.15.28:0/3012660607 shutdown_connections 2023-11-28T19:32:24.349 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 -- 172.21.15.28:0/3012660607 wait complete. 2023-11-28T19:32:24.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 Processor -- start 2023-11-28T19:32:24.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 -- start start 2023-11-28T19:32:24.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b7c072940 0x7f6b7c13c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:24.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b7c0a2d60 0x7f6b7c149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:24.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b7c139ac0 0x7f6b7c138c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:24.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c13c590 con 0x7f6b7c0a2d60 2023-11-28T19:32:24.351 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c1e2ad0 con 0x7f6b7c139ac0 2023-11-28T19:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.345+0000 7f6b820c5640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c14a1a0 con 0x7f6b7c072940 2023-11-28T19:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b7c0a2d60 0x7f6b7c149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b7c0a2d60 0x7f6b7c149c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:52590/0 (socket says 172.21.15.28:52590) 2023-11-28T19:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b7affd640 1 -- 172.21.15.28:0/544509781 learned_addr learned my addr 172.21.15.28:0/544509781 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b7b7fe640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b7c072940 0x7f6b7c13c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b7bfff640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b7c139ac0 0x7f6b7c138c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b7affd640 1 -- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b7c072940 msgr2=0x7f6b7c13c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b7affd640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b7c072940 0x7f6b7c13c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b7affd640 1 -- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b7c139ac0 msgr2=0x7f6b7c138c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b7affd640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b7c139ac0 0x7f6b7c138c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b7affd640 1 -- 172.21.15.28:0/544509781 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6c0094d0 con 0x7f6b7c0a2d60 2023-11-28T19:32:24.352 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b7bfff640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b7c139ac0 0x7f6b7c138c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:24.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b7b7fe640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b7c072940 0x7f6b7c13c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:24.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b7affd640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b7c0a2d60 0x7f6b7c149c60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c870 tx=0x7f6b7000cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:24.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b63fff640 1 -- 172.21.15.28:0/544509781 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000a5e0 con 0x7f6b7c0a2d60 2023-11-28T19:32:24.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b63fff640 1 -- 172.21.15.28:0/544509781 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7000a740 con 0x7f6b7c0a2d60 2023-11-28T19:32:24.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b820c5640 1 -- 172.21.15.28:0/544509781 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7c1e21a0 con 0x7f6b7c0a2d60 2023-11-28T19:32:24.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b63fff640 1 -- 172.21.15.28:0/544509781 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000aaf0 con 0x7f6b7c0a2d60 2023-11-28T19:32:24.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b820c5640 1 -- 172.21.15.28:0/544509781 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7c1e2760 con 0x7f6b7c0a2d60 2023-11-28T19:32:24.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b820c5640 1 -- 172.21.15.28:0/544509781 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7c1e2c60 con 0x7f6b7c0a2d60 2023-11-28T19:32:24.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b63fff640 1 -- 172.21.15.28:0/544509781 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f6b7000ac50 con 0x7f6b7c0a2d60 2023-11-28T19:32:24.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b63fff640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6b68066470 0x7f6b68068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:24.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b63fff640 1 -- 172.21.15.28:0/544509781 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b70083ce0 con 0x7f6b7c0a2d60 2023-11-28T19:32:24.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.349+0000 7f6b7b7fe640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6b68066470 0x7f6b68068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:24.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.353+0000 7f6b7b7fe640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6b68066470 0x7f6b68068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0b2000 tx=0x7f6b6c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:24.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.353+0000 7f6b63fff640 1 -- 172.21.15.28:0/544509781 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f6b70051380 con 0x7f6b7c0a2d60 2023-11-28T19:32:24.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:24.549+0000 7f6b820c5640 1 -- 172.21.15.28:0/544509781 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6b7c074a90 con 0x7f6b7c0a2d60 2023-11-28T19:32:25.558 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.557+0000 7f6b63fff640 1 -- 172.21.15.28:0/544509781 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6b700549a0 con 0x7f6b7c0a2d60 2023-11-28T19:32:25.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.557+0000 7f6b820c5640 1 -- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6b68066470 msgr2=0x7f6b68068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.557+0000 7f6b820c5640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6b68066470 0x7f6b68068930 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0b2000 tx=0x7f6b6c008040 comp rx=0 tx=0).stop 2023-11-28T19:32:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.557+0000 7f6b820c5640 1 -- 172.21.15.28:0/544509781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b7c0a2d60 msgr2=0x7f6b7c149c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.557+0000 7f6b820c5640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b7c0a2d60 0x7f6b7c149c60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000c870 tx=0x7f6b7000cd30 comp rx=0 tx=0).stop 2023-11-28T19:32:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.557+0000 7f6b820c5640 1 -- 172.21.15.28:0/544509781 shutdown_connections 2023-11-28T19:32:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.557+0000 7f6b820c5640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f6b68066470 0x7f6b68068930 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.557+0000 7f6b820c5640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6b7c139ac0 0x7f6b7c138c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.557+0000 7f6b820c5640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f6b7c0a2d60 0x7f6b7c149c60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.557+0000 7f6b820c5640 1 --2- 172.21.15.28:0/544509781 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f6b7c072940 0x7f6b7c13c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.557+0000 7f6b820c5640 1 -- 172.21.15.28:0/544509781 >> 172.21.15.28:0/544509781 conn(0x7f6b7c06ab80 msgr2=0x7f6b7c0705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.557+0000 7f6b820c5640 1 -- 172.21.15.28:0/544509781 shutdown_connections 2023-11-28T19:32:25.562 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.557+0000 7f6b820c5640 1 -- 172.21.15.28:0/544509781 wait complete. 2023-11-28T19:32:25.584 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-11-28T19:32:25.584 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-11-28T19:32:25.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b96e2640 1 Processor -- start 2023-11-28T19:32:25.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b96e2640 1 -- start start 2023-11-28T19:32:25.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b96e2640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc5b4071a10 0x7fc5b41420e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:25.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b96e2640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc5b4072130 0x7fc5b4142620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:25.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b96e2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5b40b4b30 0x7fc5b41482a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:25.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b96e2640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b4071130 con 0x7fc5b4072130 2023-11-28T19:32:25.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b96e2640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5b4071410 con 0x7fc5b4071a10 2023-11-28T19:32:25.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b96e2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b40702d0 con 0x7fc5b40b4b30 2023-11-28T19:32:25.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b27fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc5b4072130 0x7fc5b4142620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:25.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b27fc640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc5b4072130 0x7fc5b4142620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38966/0 (socket says 172.21.15.28:38966) 2023-11-28T19:32:25.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b27fc640 1 -- 172.21.15.28:0/3046336273 learned_addr learned my addr 172.21.15.28:0/3046336273 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:25.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b2ffd640 1 --2- 172.21.15.28:0/3046336273 >> v2:172.21.15.131:3300/0 conn(0x7fc5b4071a10 0x7fc5b41420e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:25.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b37fe640 1 --2- 172.21.15.28:0/3046336273 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5b40b4b30 0x7fc5b41482a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:25.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b27fc640 1 -- 172.21.15.28:0/3046336273 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5b40b4b30 msgr2=0x7fc5b41482a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:25.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b27fc640 1 --2- 172.21.15.28:0/3046336273 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5b40b4b30 0x7fc5b41482a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:25.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b27fc640 1 -- 172.21.15.28:0/3046336273 >> v2:172.21.15.131:3300/0 conn(0x7fc5b4071a10 msgr2=0x7fc5b41420e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:25.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b27fc640 1 --2- 172.21.15.28:0/3046336273 >> v2:172.21.15.131:3300/0 conn(0x7fc5b4071a10 0x7fc5b41420e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:25.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b27fc640 1 -- 172.21.15.28:0/3046336273 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5b40705b0 con 0x7fc5b4072130 2023-11-28T19:32:25.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.713+0000 7fc5b37fe640 1 --2- 172.21.15.28:0/3046336273 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5b40b4b30 0x7fc5b41482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:25.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.717+0000 7fc5b27fc640 1 --2- 172.21.15.28:0/3046336273 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4072130 0x7fc5b4142620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc5b406f810 tx=0x7fc5a801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e43f2ea1cf23db71 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:25.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.717+0000 7fc5b1ffb640 1 -- 172.21.15.28:0/3046336273 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a80ab650 con 0x7fc5b4072130 2023-11-28T19:32:25.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.717+0000 7fc5b1ffb640 1 -- 172.21.15.28:0/3046336273 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a80ab7b0 con 0x7fc5b4072130 2023-11-28T19:32:25.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.717+0000 7fc5b1ffb640 1 -- 172.21.15.28:0/3046336273 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a80abb40 con 0x7fc5b4072130 2023-11-28T19:32:25.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.717+0000 7fc5b96e2640 1 -- 172.21.15.28:0/3046336273 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4072130 msgr2=0x7fc5b4142620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:25.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.717+0000 7fc5b96e2640 1 --2- 172.21.15.28:0/3046336273 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4072130 0x7fc5b4142620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fc5b406f810 tx=0x7fc5a801c470 comp rx=0 tx=0).stop 2023-11-28T19:32:25.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.717+0000 7fc5b96e2640 1 -- 172.21.15.28:0/3046336273 shutdown_connections 2023-11-28T19:32:25.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.717+0000 7fc5b96e2640 1 --2- 172.21.15.28:0/3046336273 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5b40b4b30 0x7fc5b41482a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:25.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.717+0000 7fc5b96e2640 1 --2- 172.21.15.28:0/3046336273 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4072130 0x7fc5b4142620 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:25.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.717+0000 7fc5b96e2640 1 --2- 172.21.15.28:0/3046336273 >> v2:172.21.15.131:3300/0 conn(0x7fc5b4071a10 0x7fc5b41420e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:25.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.717+0000 7fc5b96e2640 1 -- 172.21.15.28:0/3046336273 >> 172.21.15.28:0/3046336273 conn(0x7fc5b40bdbc0 msgr2=0x7fc5b40bdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:25.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.717+0000 7fc5b96e2640 1 -- 172.21.15.28:0/3046336273 shutdown_connections 2023-11-28T19:32:25.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.717+0000 7fc5b96e2640 1 -- 172.21.15.28:0/3046336273 wait complete. 2023-11-28T19:32:25.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b96e2640 1 Processor -- start 2023-11-28T19:32:25.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b96e2640 1 -- start start 2023-11-28T19:32:25.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b96e2640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4071a10 0x7fc5b41375d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:25.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b96e2640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5b4072130 0x7fc5b414a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:25.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b96e2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5b40b4b30 0x7fc5b41e53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:25.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b96e2640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b414b570 con 0x7fc5b4071a10 2023-11-28T19:32:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b96e2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b414ae30 con 0x7fc5b40b4b30 2023-11-28T19:32:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b96e2640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5b413d3c0 con 0x7fc5b4072130 2023-11-28T19:32:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4071a10 0x7fc5b41375d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b2ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4071a10 0x7fc5b41375d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38978/0 (socket says 172.21.15.28:38978) 2023-11-28T19:32:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b2ffd640 1 -- 172.21.15.28:0/1734663715 learned_addr learned my addr 172.21.15.28:0/1734663715 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b27fc640 1 --2- 172.21.15.28:0/1734663715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5b4072130 0x7fc5b414a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b37fe640 1 --2- 172.21.15.28:0/1734663715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5b40b4b30 0x7fc5b41e53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b2ffd640 1 -- 172.21.15.28:0/1734663715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5b4072130 msgr2=0x7fc5b414a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b2ffd640 1 --2- 172.21.15.28:0/1734663715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5b4072130 0x7fc5b414a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b2ffd640 1 -- 172.21.15.28:0/1734663715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5b40b4b30 msgr2=0x7fc5b41e53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b2ffd640 1 --2- 172.21.15.28:0/1734663715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5b40b4b30 0x7fc5b41e53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:25.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b2ffd640 1 -- 172.21.15.28:0/1734663715 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5a80094d0 con 0x7fc5b4071a10 2023-11-28T19:32:25.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b2ffd640 1 --2- 172.21.15.28:0/1734663715 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4071a10 0x7fc5b41375d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400d800 tx=0x7fc5a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:25.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc59b7fe640 1 -- 172.21.15.28:0/1734663715 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a400b6c0 con 0x7fc5b4071a10 2023-11-28T19:32:25.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc59b7fe640 1 -- 172.21.15.28:0/1734663715 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5a400b820 con 0x7fc5b4071a10 2023-11-28T19:32:25.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b96e2640 1 -- 172.21.15.28:0/1734663715 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5b41492b0 con 0x7fc5b4071a10 2023-11-28T19:32:25.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc59b7fe640 1 -- 172.21.15.28:0/1734663715 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5a400bb90 con 0x7fc5b4071a10 2023-11-28T19:32:25.726 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b96e2640 1 -- 172.21.15.28:0/1734663715 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5b413ce70 con 0x7fc5b4071a10 2023-11-28T19:32:25.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc5b96e2640 1 -- 172.21.15.28:0/1734663715 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5b41e5200 con 0x7fc5b4071a10 2023-11-28T19:32:25.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc59b7fe640 1 -- 172.21.15.28:0/1734663715 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc5a400bcf0 con 0x7fc5b4071a10 2023-11-28T19:32:25.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc59b7fe640 1 --2- 172.21.15.28:0/1734663715 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc5a0066470 0x7fc5a0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:25.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.721+0000 7fc59b7fe640 1 -- 172.21.15.28:0/1734663715 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc5a40843c0 con 0x7fc5b4071a10 2023-11-28T19:32:25.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.725+0000 7fc5b27fc640 1 --2- 172.21.15.28:0/1734663715 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc5a0066470 0x7fc5a0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:25.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.725+0000 7fc5b27fc640 1 --2- 172.21.15.28:0/1734663715 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc5a0066470 0x7fc5a0068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80af000 tx=0x7fc5a80a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:25.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.729+0000 7fc59b7fe640 1 -- 172.21.15.28:0/1734663715 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc5a4051830 con 0x7fc5b4071a10 2023-11-28T19:32:25.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:25.921+0000 7fc5b96e2640 1 -- 172.21.15.28:0/1734663715 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fc5b413c9f0 con 0x7fc5b4071a10 2023-11-28T19:32:26.466 INFO:tasks.ceph.mds.a.smithi028.stderr:2023-11-28T19:32:26.461+0000 7f47969a6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-11-28T19:32:26.561 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.557+0000 7fc59b7fe640 1 -- 172.21.15.28:0/1734663715 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc5b413c9f0 con 0x7fc5b4071a10 2023-11-28T19:32:26.564 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.561+0000 7fc5b96e2640 1 -- 172.21.15.28:0/1734663715 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc5a0066470 msgr2=0x7fc5a0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:26.564 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.561+0000 7fc5b96e2640 1 --2- 172.21.15.28:0/1734663715 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc5a0066470 0x7fc5a0068930 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc5a80af000 tx=0x7fc5a80a7000 comp rx=0 tx=0).stop 2023-11-28T19:32:26.564 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.561+0000 7fc5b96e2640 1 -- 172.21.15.28:0/1734663715 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4071a10 msgr2=0x7fc5b41375d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.561+0000 7fc5b96e2640 1 --2- 172.21.15.28:0/1734663715 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4071a10 0x7fc5b41375d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fc5a400d800 tx=0x7fc5a400dcc0 comp rx=0 tx=0).stop 2023-11-28T19:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.561+0000 7fc5b96e2640 1 -- 172.21.15.28:0/1734663715 shutdown_connections 2023-11-28T19:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.561+0000 7fc5b96e2640 1 --2- 172.21.15.28:0/1734663715 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc5a0066470 0x7fc5a0068930 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.561+0000 7fc5b96e2640 1 --2- 172.21.15.28:0/1734663715 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc5b40b4b30 0x7fc5b41e53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.561+0000 7fc5b96e2640 1 --2- 172.21.15.28:0/1734663715 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc5b4072130 0x7fc5b414a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.561+0000 7fc5b96e2640 1 --2- 172.21.15.28:0/1734663715 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc5b4071a10 0x7fc5b41375d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.561+0000 7fc5b96e2640 1 -- 172.21.15.28:0/1734663715 >> 172.21.15.28:0/1734663715 conn(0x7fc5b40bdbc0 msgr2=0x7fc5b40bbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.561+0000 7fc5b96e2640 1 -- 172.21.15.28:0/1734663715 shutdown_connections 2023-11-28T19:32:26.565 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.561+0000 7fc5b96e2640 1 -- 172.21.15.28:0/1734663715 wait complete. 2023-11-28T19:32:26.589 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-11-28T19:32:26.589 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:32:26.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.713+0000 7f0e511c4640 1 Processor -- start 2023-11-28T19:32:26.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.713+0000 7f0e511c4640 1 -- start start 2023-11-28T19:32:26.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.717+0000 7f0e511c4640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0e4c142560 0x7f0e4c0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:26.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.717+0000 7f0e511c4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e4c0b4610 0x7f0e4c0b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:26.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.717+0000 7f0e511c4640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e4c0b4aa0 con 0x7f0e4c0b5dd0 2023-11-28T19:32:26.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.717+0000 7f0e511c4640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4c06f950 con 0x7f0e4c142560 2023-11-28T19:32:26.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.717+0000 7f0e511c4640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0b70c0 con 0x7f0e4c0b4610 2023-11-28T19:32:26.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.717+0000 7f0e4b59e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e4c0b4610 0x7f0e4c0b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:26.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.717+0000 7f0e4ad9d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0e4c142560 0x7f0e4c0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:26.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.717+0000 7f0e4b59e640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e4c0b4610 0x7f0e4c0b6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:47434/0 (socket says 172.21.15.28:47434) 2023-11-28T19:32:26.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.717+0000 7f0e4b59e640 1 -- 172.21.15.28:0/2960203573 learned_addr learned my addr 172.21.15.28:0/2960203573 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:26.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.717+0000 7f0e4ad9d640 1 -- 172.21.15.28:0/2960203573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e4c0b4610 msgr2=0x7f0e4c0b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:26.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.717+0000 7f0e4ad9d640 1 --2- 172.21.15.28:0/2960203573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e4c0b4610 0x7f0e4c0b6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:26.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.717+0000 7f0e4ad9d640 1 -- 172.21.15.28:0/2960203573 >> v1:172.21.15.131:6789/0 conn(0x7f0e4c0b5dd0 legacy=0x7f0e4c0b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:26.720 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.717+0000 7f0e4ad9d640 1 -- 172.21.15.28:0/2960203573 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c142940 con 0x7f0e4c142560 2023-11-28T19:32:26.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.717+0000 7f0e4ad9d640 1 --2- 172.21.15.28:0/2960203573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e4c142560 0x7f0e4c0b40d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0097c0 tx=0x7f0e3c01ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6c1df61095d0449 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:26.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e49d9b640 1 -- 172.21.15.28:0/2960203573 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0a8970 con 0x7f0e4c142560 2023-11-28T19:32:26.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e49d9b640 1 -- 172.21.15.28:0/2960203573 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c0a8ad0 con 0x7f0e4c142560 2023-11-28T19:32:26.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e49d9b640 1 -- 172.21.15.28:0/2960203573 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c0a8e60 con 0x7f0e4c142560 2023-11-28T19:32:26.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 -- 172.21.15.28:0/2960203573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e4c142560 msgr2=0x7f0e4c0b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:26.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 --2- 172.21.15.28:0/2960203573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e4c142560 0x7f0e4c0b40d0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0097c0 tx=0x7f0e3c01ec70 comp rx=0 tx=0).stop 2023-11-28T19:32:26.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 -- 172.21.15.28:0/2960203573 shutdown_connections 2023-11-28T19:32:26.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 --2- 172.21.15.28:0/2960203573 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e4c0b4610 0x7f0e4c0b6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:26.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 --2- 172.21.15.28:0/2960203573 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e4c142560 0x7f0e4c0b40d0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:26.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 -- 172.21.15.28:0/2960203573 >> 172.21.15.28:0/2960203573 conn(0x7f0e4c0bcb40 msgr2=0x7f0e4c0bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:26.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 -- 172.21.15.28:0/2960203573 shutdown_connections 2023-11-28T19:32:26.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 -- 172.21.15.28:0/2960203573 wait complete. 2023-11-28T19:32:26.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 Processor -- start 2023-11-28T19:32:26.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 -- start start 2023-11-28T19:32:26.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e4c0b4610 0x7f0e4c141270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:26.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c0b5dd0 0x7f0e4c0bbbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:26.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e4c142560 0x7f0e4c1e02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:26.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c0bc130 con 0x7f0e4c0b5dd0 2023-11-28T19:32:26.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c1e0800 con 0x7f0e4c0b4610 2023-11-28T19:32:26.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4c149bf0 con 0x7f0e4c142560 2023-11-28T19:32:26.728 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e4a59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c0b5dd0 0x7f0e4c0bbbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:26.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e4a59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c0b5dd0 0x7f0e4c0bbbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38984/0 (socket says 172.21.15.28:38984) 2023-11-28T19:32:26.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e4a59c640 1 -- 172.21.15.28:0/798081712 learned_addr learned my addr 172.21.15.28:0/798081712 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:26.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e4b59e640 1 --2- 172.21.15.28:0/798081712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e4c142560 0x7f0e4c1e02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:26.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e4ad9d640 1 --2- 172.21.15.28:0/798081712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e4c0b4610 0x7f0e4c141270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:26.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e4a59c640 1 -- 172.21.15.28:0/798081712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e4c142560 msgr2=0x7f0e4c1e02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:26.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e4a59c640 1 --2- 172.21.15.28:0/798081712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e4c142560 0x7f0e4c1e02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:26.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e4a59c640 1 -- 172.21.15.28:0/798081712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e4c0b4610 msgr2=0x7f0e4c141270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:26.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e4a59c640 1 --2- 172.21.15.28:0/798081712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e4c0b4610 0x7f0e4c141270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:26.729 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e4a59c640 1 -- 172.21.15.28:0/798081712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c009420 con 0x7f0e4c0b5dd0 2023-11-28T19:32:26.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e4a59c640 1 --2- 172.21.15.28:0/798081712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c0b5dd0 0x7f0e4c0bbbf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000c4d0 tx=0x7f0e4000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:26.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e337fe640 1 -- 172.21.15.28:0/798081712 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e400052d0 con 0x7f0e4c0b5dd0 2023-11-28T19:32:26.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e337fe640 1 -- 172.21.15.28:0/798081712 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e40005430 con 0x7f0e4c0b5dd0 2023-11-28T19:32:26.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.721+0000 7f0e511c4640 1 -- 172.21.15.28:0/798081712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e4c149ed0 con 0x7f0e4c0b5dd0 2023-11-28T19:32:26.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.725+0000 7f0e337fe640 1 -- 172.21.15.28:0/798081712 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e40012830 con 0x7f0e4c0b5dd0 2023-11-28T19:32:26.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.725+0000 7f0e511c4640 1 -- 172.21.15.28:0/798081712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e4c0bc310 con 0x7f0e4c0b5dd0 2023-11-28T19:32:26.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.725+0000 7f0e511c4640 1 -- 172.21.15.28:0/798081712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4c074a90 con 0x7f0e4c0b5dd0 2023-11-28T19:32:26.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.725+0000 7f0e337fe640 1 -- 172.21.15.28:0/798081712 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0e40012990 con 0x7f0e4c0b5dd0 2023-11-28T19:32:26.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.725+0000 7f0e337fe640 1 --2- 172.21.15.28:0/798081712 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0e38066470 0x7f0e38068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:26.730 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.725+0000 7f0e337fe640 1 -- 172.21.15.28:0/798081712 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e40083b10 con 0x7f0e4c0b5dd0 2023-11-28T19:32:26.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.725+0000 7f0e4ad9d640 1 --2- 172.21.15.28:0/798081712 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0e38066470 0x7f0e38068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:26.731 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.725+0000 7f0e4ad9d640 1 --2- 172.21.15.28:0/798081712 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0e38066470 0x7f0e38068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0b2000 tx=0x7f0e3c008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:26.732 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.729+0000 7f0e337fe640 1 -- 172.21.15.28:0/798081712 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f0e40050e60 con 0x7f0e4c0b5dd0 2023-11-28T19:32:26.922 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.921+0000 7f0e511c4640 1 -- 172.21.15.28:0/798081712 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e4c0b9220 con 0x7f0e4c0b5dd0 2023-11-28T19:32:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.921+0000 7f0e337fe640 1 -- 172.21.15.28:0/798081712 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4125 (secure 0 0 0) 0x7f0e40054480 con 0x7f0e4c0b5dd0 2023-11-28T19:32:26.923 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:26.923 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4514,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1377411437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1377411437},{"type":"v1","addr":"172.21.15.131:6835","nonce":1377411437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4672,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1536974468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1536974468},{"type":"v1","addr":"172.21.15.28:6835","nonce":1536974468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:32:22.871529+0000","modified":"2023-11-28T19:32:25.923656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6834/1057392898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1057392898},{"type":"v1","addr":"172.21.15.28:6834","nonce":1057392898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T19:32:26.923 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 16 2023-11-28T19:32:26.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.921+0000 7f0e511c4640 1 -- 172.21.15.28:0/798081712 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0e38066470 msgr2=0x7f0e38068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:26.925 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.921+0000 7f0e511c4640 1 --2- 172.21.15.28:0/798081712 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0e38066470 0x7f0e38068930 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c0b2000 tx=0x7f0e3c008040 comp rx=0 tx=0).stop 2023-11-28T19:32:26.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.921+0000 7f0e511c4640 1 -- 172.21.15.28:0/798081712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c0b5dd0 msgr2=0x7f0e4c0bbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:26.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.921+0000 7f0e511c4640 1 --2- 172.21.15.28:0/798081712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c0b5dd0 0x7f0e4c0bbbf0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f0e4000c4d0 tx=0x7f0e4000c990 comp rx=0 tx=0).stop 2023-11-28T19:32:26.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.921+0000 7f0e511c4640 1 -- 172.21.15.28:0/798081712 shutdown_connections 2023-11-28T19:32:26.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.921+0000 7f0e511c4640 1 --2- 172.21.15.28:0/798081712 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0e38066470 0x7f0e38068930 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:26.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.921+0000 7f0e511c4640 1 --2- 172.21.15.28:0/798081712 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f0e4c142560 0x7f0e4c1e02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:26.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.921+0000 7f0e511c4640 1 --2- 172.21.15.28:0/798081712 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f0e4c0b5dd0 0x7f0e4c0bbbf0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:26.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.921+0000 7f0e511c4640 1 --2- 172.21.15.28:0/798081712 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e4c0b4610 0x7f0e4c141270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:26.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.921+0000 7f0e511c4640 1 -- 172.21.15.28:0/798081712 >> 172.21.15.28:0/798081712 conn(0x7f0e4c0bcb40 msgr2=0x7f0e4c0b9440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:26.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.921+0000 7f0e511c4640 1 -- 172.21.15.28:0/798081712 shutdown_connections 2023-11-28T19:32:26.926 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:26.921+0000 7f0e511c4640 1 -- 172.21.15.28:0/798081712 wait complete. 2023-11-28T19:32:26.943 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-11-28T19:32:27.057 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.053+0000 7ff7d4f93640 1 Processor -- start 2023-11-28T19:32:27.058 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.053+0000 7ff7d4f93640 1 -- start start 2023-11-28T19:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.057+0000 7ff7d4f93640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7d0072490 0x7ff7d00b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.057+0000 7ff7d4f93640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff7d0072870 0x7ff7d014b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.057+0000 7ff7d4f93640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d00b6a30 con 0x7ff7d014bec0 2023-11-28T19:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.057+0000 7ff7d4f93640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d00b50a0 con 0x7ff7d0072870 2023-11-28T19:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.057+0000 7ff7d4f93640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d014c350 con 0x7ff7d0072490 2023-11-28T19:32:27.059 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.057+0000 7ff7cdd9b640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff7d0072870 0x7ff7d014b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.057+0000 7ff7ce59c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7d0072490 0x7ff7d00b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.057+0000 7ff7ced9d640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7ff7d014bec0 0x7ff7d014eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:51706/0 (socket says 172.21.15.28:51706) 2023-11-28T19:32:27.060 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.057+0000 7ff7ced9d640 1 -- 172.21.15.28:0/1131340235 learned_addr learned my addr 172.21.15.28:0/1131340235 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.057+0000 7ff7cdd9b640 1 -- 172.21.15.28:0/1131340235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7d0072490 msgr2=0x7ff7d00b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.057+0000 7ff7cdd9b640 1 --2- 172.21.15.28:0/1131340235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7d0072490 0x7ff7d00b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.057+0000 7ff7cdd9b640 1 -- 172.21.15.28:0/1131340235 >> v1:172.21.15.131:6789/0 conn(0x7ff7d014bec0 legacy=0x7ff7d014eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.061 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.057+0000 7ff7cdd9b640 1 -- 172.21.15.28:0/1131340235 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d00b5840 con 0x7ff7d0072870 2023-11-28T19:32:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7cdd9b640 1 --2- 172.21.15.28:0/1131340235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7d0072870 0x7ff7d014b980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40097c0 tx=0x7ff7c401c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4c0c79fc5e40f62 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7cd59a640 1 -- 172.21.15.28:0/1131340235 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40ab600 con 0x7ff7d0072870 2023-11-28T19:32:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7cd59a640 1 -- 172.21.15.28:0/1131340235 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c40a7050 con 0x7ff7d0072870 2023-11-28T19:32:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7cd59a640 1 -- 172.21.15.28:0/1131340235 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c40ab980 con 0x7ff7d0072870 2023-11-28T19:32:27.063 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 -- 172.21.15.28:0/1131340235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7d0072870 msgr2=0x7ff7d014b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 --2- 172.21.15.28:0/1131340235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7d0072870 0x7ff7d014b980 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40097c0 tx=0x7ff7c401c480 comp rx=0 tx=0).stop 2023-11-28T19:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 -- 172.21.15.28:0/1131340235 shutdown_connections 2023-11-28T19:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 --2- 172.21.15.28:0/1131340235 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7d0072870 0x7ff7d014b980 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 --2- 172.21.15.28:0/1131340235 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7d0072490 0x7ff7d00b44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 -- 172.21.15.28:0/1131340235 >> 172.21.15.28:0/1131340235 conn(0x7ff7d00bcb40 msgr2=0x7ff7d00bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 -- 172.21.15.28:0/1131340235 shutdown_connections 2023-11-28T19:32:27.064 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 -- 172.21.15.28:0/1131340235 wait complete. 2023-11-28T19:32:27.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 Processor -- start 2023-11-28T19:32:27.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 -- start start 2023-11-28T19:32:27.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7d0072490 0x7ff7d013cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7d0072870 0x7ff7d01e4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.067 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7d014bec0 0x7ff7d0144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d0145160 con 0x7ff7d0072490 2023-11-28T19:32:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d01455b0 con 0x7ff7d014bec0 2023-11-28T19:32:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7d4f93640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d01e42f0 con 0x7ff7d0072870 2023-11-28T19:32:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7ce59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7d0072490 0x7ff7d013cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.068 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7ce59c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7d0072490 0x7ff7d013cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38986/0 (socket says 172.21.15.28:38986) 2023-11-28T19:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7ce59c640 1 -- 172.21.15.28:0/2676864021 learned_addr learned my addr 172.21.15.28:0/2676864021 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7ced9d640 1 --2- 172.21.15.28:0/2676864021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7d014bec0 0x7ff7d0144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7cdd9b640 1 --2- 172.21.15.28:0/2676864021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7d0072870 0x7ff7d01e4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7ce59c640 1 -- 172.21.15.28:0/2676864021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7d0072870 msgr2=0x7ff7d01e4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7ce59c640 1 --2- 172.21.15.28:0/2676864021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7d0072870 0x7ff7d01e4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7ce59c640 1 -- 172.21.15.28:0/2676864021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7d014bec0 msgr2=0x7ff7d0144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7ce59c640 1 --2- 172.21.15.28:0/2676864021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7d014bec0 0x7ff7d0144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7ce59c640 1 -- 172.21.15.28:0/2676864021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7c4009420 con 0x7ff7d0072490 2023-11-28T19:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.061+0000 7ff7ce59c640 1 --2- 172.21.15.28:0/2676864021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7d0072490 0x7ff7d013cf90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000e870 tx=0x7ff7c000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.065+0000 7ff7beffd640 1 -- 172.21.15.28:0/2676864021 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0009510 con 0x7ff7d0072490 2023-11-28T19:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.065+0000 7ff7beffd640 1 -- 172.21.15.28:0/2676864021 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c000eec0 con 0x7ff7d0072490 2023-11-28T19:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.065+0000 7ff7d4f93640 1 -- 172.21.15.28:0/2676864021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d006fd20 con 0x7ff7d0072490 2023-11-28T19:32:27.069 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.065+0000 7ff7beffd640 1 -- 172.21.15.28:0/2676864021 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c000cb40 con 0x7ff7d0072490 2023-11-28T19:32:27.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.065+0000 7ff7d4f93640 1 -- 172.21.15.28:0/2676864021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d014cad0 con 0x7ff7d0072490 2023-11-28T19:32:27.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.065+0000 7ff7d4f93640 1 -- 172.21.15.28:0/2676864021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d0074a90 con 0x7ff7d0072490 2023-11-28T19:32:27.070 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.065+0000 7ff7beffd640 1 -- 172.21.15.28:0/2676864021 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ff7c000cca0 con 0x7ff7d0072490 2023-11-28T19:32:27.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.065+0000 7ff7beffd640 1 --2- 172.21.15.28:0/2676864021 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff7b0066470 0x7ff7b0068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.065+0000 7ff7beffd640 1 -- 172.21.15.28:0/2676864021 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7c0083f60 con 0x7ff7d0072490 2023-11-28T19:32:27.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.065+0000 7ff7cdd9b640 1 --2- 172.21.15.28:0/2676864021 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff7b0066470 0x7ff7b0068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.071 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.065+0000 7ff7cdd9b640 1 --2- 172.21.15.28:0/2676864021 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff7b0066470 0x7ff7b0068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40ad000 tx=0x7ff7c4008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:27.072 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.069+0000 7ff7beffd640 1 -- 172.21.15.28:0/2676864021 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ff7c00513d0 con 0x7ff7d0072490 2023-11-28T19:32:27.223 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.221+0000 7ff7d4f93640 1 -- 172.21.15.28:0/2676864021 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff7d006d7c0 con 0x7ff7d0072490 2023-11-28T19:32:27.224 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.221+0000 7ff7beffd640 1 -- 172.21.15.28:0/2676864021 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16569 (secure 0 0 0) 0x7ff7c00549f0 con 0x7ff7d0072490 2023-11-28T19:32:27.225 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:27.225 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":32,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","created":"2023-11-28T19:31:20.368233+0000","modified":"2023-11-28T19:32:24.500919+0000","last_up_change":"2023-11-28T19:31:31.805891+0000","last_in_change":"2023-11-28T19:31:22.643528+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-11-28T19:31:33.212362+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-11-28T19:32:21.030929+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-11-28T19:32:21.859160+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"7c2e19c0-083a-4949-8be8-81932073d757","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6818","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6820","nonce":1448487468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6822","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6824","nonce":1448487468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6830","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6831","nonce":1448487468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6827","nonce":1448487468},{"type":"v1","addr":"172.21.15.28:6829","nonce":1448487468}]},"public_addr":"172.21.15.28:6820/1448487468","cluster_addr":"172.21.15.28:6824/1448487468","heartbeat_back_addr":"172.21.15.28:6831/1448487468","heartbeat_front_addr":"172.21.15.28:6829/1448487468","state":["exists","up"]},{"osd":1,"uuid":"471c9241-1021-4b2d-b0a6-9881e0dbdd05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6803","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6805","nonce":3480750679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6806","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6808","nonce":3480750679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6812","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6814","nonce":3480750679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6809","nonce":3480750679},{"type":"v1","addr":"172.21.15.28:6811","nonce":3480750679}]},"public_addr":"172.21.15.28:6805/3480750679","cluster_addr":"172.21.15.28:6808/3480750679","heartbeat_back_addr":"172.21.15.28:6814/3480750679","heartbeat_front_addr":"172.21.15.28:6811/3480750679","state":["exists","up"]},{"osd":2,"uuid":"e67b151c-c6ca-4edd-9314-bbdfc38e7ba0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6816","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6817","nonce":1703441975}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6819","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6821","nonce":1703441975}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6826","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6828","nonce":1703441975}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6823","nonce":1703441975},{"type":"v1","addr":"172.21.15.28:6825","nonce":1703441975}]},"public_addr":"172.21.15.28:6817/1703441975","cluster_addr":"172.21.15.28:6821/1703441975","heartbeat_back_addr":"172.21.15.28:6828/1703441975","heartbeat_front_addr":"172.21.15.28:6825/1703441975","state":["exists","up"]},{"osd":3,"uuid":"9f551835-7aa2-43ed-8754-c1acb7f717b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6800","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6801","nonce":2167220471}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6802","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6804","nonce":2167220471}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6813","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6815","nonce":2167220471}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6807","nonce":2167220471},{"type":"v1","addr":"172.21.15.28:6810","nonce":2167220471}]},"public_addr":"172.21.15.28:6801/2167220471","cluster_addr":"172.21.15.28:6804/2167220471","heartbeat_back_addr":"172.21.15.28:6815/2167220471","heartbeat_front_addr":"172.21.15.28:6810/2167220471","state":["exists","up"]},{"osd":4,"uuid":"704110d8-2b94-4f9a-b657-15390cc62a7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6825","nonce":2551002532}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6827","nonce":2551002532}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6831","nonce":2551002532}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":2551002532},{"type":"v1","addr":"172.21.15.131:6829","nonce":2551002532}]},"public_addr":"172.21.15.131:6825/2551002532","cluster_addr":"172.21.15.131:6827/2551002532","heartbeat_back_addr":"172.21.15.131:6831/2551002532","heartbeat_front_addr":"172.21.15.131:6829/2551002532","state":["exists","up"]},{"osd":5,"uuid":"f4e1867f-6cc0-4017-b594-969b1f146bf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6804","nonce":233786301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6809","nonce":233786301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6815","nonce":233786301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6811","nonce":233786301},{"type":"v1","addr":"172.21.15.131:6813","nonce":233786301}]},"public_addr":"172.21.15.131:6804/233786301","cluster_addr":"172.21.15.131:6809/233786301","heartbeat_back_addr":"172.21.15.131:6815/233786301","heartbeat_front_addr":"172.21.15.131:6813/233786301","state":["exists","up"]},{"osd":6,"uuid":"d3038de4-3fa3-4d8c-b08f-5d0efbe6e467","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6817","nonce":1372656990}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6819","nonce":1372656990}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6823","nonce":1372656990}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1372656990},{"type":"v1","addr":"172.21.15.131:6821","nonce":1372656990}]},"public_addr":"172.21.15.131:6817/1372656990","cluster_addr":"172.21.15.131:6819/1372656990","heartbeat_back_addr":"172.21.15.131:6823/1372656990","heartbeat_front_addr":"172.21.15.131:6821/1372656990","state":["exists","up"]},{"osd":7,"uuid":"542040e3-4f8c-4a46-83bf-33a8f0964140","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6801","nonce":1919068763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6803","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6805","nonce":1919068763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6812","nonce":1919068763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6807","nonce":1919068763},{"type":"v1","addr":"172.21.15.131:6808","nonce":1919068763}]},"public_addr":"172.21.15.131:6801/1919068763","cluster_addr":"172.21.15.131:6805/1919068763","heartbeat_back_addr":"172.21.15.131:6812/1919068763","heartbeat_front_addr":"172.21.15.131:6808/1919068763","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.254433+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.243630+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.219199+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.195712+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.183957+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.320899+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.268811+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-11-28T19:31:28.187980+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-11-28T19:32:27.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.225+0000 7ff7d4f93640 1 -- 172.21.15.28:0/2676864021 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff7b0066470 msgr2=0x7ff7b0068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.225+0000 7ff7d4f93640 1 --2- 172.21.15.28:0/2676864021 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff7b0066470 0x7ff7b0068930 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7ff7c40ad000 tx=0x7ff7c4008040 comp rx=0 tx=0).stop 2023-11-28T19:32:27.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.225+0000 7ff7d4f93640 1 -- 172.21.15.28:0/2676864021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7d0072490 msgr2=0x7ff7d013cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.225+0000 7ff7d4f93640 1 --2- 172.21.15.28:0/2676864021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7d0072490 0x7ff7d013cf90 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000e870 tx=0x7ff7c000ec70 comp rx=0 tx=0).stop 2023-11-28T19:32:27.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.225+0000 7ff7d4f93640 1 -- 172.21.15.28:0/2676864021 shutdown_connections 2023-11-28T19:32:27.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.225+0000 7ff7d4f93640 1 --2- 172.21.15.28:0/2676864021 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ff7b0066470 0x7ff7b0068930 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.225+0000 7ff7d4f93640 1 --2- 172.21.15.28:0/2676864021 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7d014bec0 0x7ff7d0144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.225+0000 7ff7d4f93640 1 --2- 172.21.15.28:0/2676864021 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ff7d0072870 0x7ff7d01e4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.225+0000 7ff7d4f93640 1 --2- 172.21.15.28:0/2676864021 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ff7d0072490 0x7ff7d013cf90 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.227 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.225+0000 7ff7d4f93640 1 -- 172.21.15.28:0/2676864021 >> 172.21.15.28:0/2676864021 conn(0x7ff7d00bcb40 msgr2=0x7ff7d014ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:27.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.225+0000 7ff7d4f93640 1 -- 172.21.15.28:0/2676864021 shutdown_connections 2023-11-28T19:32:27.228 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.225+0000 7ff7d4f93640 1 -- 172.21.15.28:0/2676864021 wait complete. 2023-11-28T19:32:27.243 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-11-28T19:32:27.244 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T19:32:27.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.349+0000 7f7dc5930640 1 Processor -- start 2023-11-28T19:32:27.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.349+0000 7f7dc5930640 1 -- start start 2023-11-28T19:32:27.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dc5930640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7dc006ab60 0x7f7dc014b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dc5930640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dc00bbad0 0x7f7dc00a6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dc5930640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7dc006af40 0x7f7dc00a6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dc5930640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc00bd5d0 con 0x7f7dc006ab60 2023-11-28T19:32:27.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dc5930640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dc00bce60 con 0x7f7dc006af40 2023-11-28T19:32:27.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dc5930640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc00a6b70 con 0x7f7dc00bbad0 2023-11-28T19:32:27.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dbeffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7dc006ab60 0x7f7dc014b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dbeffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f7dc006ab60 0x7f7dc014b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38988/0 (socket says 172.21.15.28:38988) 2023-11-28T19:32:27.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dbeffd640 1 -- 172.21.15.28:0/2333997419 learned_addr learned my addr 172.21.15.28:0/2333997419 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:27.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dbeffd640 1 -- 172.21.15.28:0/2333997419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dc00bbad0 msgr2=0x7f7dc00a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:27.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dbeffd640 1 --2- 172.21.15.28:0/2333997419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dc00bbad0 0x7f7dc00a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dbeffd640 1 -- 172.21.15.28:0/2333997419 >> v2:172.21.15.131:3300/0 conn(0x7f7dc006af40 msgr2=0x7f7dc00a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:27.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dbeffd640 1 --2- 172.21.15.28:0/2333997419 >> v2:172.21.15.131:3300/0 conn(0x7f7dc006af40 0x7f7dc00a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.356 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dbeffd640 1 -- 172.21.15.28:0/2333997419 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc00bff70 con 0x7f7dc006ab60 2023-11-28T19:32:27.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dbeffd640 1 --2- 172.21.15.28:0/2333997419 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dc006ab60 0x7f7dc014b5f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7dc014fb90 tx=0x7f7db001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a625e0efe9108cfe server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:27.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dbdffb640 1 -- 172.21.15.28:0/2333997419 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db00ac600 con 0x7f7dc006ab60 2023-11-28T19:32:27.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dbdffb640 1 -- 172.21.15.28:0/2333997419 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db00a8050 con 0x7f7dc006ab60 2023-11-28T19:32:27.357 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.353+0000 7f7dbdffb640 1 -- 172.21.15.28:0/2333997419 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db00ac980 con 0x7f7dc006ab60 2023-11-28T19:32:27.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 -- 172.21.15.28:0/2333997419 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dc006ab60 msgr2=0x7f7dc014b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 --2- 172.21.15.28:0/2333997419 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dc006ab60 0x7f7dc014b5f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f7dc014fb90 tx=0x7f7db001c4d0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.358 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 -- 172.21.15.28:0/2333997419 shutdown_connections 2023-11-28T19:32:27.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 --2- 172.21.15.28:0/2333997419 >> v2:172.21.15.131:3300/0 conn(0x7f7dc006af40 0x7f7dc00a6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 --2- 172.21.15.28:0/2333997419 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dc00bbad0 0x7f7dc00a6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 --2- 172.21.15.28:0/2333997419 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dc006ab60 0x7f7dc014b5f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 -- 172.21.15.28:0/2333997419 >> 172.21.15.28:0/2333997419 conn(0x7f7dc00c0c90 msgr2=0x7f7dc00c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:27.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 -- 172.21.15.28:0/2333997419 shutdown_connections 2023-11-28T19:32:27.359 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 -- 172.21.15.28:0/2333997419 wait complete. 2023-11-28T19:32:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 Processor -- start 2023-11-28T19:32:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 -- start start 2023-11-28T19:32:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dc006ab60 0x7f7dc014d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dc006af40 0x7f7dc01e79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dc00bbad0 0x7f7dc00b4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc009af90 con 0x7f7dc00bbad0 2023-11-28T19:32:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc014dda0 con 0x7f7dc006ab60 2023-11-28T19:32:27.360 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dc01e7550 con 0x7f7dc006af40 2023-11-28T19:32:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dbf7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dc00bbad0 0x7f7dc00b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dbf7fe640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dc00bbad0 0x7f7dc00b4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38990/0 (socket says 172.21.15.28:38990) 2023-11-28T19:32:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dbf7fe640 1 -- 172.21.15.28:0/1827851709 learned_addr learned my addr 172.21.15.28:0/1827851709 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dbeffd640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dc006ab60 0x7f7dc014d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.361 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dbe7fc640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dc006af40 0x7f7dc01e79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dbf7fe640 1 -- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dc006af40 msgr2=0x7f7dc01e79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.362 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dbf7fe640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dc006af40 0x7f7dc01e79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dbf7fe640 1 -- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dc006ab60 msgr2=0x7f7dc014d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dbf7fe640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dc006ab60 0x7f7dc014d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dbf7fe640 1 -- 172.21.15.28:0/1827851709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7db00094d0 con 0x7f7dc00bbad0 2023-11-28T19:32:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dbe7fc640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dc006af40 0x7f7dc01e79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dbf7fe640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dc00bbad0 0x7f7dc00b4660 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7db800b970 tx=0x7f7db800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7da7fff640 1 -- 172.21.15.28:0/1827851709 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db800cae0 con 0x7f7dc00bbad0 2023-11-28T19:32:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7da7fff640 1 -- 172.21.15.28:0/1827851709 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7db800cc60 con 0x7f7dc00bbad0 2023-11-28T19:32:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 -- 172.21.15.28:0/1827851709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dc01e7f20 con 0x7f7dc00bbad0 2023-11-28T19:32:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7da7fff640 1 -- 172.21.15.28:0/1827851709 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7db8014440 con 0x7f7dc00bbad0 2023-11-28T19:32:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.357+0000 7f7dc5930640 1 -- 172.21.15.28:0/1827851709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dc009acb0 con 0x7f7dc00bbad0 2023-11-28T19:32:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.361+0000 7f7dc5930640 1 -- 172.21.15.28:0/1827851709 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dc01e7700 con 0x7f7dc00bbad0 2023-11-28T19:32:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.361+0000 7f7da7fff640 1 -- 172.21.15.28:0/1827851709 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f7db801d3b0 con 0x7f7dc00bbad0 2023-11-28T19:32:27.363 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.361+0000 7f7da7fff640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f7dac0664a0 0x7f7dac068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.361+0000 7f7da7fff640 1 -- 172.21.15.28:0/1827851709 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7db8083c40 con 0x7f7dc00bbad0 2023-11-28T19:32:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.361+0000 7f7dbeffd640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f7dac0664a0 0x7f7dac068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.364 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.361+0000 7f7dbeffd640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f7dac0664a0 0x7f7dac068960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7db00ae000 tx=0x7f7db00a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:27.367 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.365+0000 7f7da7fff640 1 -- 172.21.15.28:0/1827851709 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f7dc01e7700 con 0x7f7dc00bbad0 2023-11-28T19:32:27.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.513+0000 7f7dc5930640 1 -- 172.21.15.28:0/1827851709 --> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7dc01e76c0 con 0x7f7dac0664a0 2023-11-28T19:32:27.533 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.529+0000 7f7da7fff640 1 -- 172.21.15.28:0/1827851709 <== mgr.4100 v2:172.21.15.131:6832/3367043860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252090 (secure 0 0 0) 0x7f7dc01e76c0 con 0x7f7dac0664a0 2023-11-28T19:32:27.536 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:27.537 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-28T19:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.533+0000 7f7dc5930640 1 -- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f7dac0664a0 msgr2=0x7f7dac068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.533+0000 7f7dc5930640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f7dac0664a0 0x7f7dac068960 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7db00ae000 tx=0x7f7db00a7000 comp rx=0 tx=0).stop 2023-11-28T19:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.533+0000 7f7dc5930640 1 -- 172.21.15.28:0/1827851709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dc00bbad0 msgr2=0x7f7dc00b4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.533+0000 7f7dc5930640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dc00bbad0 0x7f7dc00b4660 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7db800b970 tx=0x7f7db800be30 comp rx=0 tx=0).stop 2023-11-28T19:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.533+0000 7f7dc5930640 1 -- 172.21.15.28:0/1827851709 shutdown_connections 2023-11-28T19:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.533+0000 7f7dc5930640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f7dac0664a0 0x7f7dac068960 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.533+0000 7f7dc5930640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f7dc00bbad0 0x7f7dc00b4660 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.533+0000 7f7dc5930640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f7dc006af40 0x7f7dc01e79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.539 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.533+0000 7f7dc5930640 1 --2- 172.21.15.28:0/1827851709 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7dc006ab60 0x7f7dc014d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.533+0000 7f7dc5930640 1 -- 172.21.15.28:0/1827851709 >> 172.21.15.28:0/1827851709 conn(0x7f7dc00c0c90 msgr2=0x7f7dc00bb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.533+0000 7f7dc5930640 1 -- 172.21.15.28:0/1827851709 shutdown_connections 2023-11-28T19:32:27.540 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.533+0000 7f7dc5930640 1 -- 172.21.15.28:0/1827851709 wait complete. 2023-11-28T19:32:27.552 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-11-28T19:32:27.148808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236460,"kb_used_data":3652,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738260,"statfs":{"total":773094113280,"available":772851978240,"internally_reserved":0,"allocated":3739648,"data_stored":2120109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.660969"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.498564+0000","last_change":"2023-11-28T19:32:21.498564+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.498564+0000","last_undegraded":"2023-11-28T19:32:21.498564+0000","last_fullsized":"2023-11-28T19:32:21.498564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496495+0000","last_change":"2023-11-28T19:32:21.496495+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496495+0000","last_undegraded":"2023-11-28T19:32:21.496495+0000","last_fullsized":"2023-11-28T19:32:21.496495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.492080+0000","last_change":"2023-11-28T19:32:21.492080+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.492080+0000","last_undegraded":"2023-11-28T19:32:21.492080+0000","last_fullsized":"2023-11-28T19:32:21.492080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494519+0000","last_change":"2023-11-28T19:32:21.494519+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494519+0000","last_undegraded":"2023-11-28T19:32:21.494519+0000","last_fullsized":"2023-11-28T19:32:21.494519+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.490611+0000","last_change":"2023-11-28T19:32:21.490611+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.490611+0000","last_undegraded":"2023-11-28T19:32:21.490611+0000","last_fullsized":"2023-11-28T19:32:21.490611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.495717+0000","last_change":"2023-11-28T19:32:21.495717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.495717+0000","last_undegraded":"2023-11-28T19:32:21.495717+0000","last_fullsized":"2023-11-28T19:32:21.495717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.493253+0000","last_change":"2023-11-28T19:32:21.493253+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.493253+0000","last_undegraded":"2023-11-28T19:32:21.493253+0000","last_fullsized":"2023-11-28T19:32:21.493253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.495404+0000","last_change":"2023-11-28T19:32:21.495404+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.495404+0000","last_undegraded":"2023-11-28T19:32:21.495404+0000","last_fullsized":"2023-11-28T19:32:21.495404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496092+0000","last_change":"2023-11-28T19:32:21.496092+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496092+0000","last_undegraded":"2023-11-28T19:32:21.496092+0000","last_fullsized":"2023-11-28T19:32:21.496092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.497626+0000","last_change":"2023-11-28T19:32:21.497626+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.497626+0000","last_undegraded":"2023-11-28T19:32:21.497626+0000","last_fullsized":"2023-11-28T19:32:21.497626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.491058+0000","last_change":"2023-11-28T19:32:21.491058+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.491058+0000","last_undegraded":"2023-11-28T19:32:21.491058+0000","last_fullsized":"2023-11-28T19:32:21.491058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496408+0000","last_change":"2023-11-28T19:32:21.496408+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496408+0000","last_undegraded":"2023-11-28T19:32:21.496408+0000","last_fullsized":"2023-11-28T19:32:21.496408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494926+0000","last_change":"2023-11-28T19:32:21.494926+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494926+0000","last_undegraded":"2023-11-28T19:32:21.494926+0000","last_fullsized":"2023-11-28T19:32:21.494926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496017+0000","last_change":"2023-11-28T19:32:21.496017+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496017+0000","last_undegraded":"2023-11-28T19:32:21.496017+0000","last_fullsized":"2023-11-28T19:32:21.496017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496590+0000","last_change":"2023-11-28T19:32:21.496590+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496590+0000","last_undegraded":"2023-11-28T19:32:21.496590+0000","last_fullsized":"2023-11-28T19:32:21.496590+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.490571+0000","last_change":"2023-11-28T19:32:21.490571+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.490571+0000","last_undegraded":"2023-11-28T19:32:21.490571+0000","last_fullsized":"2023-11-28T19:32:21.490571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.490518+0000","last_change":"2023-11-28T19:32:21.490518+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.490518+0000","last_undegraded":"2023-11-28T19:32:21.490518+0000","last_fullsized":"2023-11-28T19:32:21.490518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.491255+0000","last_change":"2023-11-28T19:32:21.491255+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.491255+0000","last_undegraded":"2023-11-28T19:32:21.491255+0000","last_fullsized":"2023-11-28T19:32:21.491255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.498886+0000","last_change":"2023-11-28T19:32:21.498886+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.498886+0000","last_undegraded":"2023-11-28T19:32:21.498886+0000","last_fullsized":"2023-11-28T19:32:21.498886+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.493948+0000","last_change":"2023-11-28T19:32:21.493948+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.493948+0000","last_undegraded":"2023-11-28T19:32:21.493948+0000","last_fullsized":"2023-11-28T19:32:21.493948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.495096+0000","last_change":"2023-11-28T19:32:21.495096+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.495096+0000","last_undegraded":"2023-11-28T19:32:21.495096+0000","last_fullsized":"2023-11-28T19:32:21.495096+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.495074+0000","last_change":"2023-11-28T19:32:21.495074+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.495074+0000","last_undegraded":"2023-11-28T19:32:21.495074+0000","last_fullsized":"2023-11-28T19:32:21.495074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494527+0000","last_change":"2023-11-28T19:32:21.494527+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494527+0000","last_undegraded":"2023-11-28T19:32:21.494527+0000","last_fullsized":"2023-11-28T19:32:21.494527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494531+0000","last_change":"2023-11-28T19:32:21.494531+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494531+0000","last_undegraded":"2023-11-28T19:32:21.494531+0000","last_fullsized":"2023-11-28T19:32:21.494531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.490514+0000","last_change":"2023-11-28T19:32:21.490514+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.490514+0000","last_undegraded":"2023-11-28T19:32:21.490514+0000","last_fullsized":"2023-11-28T19:32:21.490514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494964+0000","last_change":"2023-11-28T19:32:21.494964+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494964+0000","last_undegraded":"2023-11-28T19:32:21.494964+0000","last_fullsized":"2023-11-28T19:32:21.494964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.498411+0000","last_change":"2023-11-28T19:32:21.498411+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.498411+0000","last_undegraded":"2023-11-28T19:32:21.498411+0000","last_fullsized":"2023-11-28T19:32:21.498411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T19:32:18.339109+0000","last_change":"2023-11-28T19:31:35.378105+0000","last_active":"2023-11-28T19:32:18.339109+0000","last_peered":"2023-11-28T19:32:18.339109+0000","last_clean":"2023-11-28T19:32:18.339109+0000","last_became_active":"2023-11-28T19:31:35.375035+0000","last_became_peered":"2023-11-28T19:31:35.375035+0000","last_unstale":"2023-11-28T19:32:18.339109+0000","last_undegraded":"2023-11-28T19:32:18.339109+0000","last_fullsized":"2023-11-28T19:32:18.339109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_clean_scrub_stamp":"2023-11-28T19:31:33.813158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:07.043315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":709971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6140000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.641}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8540000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":113786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":119603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":119603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":311296,"data_stored":113786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":704154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T19:32:27.557 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T19:32:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc835d73640 1 Processor -- start 2023-11-28T19:32:27.714 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc835d73640 1 -- start start 2023-11-28T19:32:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc835d73640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc8300b8f30 0x7fc830071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.715 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc835d73640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc83014ccc0 0x7fc830153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc835d73640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc83006f780 con 0x7fc83014c860 2023-11-28T19:32:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc835d73640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc830143aa0 con 0x7fc8300b8f30 2023-11-28T19:32:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc835d73640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc830072320 con 0x7fc83014ccc0 2023-11-28T19:32:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc82f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc8300b8f30 0x7fc830071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc82f7fe640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7fc8300b8f30 0x7fc830071790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38994/0 (socket says 172.21.15.28:38994) 2023-11-28T19:32:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc82f7fe640 1 -- 172.21.15.28:0/111728603 learned_addr learned my addr 172.21.15.28:0/111728603 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc82f7fe640 1 -- 172.21.15.28:0/111728603 >> v2:172.21.15.131:3300/0 conn(0x7fc83014ccc0 msgr2=0x7fc830153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc82ffff640 1 --2- 172.21.15.28:0/111728603 >> v2:172.21.15.131:3300/0 conn(0x7fc83014ccc0 0x7fc830153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc82f7fe640 1 --2- 172.21.15.28:0/111728603 >> v2:172.21.15.131:3300/0 conn(0x7fc83014ccc0 0x7fc830153bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.716 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc82f7fe640 1 -- 172.21.15.28:0/111728603 >> v1:172.21.15.131:6789/0 conn(0x7fc83014c860 legacy=0x7fc8300b6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:27.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc82f7fe640 1 -- 172.21.15.28:0/111728603 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83006fcf0 con 0x7fc8300b8f30 2023-11-28T19:32:27.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc82ffff640 1 --2- 172.21.15.28:0/111728603 >> v2:172.21.15.131:3300/0 conn(0x7fc83014ccc0 0x7fc830153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:27.717 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc82f7fe640 1 --2- 172.21.15.28:0/111728603 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8300b8f30 0x7fc830071790 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc8300ba9f0 tx=0x7fc82001c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47932c36802bfb45 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc82e7fc640 1 -- 172.21.15.28:0/111728603 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200ab600 con 0x7fc8300b8f30 2023-11-28T19:32:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc82e7fc640 1 -- 172.21.15.28:0/111728603 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8200a7050 con 0x7fc8300b8f30 2023-11-28T19:32:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.713+0000 7fc82e7fc640 1 -- 172.21.15.28:0/111728603 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200ab980 con 0x7fc8300b8f30 2023-11-28T19:32:27.718 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 -- 172.21.15.28:0/111728603 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8300b8f30 msgr2=0x7fc830071790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 --2- 172.21.15.28:0/111728603 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8300b8f30 0x7fc830071790 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc8300ba9f0 tx=0x7fc82001c4c0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 -- 172.21.15.28:0/111728603 shutdown_connections 2023-11-28T19:32:27.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 --2- 172.21.15.28:0/111728603 >> v2:172.21.15.131:3300/0 conn(0x7fc83014ccc0 0x7fc830153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 --2- 172.21.15.28:0/111728603 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc8300b8f30 0x7fc830071790 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 -- 172.21.15.28:0/111728603 >> 172.21.15.28:0/111728603 conn(0x7fc8300bcb40 msgr2=0x7fc8300bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:27.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 -- 172.21.15.28:0/111728603 shutdown_connections 2023-11-28T19:32:27.719 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 -- 172.21.15.28:0/111728603 wait complete. 2023-11-28T19:32:27.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 Processor -- start 2023-11-28T19:32:27.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 -- start start 2023-11-28T19:32:27.721 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8300b8f30 0x7fc830140890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc83014c860 0x7fc8301e75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc83014ccc0 0x7fc830141620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8301e7b00 con 0x7fc83014c860 2023-11-28T19:32:27.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc830146250 con 0x7fc8300b8f30 2023-11-28T19:32:27.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc830140f50 con 0x7fc83014ccc0 2023-11-28T19:32:27.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc82effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc83014c860 0x7fc8301e75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc82effd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc83014c860 0x7fc8301e75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39002/0 (socket says 172.21.15.28:39002) 2023-11-28T19:32:27.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc82effd640 1 -- 172.21.15.28:0/1148010460 learned_addr learned my addr 172.21.15.28:0/1148010460 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:27.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc82f7fe640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8300b8f30 0x7fc830140890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.722 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc82effd640 1 -- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc83014ccc0 msgr2=0x7fc830141620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc82ffff640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc83014ccc0 0x7fc830141620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc82effd640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc83014ccc0 0x7fc830141620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc82effd640 1 -- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8300b8f30 msgr2=0x7fc830140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc82effd640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8300b8f30 0x7fc830140890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc82effd640 1 -- 172.21.15.28:0/1148010460 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8200094d0 con 0x7fc83014c860 2023-11-28T19:32:27.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc82f7fe640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8300b8f30 0x7fc830140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:27.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc82effd640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc83014c860 0x7fc8301e75c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc82400c480 tx=0x7fc82400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:27.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc817fff640 1 -- 172.21.15.28:0/1148010460 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824012830 con 0x7fc83014c860 2023-11-28T19:32:27.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc817fff640 1 -- 172.21.15.28:0/1148010460 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8240129b0 con 0x7fc83014c860 2023-11-28T19:32:27.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc817fff640 1 -- 172.21.15.28:0/1148010460 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc824012d60 con 0x7fc83014c860 2023-11-28T19:32:27.723 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 -- 172.21.15.28:0/1148010460 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8301464c0 con 0x7fc83014c860 2023-11-28T19:32:27.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.717+0000 7fc835d73640 1 -- 172.21.15.28:0/1148010460 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc830147350 con 0x7fc83014c860 2023-11-28T19:32:27.724 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.721+0000 7fc835d73640 1 -- 172.21.15.28:0/1148010460 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8301469e0 con 0x7fc83014c860 2023-11-28T19:32:27.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.721+0000 7fc817fff640 1 -- 172.21.15.28:0/1148010460 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fc82401c460 con 0x7fc83014c860 2023-11-28T19:32:27.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.721+0000 7fc817fff640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc81c066470 0x7fc81c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:27.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.721+0000 7fc817fff640 1 -- 172.21.15.28:0/1148010460 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc824083dc0 con 0x7fc83014c860 2023-11-28T19:32:27.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.721+0000 7fc82f7fe640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc81c066470 0x7fc81c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:27.725 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.721+0000 7fc82f7fe640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc81c066470 0x7fc81c068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc8200ad000 tx=0x7fc820008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:27.727 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.725+0000 7fc817fff640 1 -- 172.21.15.28:0/1148010460 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fc824051230 con 0x7fc83014c860 2023-11-28T19:32:27.879 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.877+0000 7fc835d73640 1 -- 172.21.15.28:0/1148010460 --> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc830141370 con 0x7fc81c066470 2023-11-28T19:32:27.897 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.893+0000 7fc817fff640 1 -- 172.21.15.28:0/1148010460 <== mgr.4100 v2:172.21.15.131:6832/3367043860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252090 (secure 0 0 0) 0x7fc830141370 con 0x7fc81c066470 2023-11-28T19:32:27.901 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:27.903 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-28T19:32:27.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.897+0000 7fc835d73640 1 -- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc81c066470 msgr2=0x7fc81c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.897+0000 7fc835d73640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc81c066470 0x7fc81c068930 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc8200ad000 tx=0x7fc820008040 comp rx=0 tx=0).stop 2023-11-28T19:32:27.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.897+0000 7fc835d73640 1 -- 172.21.15.28:0/1148010460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc83014c860 msgr2=0x7fc8301e75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:27.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.897+0000 7fc835d73640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc83014c860 0x7fc8301e75c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc82400c480 tx=0x7fc82400c940 comp rx=0 tx=0).stop 2023-11-28T19:32:27.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.897+0000 7fc835d73640 1 -- 172.21.15.28:0/1148010460 shutdown_connections 2023-11-28T19:32:27.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.897+0000 7fc835d73640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fc81c066470 0x7fc81c068930 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.897+0000 7fc835d73640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fc83014ccc0 0x7fc830141620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.897+0000 7fc835d73640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fc83014c860 0x7fc8301e75c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.897+0000 7fc835d73640 1 --2- 172.21.15.28:0/1148010460 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc8300b8f30 0x7fc830140890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:27.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.897+0000 7fc835d73640 1 -- 172.21.15.28:0/1148010460 >> 172.21.15.28:0/1148010460 conn(0x7fc8300bcb40 msgr2=0x7fc83013f580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:27.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.897+0000 7fc835d73640 1 -- 172.21.15.28:0/1148010460 shutdown_connections 2023-11-28T19:32:27.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:27.897+0000 7fc835d73640 1 -- 172.21.15.28:0/1148010460 wait complete. 2023-11-28T19:32:27.919 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-11-28T19:32:27.148808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236460,"kb_used_data":3652,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738260,"statfs":{"total":773094113280,"available":772851978240,"internally_reserved":0,"allocated":3739648,"data_stored":2120109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.660969"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.498564+0000","last_change":"2023-11-28T19:32:21.498564+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.498564+0000","last_undegraded":"2023-11-28T19:32:21.498564+0000","last_fullsized":"2023-11-28T19:32:21.498564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496495+0000","last_change":"2023-11-28T19:32:21.496495+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496495+0000","last_undegraded":"2023-11-28T19:32:21.496495+0000","last_fullsized":"2023-11-28T19:32:21.496495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.492080+0000","last_change":"2023-11-28T19:32:21.492080+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.492080+0000","last_undegraded":"2023-11-28T19:32:21.492080+0000","last_fullsized":"2023-11-28T19:32:21.492080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494519+0000","last_change":"2023-11-28T19:32:21.494519+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494519+0000","last_undegraded":"2023-11-28T19:32:21.494519+0000","last_fullsized":"2023-11-28T19:32:21.494519+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.490611+0000","last_change":"2023-11-28T19:32:21.490611+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.490611+0000","last_undegraded":"2023-11-28T19:32:21.490611+0000","last_fullsized":"2023-11-28T19:32:21.490611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.495717+0000","last_change":"2023-11-28T19:32:21.495717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.495717+0000","last_undegraded":"2023-11-28T19:32:21.495717+0000","last_fullsized":"2023-11-28T19:32:21.495717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.493253+0000","last_change":"2023-11-28T19:32:21.493253+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.493253+0000","last_undegraded":"2023-11-28T19:32:21.493253+0000","last_fullsized":"2023-11-28T19:32:21.493253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.495404+0000","last_change":"2023-11-28T19:32:21.495404+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.495404+0000","last_undegraded":"2023-11-28T19:32:21.495404+0000","last_fullsized":"2023-11-28T19:32:21.495404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496092+0000","last_change":"2023-11-28T19:32:21.496092+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496092+0000","last_undegraded":"2023-11-28T19:32:21.496092+0000","last_fullsized":"2023-11-28T19:32:21.496092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.497626+0000","last_change":"2023-11-28T19:32:21.497626+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.497626+0000","last_undegraded":"2023-11-28T19:32:21.497626+0000","last_fullsized":"2023-11-28T19:32:21.497626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.491058+0000","last_change":"2023-11-28T19:32:21.491058+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.491058+0000","last_undegraded":"2023-11-28T19:32:21.491058+0000","last_fullsized":"2023-11-28T19:32:21.491058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496408+0000","last_change":"2023-11-28T19:32:21.496408+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496408+0000","last_undegraded":"2023-11-28T19:32:21.496408+0000","last_fullsized":"2023-11-28T19:32:21.496408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494926+0000","last_change":"2023-11-28T19:32:21.494926+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494926+0000","last_undegraded":"2023-11-28T19:32:21.494926+0000","last_fullsized":"2023-11-28T19:32:21.494926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496017+0000","last_change":"2023-11-28T19:32:21.496017+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496017+0000","last_undegraded":"2023-11-28T19:32:21.496017+0000","last_fullsized":"2023-11-28T19:32:21.496017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496590+0000","last_change":"2023-11-28T19:32:21.496590+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496590+0000","last_undegraded":"2023-11-28T19:32:21.496590+0000","last_fullsized":"2023-11-28T19:32:21.496590+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.490571+0000","last_change":"2023-11-28T19:32:21.490571+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.490571+0000","last_undegraded":"2023-11-28T19:32:21.490571+0000","last_fullsized":"2023-11-28T19:32:21.490571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.490518+0000","last_change":"2023-11-28T19:32:21.490518+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.490518+0000","last_undegraded":"2023-11-28T19:32:21.490518+0000","last_fullsized":"2023-11-28T19:32:21.490518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.491255+0000","last_change":"2023-11-28T19:32:21.491255+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.491255+0000","last_undegraded":"2023-11-28T19:32:21.491255+0000","last_fullsized":"2023-11-28T19:32:21.491255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.498886+0000","last_change":"2023-11-28T19:32:21.498886+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.498886+0000","last_undegraded":"2023-11-28T19:32:21.498886+0000","last_fullsized":"2023-11-28T19:32:21.498886+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.493948+0000","last_change":"2023-11-28T19:32:21.493948+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.493948+0000","last_undegraded":"2023-11-28T19:32:21.493948+0000","last_fullsized":"2023-11-28T19:32:21.493948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.495096+0000","last_change":"2023-11-28T19:32:21.495096+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.495096+0000","last_undegraded":"2023-11-28T19:32:21.495096+0000","last_fullsized":"2023-11-28T19:32:21.495096+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.495074+0000","last_change":"2023-11-28T19:32:21.495074+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.495074+0000","last_undegraded":"2023-11-28T19:32:21.495074+0000","last_fullsized":"2023-11-28T19:32:21.495074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494527+0000","last_change":"2023-11-28T19:32:21.494527+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494527+0000","last_undegraded":"2023-11-28T19:32:21.494527+0000","last_fullsized":"2023-11-28T19:32:21.494527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494531+0000","last_change":"2023-11-28T19:32:21.494531+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494531+0000","last_undegraded":"2023-11-28T19:32:21.494531+0000","last_fullsized":"2023-11-28T19:32:21.494531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.490514+0000","last_change":"2023-11-28T19:32:21.490514+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.490514+0000","last_undegraded":"2023-11-28T19:32:21.490514+0000","last_fullsized":"2023-11-28T19:32:21.490514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494964+0000","last_change":"2023-11-28T19:32:21.494964+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494964+0000","last_undegraded":"2023-11-28T19:32:21.494964+0000","last_fullsized":"2023-11-28T19:32:21.494964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.498411+0000","last_change":"2023-11-28T19:32:21.498411+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.498411+0000","last_undegraded":"2023-11-28T19:32:21.498411+0000","last_fullsized":"2023-11-28T19:32:21.498411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T19:32:18.339109+0000","last_change":"2023-11-28T19:31:35.378105+0000","last_active":"2023-11-28T19:32:18.339109+0000","last_peered":"2023-11-28T19:32:18.339109+0000","last_clean":"2023-11-28T19:32:18.339109+0000","last_became_active":"2023-11-28T19:31:35.375035+0000","last_became_peered":"2023-11-28T19:31:35.375035+0000","last_unstale":"2023-11-28T19:32:18.339109+0000","last_undegraded":"2023-11-28T19:32:18.339109+0000","last_fullsized":"2023-11-28T19:32:18.339109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_clean_scrub_stamp":"2023-11-28T19:31:33.813158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:07.043315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":709971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6140000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.641}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8540000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":113786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":119603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":119603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":311296,"data_stored":113786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":704154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T19:32:27.923 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T19:32:28.089 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.085+0000 7faab5df0640 1 Processor -- start 2023-11-28T19:32:35.541 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.085+0000 7faab5df0640 1 -- start start 2023-11-28T19:32:35.542 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:32:35.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faab5df0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faab0072490 0x7faab00b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:35.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faab5df0640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab00b6a30 con 0x7faab0072870 2023-11-28T19:32:35.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faab5df0640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab00b50a0 con 0x7faab014c090 2023-11-28T19:32:35.548 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faab5df0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab00b5840 con 0x7faab0072490 2023-11-28T19:32:35.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaaeffd640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7faab0072870 0x7faab014b980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:35344/0 (socket says 172.21.15.28:35344) 2023-11-28T19:32:35.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaaeffd640 1 -- 172.21.15.28:0/20761972 learned_addr learned my addr 172.21.15.28:0/20761972 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:35.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaaf7fe640 1 --2- 172.21.15.28:0/20761972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faab0072490 0x7faab00b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:35.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 -- 172.21.15.28:0/20761972 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1345943429 0 0) 0x7faaa4001120 con 0x7faab0072870 2023-11-28T19:32:35.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 -- 172.21.15.28:0/20761972 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa98003530 con 0x7faab0072870 2023-11-28T19:32:35.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 -- 172.21.15.28:0/20761972 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1572306860 0 0) 0x7faa98003530 con 0x7faab0072870 2023-11-28T19:32:35.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 -- 172.21.15.28:0/20761972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faab0072490 msgr2=0x7faab00b44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:35.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 --2- 172.21.15.28:0/20761972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faab0072490 0x7faab00b44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:35.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 -- 172.21.15.28:0/20761972 >> v1:172.21.15.131:6789/0 conn(0x7faab014c090 legacy=0x7faab0155e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:35.549 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 -- 172.21.15.28:0/20761972 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab00b5b20 con 0x7faab0072870 2023-11-28T19:32:35.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 -- 172.21.15.28:0/20761972 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7faaa4001810 con 0x7faab0072870 2023-11-28T19:32:35.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 -- 172.21.15.28:0/20761972 >> v1:172.21.15.28:6789/0 conn(0x7faab0072870 legacy=0x7faab014b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:35.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 --2- 172.21.15.28:0/20761972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa980039b0 0x7faa98003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:35.550 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 --2- 172.21.15.28:0/20761972 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa980047d0 0x7faa98004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:35.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 --2- 172.21.15.28:0/20761972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faab0072490 0x7faa98005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:35.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 -- 172.21.15.28:0/20761972 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab00b5840 con 0x7faa980047d0 2023-11-28T19:32:35.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 -- 172.21.15.28:0/20761972 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9800ba70 con 0x7faa980039b0 2023-11-28T19:32:35.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaae7fc640 1 -- 172.21.15.28:0/20761972 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9800bc30 con 0x7faab0072490 2023-11-28T19:32:35.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaaeffd640 1 --2- 172.21.15.28:0/20761972 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa980047d0 0x7faa98004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:35.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaaffff640 1 --2- 172.21.15.28:0/20761972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faab0072490 0x7faa98005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:35.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaaf7fe640 1 --2- 172.21.15.28:0/20761972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa980039b0 0x7faa98003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:35.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaaeffd640 1 -- 172.21.15.28:0/20761972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faab0072490 msgr2=0x7faa98005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:35.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaaeffd640 1 --2- 172.21.15.28:0/20761972 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faab0072490 0x7faa98005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:35.551 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaaeffd640 1 -- 172.21.15.28:0/20761972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa980039b0 msgr2=0x7faa98003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:35.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaaeffd640 1 --2- 172.21.15.28:0/20761972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa980039b0 0x7faa98003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:35.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaaeffd640 1 -- 172.21.15.28:0/20761972 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa98003530 con 0x7faa980047d0 2023-11-28T19:32:35.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.089+0000 7faaaf7fe640 1 --2- 172.21.15.28:0/20761972 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa980039b0 0x7faa98003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:35.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaaeffd640 1 --2- 172.21.15.28:0/20761972 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa980047d0 0x7faa98004c50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faaa4001ec0 tx=0x7faaa401f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763ff24967796749 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:35.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaae7fc640 1 -- 172.21.15.28:0/20761972 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa40a8e90 con 0x7faa980047d0 2023-11-28T19:32:35.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaae7fc640 1 -- 172.21.15.28:0/20761972 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa40058e0 con 0x7faa980047d0 2023-11-28T19:32:35.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaae7fc640 1 -- 172.21.15.28:0/20761972 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4005cb0 con 0x7faa980047d0 2023-11-28T19:32:35.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 -- 172.21.15.28:0/20761972 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa980047d0 msgr2=0x7faa98004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:35.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 --2- 172.21.15.28:0/20761972 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faa980047d0 0x7faa98004c50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faaa4001ec0 tx=0x7faaa401f270 comp rx=0 tx=0).stop 2023-11-28T19:32:35.552 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaaffff640 1 -- 172.21.15.28:0/20761972 reap_dead start 2023-11-28T19:32:35.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 -- 172.21.15.28:0/20761972 shutdown_connections 2023-11-28T19:32:35.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 -- 172.21.15.28:0/20761972 >> 172.21.15.28:0/20761972 conn(0x7faab00bcb40 msgr2=0x7faab00bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:35.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 -- 172.21.15.28:0/20761972 shutdown_connections 2023-11-28T19:32:35.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 -- 172.21.15.28:0/20761972 wait complete. 2023-11-28T19:32:35.553 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 Processor -- start 2023-11-28T19:32:35.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 -- start start 2023-11-28T19:32:35.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa980047d0 0x7faab00b9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:35.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faab014d580 0x7faab013eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:35.581 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faab013f1e0 0x7faab0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:35.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab00b9b40 con 0x7faab014d580 2023-11-28T19:32:35.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab014c9e0 con 0x7faa980047d0 2023-11-28T19:32:35.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab014cdf0 con 0x7faab013f1e0 2023-11-28T19:32:35.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaaeffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faab014d580 0x7faab013eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:35.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaaeffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faab014d580 0x7faab013eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:39014/0 (socket says 172.21.15.28:39014) 2023-11-28T19:32:35.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaaeffd640 1 -- 172.21.15.28:0/4217635878 learned_addr learned my addr 172.21.15.28:0/4217635878 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:35.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaaf7fe640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa980047d0 0x7faab00b9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:35.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaaffff640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faab013f1e0 0x7faab0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:35.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaaeffd640 1 -- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faab013f1e0 msgr2=0x7faab0071210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:35.582 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaaeffd640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faab013f1e0 0x7faab0071210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaaeffd640 1 -- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa980047d0 msgr2=0x7faab00b9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaaeffd640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa980047d0 0x7faab00b9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaaeffd640 1 -- 172.21.15.28:0/4217635878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab014ea40 con 0x7faab014d580 2023-11-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaaf7fe640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa980047d0 0x7faab00b9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faaaeffd640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faab014d580 0x7faab013eca0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faaa4001ec0 tx=0x7faa98005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faa97fff640 1 -- 172.21.15.28:0/4217635878 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa40b7070 con 0x7faab014d580 2023-11-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faa97fff640 1 -- 172.21.15.28:0/4217635878 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa4005a50 con 0x7faab014d580 2023-11-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 -- 172.21.15.28:0/4217635878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab014ecb0 con 0x7faab014d580 2023-11-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faa97fff640 1 -- 172.21.15.28:0/4217635878 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4005de0 con 0x7faab014d580 2023-11-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.093+0000 7faab5df0640 1 -- 172.21.15.28:0/4217635878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab014d060 con 0x7faab014d580 2023-11-28T19:32:35.583 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.097+0000 7faab5df0640 1 -- 172.21.15.28:0/4217635878 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faab0074a90 con 0x7faab014d580 2023-11-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.097+0000 7faa97fff640 1 -- 172.21.15.28:0/4217635878 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7faaa4007090 con 0x7faab014d580 2023-11-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.097+0000 7faa97fff640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7faa9c066470 0x7faa9c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.097+0000 7faa97fff640 1 -- 172.21.15.28:0/4217635878 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faaa4120da0 con 0x7faab014d580 2023-11-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.097+0000 7faaaf7fe640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7faa9c066470 0x7faa9c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.097+0000 7faaaf7fe640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7faa9c066470 0x7faa9c068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009b80 tx=0x7faaa0008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.101+0000 7faa97fff640 1 -- 172.21.15.28:0/4217635878 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7faaa40ee210 con 0x7faab014d580 2023-11-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.253+0000 7faab5df0640 1 -- 172.21.15.28:0/4217635878 --> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7faab00b60e0 con 0x7faa9c066470 2023-11-28T19:32:35.584 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.273+0000 7faa97fff640 1 -- 172.21.15.28:0/4217635878 <== mgr.4100 v2:172.21.15.131:6832/3367043860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+252090 (secure 0 0 0) 0x7faaa0012a50 con 0x7faa9c066470 2023-11-28T19:32:35.586 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:35.588 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-28T19:32:35.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.277+0000 7faab5df0640 1 -- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7faa9c066470 msgr2=0x7faa9c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:35.590 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.277+0000 7faab5df0640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7faa9c066470 0x7faa9c068930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7faaa0009b80 tx=0x7faaa0008040 comp rx=0 tx=0).stop 2023-11-28T19:32:35.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.277+0000 7faab5df0640 1 -- 172.21.15.28:0/4217635878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faab014d580 msgr2=0x7faab013eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:35.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.277+0000 7faab5df0640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faab014d580 0x7faab013eca0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7faaa4001ec0 tx=0x7faa98005800 comp rx=0 tx=0).stop 2023-11-28T19:32:35.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.277+0000 7faab5df0640 1 -- 172.21.15.28:0/4217635878 shutdown_connections 2023-11-28T19:32:35.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.277+0000 7faab5df0640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7faa9c066470 0x7faa9c068930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:35.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.277+0000 7faab5df0640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7faab013f1e0 0x7faab0071210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:35.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.277+0000 7faab5df0640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7faab014d580 0x7faab013eca0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:35.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.277+0000 7faab5df0640 1 --2- 172.21.15.28:0/4217635878 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa980047d0 0x7faab00b9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:35.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.277+0000 7faab5df0640 1 -- 172.21.15.28:0/4217635878 >> 172.21.15.28:0/4217635878 conn(0x7faab00bcb40 msgr2=0x7faab014a050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:35.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.277+0000 7faab5df0640 1 -- 172.21.15.28:0/4217635878 shutdown_connections 2023-11-28T19:32:35.591 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:28.277+0000 7faab5df0640 1 -- 172.21.15.28:0/4217635878 wait complete. 2023-11-28T19:32:35.592 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2023-11-28T19:32:27.148808+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":56,"acting":56,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236460,"kb_used_data":3652,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738260,"statfs":{"total":773094113280,"available":772851978240,"internally_reserved":0,"allocated":3739648,"data_stored":2120109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.660969"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.498564+0000","last_change":"2023-11-28T19:32:21.498564+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.498564+0000","last_undegraded":"2023-11-28T19:32:21.498564+0000","last_fullsized":"2023-11-28T19:32:21.498564+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496495+0000","last_change":"2023-11-28T19:32:21.496495+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496495+0000","last_undegraded":"2023-11-28T19:32:21.496495+0000","last_fullsized":"2023-11-28T19:32:21.496495+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.492080+0000","last_change":"2023-11-28T19:32:21.492080+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.492080+0000","last_undegraded":"2023-11-28T19:32:21.492080+0000","last_fullsized":"2023-11-28T19:32:21.492080+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494519+0000","last_change":"2023-11-28T19:32:21.494519+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494519+0000","last_undegraded":"2023-11-28T19:32:21.494519+0000","last_fullsized":"2023-11-28T19:32:21.494519+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.490611+0000","last_change":"2023-11-28T19:32:21.490611+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.490611+0000","last_undegraded":"2023-11-28T19:32:21.490611+0000","last_fullsized":"2023-11-28T19:32:21.490611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.495717+0000","last_change":"2023-11-28T19:32:21.495717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.495717+0000","last_undegraded":"2023-11-28T19:32:21.495717+0000","last_fullsized":"2023-11-28T19:32:21.495717+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.493253+0000","last_change":"2023-11-28T19:32:21.493253+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.493253+0000","last_undegraded":"2023-11-28T19:32:21.493253+0000","last_fullsized":"2023-11-28T19:32:21.493253+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.495404+0000","last_change":"2023-11-28T19:32:21.495404+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.495404+0000","last_undegraded":"2023-11-28T19:32:21.495404+0000","last_fullsized":"2023-11-28T19:32:21.495404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496092+0000","last_change":"2023-11-28T19:32:21.496092+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496092+0000","last_undegraded":"2023-11-28T19:32:21.496092+0000","last_fullsized":"2023-11-28T19:32:21.496092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.497626+0000","last_change":"2023-11-28T19:32:21.497626+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.497626+0000","last_undegraded":"2023-11-28T19:32:21.497626+0000","last_fullsized":"2023-11-28T19:32:21.497626+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.491058+0000","last_change":"2023-11-28T19:32:21.491058+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.491058+0000","last_undegraded":"2023-11-28T19:32:21.491058+0000","last_fullsized":"2023-11-28T19:32:21.491058+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496408+0000","last_change":"2023-11-28T19:32:21.496408+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496408+0000","last_undegraded":"2023-11-28T19:32:21.496408+0000","last_fullsized":"2023-11-28T19:32:21.496408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494926+0000","last_change":"2023-11-28T19:32:21.494926+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494926+0000","last_undegraded":"2023-11-28T19:32:21.494926+0000","last_fullsized":"2023-11-28T19:32:21.494926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496017+0000","last_change":"2023-11-28T19:32:21.496017+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496017+0000","last_undegraded":"2023-11-28T19:32:21.496017+0000","last_fullsized":"2023-11-28T19:32:21.496017+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.496590+0000","last_change":"2023-11-28T19:32:21.496590+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.496590+0000","last_undegraded":"2023-11-28T19:32:21.496590+0000","last_fullsized":"2023-11-28T19:32:21.496590+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.490571+0000","last_change":"2023-11-28T19:32:21.490571+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.490571+0000","last_undegraded":"2023-11-28T19:32:21.490571+0000","last_fullsized":"2023-11-28T19:32:21.490571+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.490518+0000","last_change":"2023-11-28T19:32:21.490518+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.490518+0000","last_undegraded":"2023-11-28T19:32:21.490518+0000","last_fullsized":"2023-11-28T19:32:21.490518+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.491255+0000","last_change":"2023-11-28T19:32:21.491255+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.491255+0000","last_undegraded":"2023-11-28T19:32:21.491255+0000","last_fullsized":"2023-11-28T19:32:21.491255+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.498886+0000","last_change":"2023-11-28T19:32:21.498886+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.498886+0000","last_undegraded":"2023-11-28T19:32:21.498886+0000","last_fullsized":"2023-11-28T19:32:21.498886+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.493948+0000","last_change":"2023-11-28T19:32:21.493948+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.493948+0000","last_undegraded":"2023-11-28T19:32:21.493948+0000","last_fullsized":"2023-11-28T19:32:21.493948+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.495096+0000","last_change":"2023-11-28T19:32:21.495096+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.495096+0000","last_undegraded":"2023-11-28T19:32:21.495096+0000","last_fullsized":"2023-11-28T19:32:21.495096+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.495074+0000","last_change":"2023-11-28T19:32:21.495074+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.495074+0000","last_undegraded":"2023-11-28T19:32:21.495074+0000","last_fullsized":"2023-11-28T19:32:21.495074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494527+0000","last_change":"2023-11-28T19:32:21.494527+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494527+0000","last_undegraded":"2023-11-28T19:32:21.494527+0000","last_fullsized":"2023-11-28T19:32:21.494527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:21.472717+0000","last_change":"2023-11-28T19:32:21.472717+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.472717+0000","last_undegraded":"2023-11-28T19:32:21.472717+0000","last_fullsized":"2023-11-28T19:32:21.472717+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494531+0000","last_change":"2023-11-28T19:32:21.494531+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494531+0000","last_undegraded":"2023-11-28T19:32:21.494531+0000","last_fullsized":"2023-11-28T19:32:21.494531+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.490514+0000","last_change":"2023-11-28T19:32:21.490514+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.490514+0000","last_undegraded":"2023-11-28T19:32:21.490514+0000","last_fullsized":"2023-11-28T19:32:21.490514+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.494964+0000","last_change":"2023-11-28T19:32:21.494964+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.494964+0000","last_undegraded":"2023-11-28T19:32:21.494964+0000","last_fullsized":"2023-11-28T19:32:21.494964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-11-28T19:32:22.485054+0000","last_change":"2023-11-28T19:32:22.485054+0000","last_active":"2023-11-28T19:32:22.485054+0000","last_peered":"2023-11-28T19:32:22.485054+0000","last_clean":"2023-11-28T19:32:22.485054+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:22.485054+0000","last_undegraded":"2023-11-28T19:32:22.485054+0000","last_fullsized":"2023-11-28T19:32:22.485054+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":29,"state":"creating+peering","last_fresh":"2023-11-28T19:32:21.498411+0000","last_change":"2023-11-28T19:32:21.498411+0000","last_active":"2023-11-28T19:32:21.472717+0000","last_peered":"2023-11-28T19:32:21.472717+0000","last_clean":"2023-11-28T19:32:21.472717+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-11-28T19:32:21.498411+0000","last_undegraded":"2023-11-28T19:32:21.498411+0000","last_fullsized":"2023-11-28T19:32:21.498411+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-11-28T19:32:18.339109+0000","last_change":"2023-11-28T19:31:35.378105+0000","last_active":"2023-11-28T19:32:18.339109+0000","last_peered":"2023-11-28T19:32:18.339109+0000","last_clean":"2023-11-28T19:32:18.339109+0000","last_became_active":"2023-11-28T19:31:35.375035+0000","last_became_peered":"2023-11-28T19:31:35.375035+0000","last_unstale":"2023-11-28T19:32:18.339109+0000","last_undegraded":"2023-11-28T19:32:18.339109+0000","last_fullsized":"2023-11-28T19:32:18.339109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_clean_scrub_stamp":"2023-11-28T19:31:33.813158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:07.043315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":54,"acting":54,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574860,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27916,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343924,"statfs":{"total":96636764160,"available":96608178176,"internally_reserved":0,"allocated":917504,"data_stored":709971,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83399999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6140000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.641}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8540000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27328,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344512,"statfs":{"total":96636764160,"available":96608780288,"internally_reserved":0,"allocated":311296,"data_stored":113786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0029999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.036}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]}]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":323584,"data_stored":119603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96699999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.101}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.137}]}]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":119603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.752}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.121}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.099}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2370000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31496,"kb_used_data":316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340344,"statfs":{"total":96636764160,"available":96604512256,"internally_reserved":0,"allocated":323584,"data_stored":119603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.749}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31484,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340356,"statfs":{"total":96636764160,"available":96604524544,"internally_reserved":0,"allocated":311296,"data_stored":113786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73499999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32068,"kb_used_data":884,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339772,"statfs":{"total":96636764160,"available":96603926528,"internally_reserved":0,"allocated":905216,"data_stored":704154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1819999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0409999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T19:32:35.610 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-11-28T19:32:35.610 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-11-28T19:32:35.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-11-28T19:32:35.611 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.611 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-11-28T19:32:35.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-11-28T19:32:35.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-11-28T19:32:35.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-11-28T19:32:35.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.612 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-11-28T19:32:35.612 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-11-28T19:32:35.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-11-28T19:32:35.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-11-28T19:32:35.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.613 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-11-28T19:32:35.613 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-11-28T19:32:35.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-11-28T19:32:35.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.614 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-11-28T19:32:35.614 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-11-28T19:32:35.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-11-28T19:32:35.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-11-28T19:32:35.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-11-28T19:32:35.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.615 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-11-28T19:32:35.615 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-11-28T19:32:35.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-11-28T19:32:35.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-11-28T19:32:35.616 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.616 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-11-28T19:32:35.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-11-28T19:32:35.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-11-28T19:32:35.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-11-28T19:32:35.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-11-28T19:32:35.617 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.617 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-11-28T19:32:35.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-11-28T19:32:35.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-11-28T19:32:35.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-11-28T19:32:35.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.618 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-11-28T19:32:35.618 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-11-28T19:32:35.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.498564+0000', 'last_change': '2023-11-28T19:32:21.498564+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.498564+0000', 'last_undegraded': '2023-11-28T19:32:21.498564+0000', 'last_fullsized': '2023-11-28T19:32:21.498564+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T19:32:35.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-11-28T19:32:35.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.619 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-11-28T19:32:35.619 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:21.472717+0000', 'last_change': '2023-11-28T19:32:21.472717+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.472717+0000', 'last_undegraded': '2023-11-28T19:32:21.472717+0000', 'last_fullsized': '2023-11-28T19:32:21.472717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-11-28T19:32:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-11-28T19:32:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.496495+0000', 'last_change': '2023-11-28T19:32:21.496495+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.496495+0000', 'last_undegraded': '2023-11-28T19:32:21.496495+0000', 'last_fullsized': '2023-11-28T19:32:21.496495+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T19:32:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-11-28T19:32:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-11-28T19:32:35.620 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.492080+0000', 'last_change': '2023-11-28T19:32:21.492080+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.492080+0000', 'last_undegraded': '2023-11-28T19:32:21.492080+0000', 'last_fullsized': '2023-11-28T19:32:21.492080+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-11-28T19:32:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-11-28T19:32:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-11-28T19:32:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.494519+0000', 'last_change': '2023-11-28T19:32:21.494519+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.494519+0000', 'last_undegraded': '2023-11-28T19:32:21.494519+0000', 'last_fullsized': '2023-11-28T19:32:21.494519+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T19:32:35.621 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-11-28T19:32:35.622 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.622 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-11-28T19:32:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.490611+0000', 'last_change': '2023-11-28T19:32:21.490611+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.490611+0000', 'last_undegraded': '2023-11-28T19:32:21.490611+0000', 'last_fullsized': '2023-11-28T19:32:21.490611+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T19:32:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-11-28T19:32:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-11-28T19:32:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.495717+0000', 'last_change': '2023-11-28T19:32:21.495717+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.495717+0000', 'last_undegraded': '2023-11-28T19:32:21.495717+0000', 'last_fullsized': '2023-11-28T19:32:21.495717+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T19:32:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-11-28T19:32:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-11-28T19:32:35.623 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.493253+0000', 'last_change': '2023-11-28T19:32:21.493253+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.493253+0000', 'last_undegraded': '2023-11-28T19:32:21.493253+0000', 'last_fullsized': '2023-11-28T19:32:21.493253+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T19:32:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-11-28T19:32:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-11-28T19:32:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.495404+0000', 'last_change': '2023-11-28T19:32:21.495404+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.495404+0000', 'last_undegraded': '2023-11-28T19:32:21.495404+0000', 'last_fullsized': '2023-11-28T19:32:21.495404+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T19:32:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-11-28T19:32:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-11-28T19:32:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:21.472717+0000', 'last_change': '2023-11-28T19:32:21.472717+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.472717+0000', 'last_undegraded': '2023-11-28T19:32:21.472717+0000', 'last_fullsized': '2023-11-28T19:32:21.472717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-11-28T19:32:35.624 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-11-28T19:32:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.496092+0000', 'last_change': '2023-11-28T19:32:21.496092+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.496092+0000', 'last_undegraded': '2023-11-28T19:32:21.496092+0000', 'last_fullsized': '2023-11-28T19:32:21.496092+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T19:32:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-11-28T19:32:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-11-28T19:32:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.497626+0000', 'last_change': '2023-11-28T19:32:21.497626+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.497626+0000', 'last_undegraded': '2023-11-28T19:32:21.497626+0000', 'last_fullsized': '2023-11-28T19:32:21.497626+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T19:32:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-11-28T19:32:35.625 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-11-28T19:32:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.491058+0000', 'last_change': '2023-11-28T19:32:21.491058+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.491058+0000', 'last_undegraded': '2023-11-28T19:32:21.491058+0000', 'last_fullsized': '2023-11-28T19:32:21.491058+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T19:32:35.626 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-11-28T19:32:35.627 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-11-28T19:32:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.496408+0000', 'last_change': '2023-11-28T19:32:21.496408+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.496408+0000', 'last_undegraded': '2023-11-28T19:32:21.496408+0000', 'last_fullsized': '2023-11-28T19:32:21.496408+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T19:32:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-11-28T19:32:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.630 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-11-28T19:32:35.646 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.494926+0000', 'last_change': '2023-11-28T19:32:21.494926+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.494926+0000', 'last_undegraded': '2023-11-28T19:32:21.494926+0000', 'last_fullsized': '2023-11-28T19:32:21.494926+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T19:32:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-11-28T19:32:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-11-28T19:32:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.496017+0000', 'last_change': '2023-11-28T19:32:21.496017+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.496017+0000', 'last_undegraded': '2023-11-28T19:32:21.496017+0000', 'last_fullsized': '2023-11-28T19:32:21.496017+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T19:32:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-11-28T19:32:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.647 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-11-28T19:32:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.496590+0000', 'last_change': '2023-11-28T19:32:21.496590+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.496590+0000', 'last_undegraded': '2023-11-28T19:32:21.496590+0000', 'last_fullsized': '2023-11-28T19:32:21.496590+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T19:32:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-11-28T19:32:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-11-28T19:32:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.490571+0000', 'last_change': '2023-11-28T19:32:21.490571+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.490571+0000', 'last_undegraded': '2023-11-28T19:32:21.490571+0000', 'last_fullsized': '2023-11-28T19:32:21.490571+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T19:32:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-11-28T19:32:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.648 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-11-28T19:32:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.490518+0000', 'last_change': '2023-11-28T19:32:21.490518+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.490518+0000', 'last_undegraded': '2023-11-28T19:32:21.490518+0000', 'last_fullsized': '2023-11-28T19:32:21.490518+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T19:32:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-11-28T19:32:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-11-28T19:32:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.491255+0000', 'last_change': '2023-11-28T19:32:21.491255+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.491255+0000', 'last_undegraded': '2023-11-28T19:32:21.491255+0000', 'last_fullsized': '2023-11-28T19:32:21.491255+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T19:32:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-11-28T19:32:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-11-28T19:32:35.649 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:21.472717+0000', 'last_change': '2023-11-28T19:32:21.472717+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.472717+0000', 'last_undegraded': '2023-11-28T19:32:21.472717+0000', 'last_fullsized': '2023-11-28T19:32:21.472717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-11-28T19:32:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-11-28T19:32:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.498886+0000', 'last_change': '2023-11-28T19:32:21.498886+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.498886+0000', 'last_undegraded': '2023-11-28T19:32:21.498886+0000', 'last_fullsized': '2023-11-28T19:32:21.498886+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T19:32:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-11-28T19:32:35.650 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-11-28T19:32:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.493948+0000', 'last_change': '2023-11-28T19:32:21.493948+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.493948+0000', 'last_undegraded': '2023-11-28T19:32:21.493948+0000', 'last_fullsized': '2023-11-28T19:32:21.493948+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T19:32:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-11-28T19:32:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-11-28T19:32:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.495096+0000', 'last_change': '2023-11-28T19:32:21.495096+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.495096+0000', 'last_undegraded': '2023-11-28T19:32:21.495096+0000', 'last_fullsized': '2023-11-28T19:32:21.495096+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-11-28T19:32:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-11-28T19:32:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-11-28T19:32:35.651 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.495074+0000', 'last_change': '2023-11-28T19:32:21.495074+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.495074+0000', 'last_undegraded': '2023-11-28T19:32:21.495074+0000', 'last_fullsized': '2023-11-28T19:32:21.495074+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T19:32:35.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-11-28T19:32:35.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-11-28T19:32:35.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:21.472717+0000', 'last_change': '2023-11-28T19:32:21.472717+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.472717+0000', 'last_undegraded': '2023-11-28T19:32:21.472717+0000', 'last_fullsized': '2023-11-28T19:32:21.472717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.652 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-11-28T19:32:35.652 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.653 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-11-28T19:32:35.653 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.494527+0000', 'last_change': '2023-11-28T19:32:21.494527+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.494527+0000', 'last_undegraded': '2023-11-28T19:32:21.494527+0000', 'last_fullsized': '2023-11-28T19:32:21.494527+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T19:32:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-11-28T19:32:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.654 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-11-28T19:32:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:21.472717+0000', 'last_change': '2023-11-28T19:32:21.472717+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.472717+0000', 'last_undegraded': '2023-11-28T19:32:21.472717+0000', 'last_fullsized': '2023-11-28T19:32:21.472717+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-11-28T19:32:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-11-28T19:32:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.494531+0000', 'last_change': '2023-11-28T19:32:21.494531+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.494531+0000', 'last_undegraded': '2023-11-28T19:32:21.494531+0000', 'last_fullsized': '2023-11-28T19:32:21.494531+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-11-28T19:32:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-11-28T19:32:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-11-28T19:32:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.490514+0000', 'last_change': '2023-11-28T19:32:21.490514+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.490514+0000', 'last_undegraded': '2023-11-28T19:32:21.490514+0000', 'last_fullsized': '2023-11-28T19:32:21.490514+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-11-28T19:32:35.655 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-11-28T19:32:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-11-28T19:32:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.494964+0000', 'last_change': '2023-11-28T19:32:21.494964+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.494964+0000', 'last_undegraded': '2023-11-28T19:32:21.494964+0000', 'last_fullsized': '2023-11-28T19:32:21.494964+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-11-28T19:32:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-11-28T19:32:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-11-28T19:32:22.485054+0000', 'last_change': '2023-11-28T19:32:22.485054+0000', 'last_active': '2023-11-28T19:32:22.485054+0000', 'last_peered': '2023-11-28T19:32:22.485054+0000', 'last_clean': '2023-11-28T19:32:22.485054+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:22.485054+0000', 'last_undegraded': '2023-11-28T19:32:22.485054+0000', 'last_fullsized': '2023-11-28T19:32:22.485054+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:22.485054+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-11-28T19:32:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-11-28T19:32:35.656 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 29, 'state': 'creating+peering', 'last_fresh': '2023-11-28T19:32:21.498411+0000', 'last_change': '2023-11-28T19:32:21.498411+0000', 'last_active': '2023-11-28T19:32:21.472717+0000', 'last_peered': '2023-11-28T19:32:21.472717+0000', 'last_clean': '2023-11-28T19:32:21.472717+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-11-28T19:32:21.498411+0000', 'last_undegraded': '2023-11-28T19:32:21.498411+0000', 'last_fullsized': '2023-11-28T19:32:21.498411+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'last_clean_scrub_stamp': '2023-11-28T19:32:21.472717+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-11-28T19:32:35.657 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-11-28T19:32:35.659 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:32:35.661 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:32:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.789+0000 7fe80c2d1640 1 Processor -- start 2023-11-28T19:32:35.793 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.789+0000 7fe80c2d1640 1 -- start start 2023-11-28T19:32:35.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.789+0000 7fe80c2d1640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8040ba9b0 0x7fe804145110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:35.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.789+0000 7fe80c2d1640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe8040b9650 0x7fe804145650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:35.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.789+0000 7fe80c2d1640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8040704e0 con 0x7fe8040b7a90 2023-11-28T19:32:35.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.789+0000 7fe80c2d1640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe804145b90 con 0x7fe8040b9650 2023-11-28T19:32:35.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.789+0000 7fe80c2d1640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8040b8910 con 0x7fe8040ba9b0 2023-11-28T19:32:35.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.793+0000 7fe80a86e640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe8040b9650 0x7fe804145650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:35.794 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.793+0000 7fe80986c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8040ba9b0 0x7fe804145110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:35.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.793+0000 7fe80a06d640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe8040b7a90 0x7fe8040ba2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:35670/0 (socket says 172.21.15.28:35670) 2023-11-28T19:32:35.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.793+0000 7fe80a06d640 1 -- 172.21.15.28:0/3753320909 learned_addr learned my addr 172.21.15.28:0/3753320909 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:35.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.793+0000 7fe80986c640 1 -- 172.21.15.28:0/3753320909 >> v2:172.21.15.131:3300/0 conn(0x7fe8040b9650 msgr2=0x7fe804145650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:35.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.793+0000 7fe80986c640 1 --2- 172.21.15.28:0/3753320909 >> v2:172.21.15.131:3300/0 conn(0x7fe8040b9650 0x7fe804145650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:35.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.793+0000 7fe80986c640 1 -- 172.21.15.28:0/3753320909 >> v1:172.21.15.131:6789/0 conn(0x7fe8040b7a90 legacy=0x7fe8040ba2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:35.795 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.793+0000 7fe80986c640 1 -- 172.21.15.28:0/3753320909 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8040720b0 con 0x7fe8040ba9b0 2023-11-28T19:32:35.796 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.793+0000 7fe80a86e640 1 --2- 172.21.15.28:0/3753320909 >> v2:172.21.15.131:3300/0 conn(0x7fe8040b9650 0x7fe804145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:32:35.797 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.793+0000 7fe80986c640 1 --2- 172.21.15.28:0/3753320909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8040ba9b0 0x7fe804145110 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40097c0 tx=0x7fe7f401c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c00281b0c93c3f4 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:35.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80906b640 1 -- 172.21.15.28:0/3753320909 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f40a6040 con 0x7fe8040ba9b0 2023-11-28T19:32:35.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80906b640 1 -- 172.21.15.28:0/3753320909 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f40aa600 con 0x7fe8040ba9b0 2023-11-28T19:32:35.798 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80906b640 1 -- 172.21.15.28:0/3753320909 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f40aa990 con 0x7fe8040ba9b0 2023-11-28T19:32:35.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 -- 172.21.15.28:0/3753320909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8040ba9b0 msgr2=0x7fe804145110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:35.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 --2- 172.21.15.28:0/3753320909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8040ba9b0 0x7fe804145110 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe7f40097c0 tx=0x7fe7f401c480 comp rx=0 tx=0).stop 2023-11-28T19:32:35.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 -- 172.21.15.28:0/3753320909 shutdown_connections 2023-11-28T19:32:35.799 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 --2- 172.21.15.28:0/3753320909 >> v2:172.21.15.131:3300/0 conn(0x7fe8040b9650 0x7fe804145650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:35.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 --2- 172.21.15.28:0/3753320909 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8040ba9b0 0x7fe804145110 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:35.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 -- 172.21.15.28:0/3753320909 >> 172.21.15.28:0/3753320909 conn(0x7fe80406e770 msgr2=0x7fe80406b690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:35.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 -- 172.21.15.28:0/3753320909 shutdown_connections 2023-11-28T19:32:35.800 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 -- 172.21.15.28:0/3753320909 wait complete. 2023-11-28T19:32:35.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 Processor -- start 2023-11-28T19:32:35.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 -- start start 2023-11-28T19:32:35.802 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8040b7a90 0x7fe804141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:35.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8040b9650 0x7fe804139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:35.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe80413a1e0 0x7fe8041ddb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:35.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8041e42d0 con 0x7fe80413a1e0 2023-11-28T19:32:35.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8041e45b0 con 0x7fe8040b9650 2023-11-28T19:32:35.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8041e4890 con 0x7fe8040b7a90 2023-11-28T19:32:35.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80a86e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe80413a1e0 0x7fe8041ddb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:35.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80a06d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8040b7a90 0x7fe804141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:35.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80986c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8040b9650 0x7fe804139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:35.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80986c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8040b9650 0x7fe804139ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:43844/0 (socket says 172.21.15.28:43844) 2023-11-28T19:32:35.803 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80a06d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8040b7a90 0x7fe804141940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3301/0 says I am v2:172.21.15.28:38176/0 (socket says 172.21.15.28:38176) 2023-11-28T19:32:35.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80a86e640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe80413a1e0 0x7fe8041ddb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53072/0 (socket says 172.21.15.28:53072) 2023-11-28T19:32:35.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80986c640 1 -- 172.21.15.28:0/360402480 learned_addr learned my addr 172.21.15.28:0/360402480 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:35.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80a86e640 1 -- 172.21.15.28:0/360402480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8040b7a90 msgr2=0x7fe804141940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:35.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80a86e640 1 --2- 172.21.15.28:0/360402480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8040b7a90 0x7fe804141940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:35.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80a86e640 1 -- 172.21.15.28:0/360402480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8040b9650 msgr2=0x7fe804139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:35.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80a86e640 1 --2- 172.21.15.28:0/360402480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8040b9650 0x7fe804139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:35.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80a86e640 1 -- 172.21.15.28:0/360402480 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7fc009a70 con 0x7fe80413a1e0 2023-11-28T19:32:35.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80a86e640 1 --2- 172.21.15.28:0/360402480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe80413a1e0 0x7fe8041ddb40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00efc0 tx=0x7fe7fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:35.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe7faffd640 1 -- 172.21.15.28:0/360402480 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc00cd30 con 0x7fe80413a1e0 2023-11-28T19:32:35.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe7faffd640 1 -- 172.21.15.28:0/360402480 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7fc00f040 con 0x7fe80413a1e0 2023-11-28T19:32:35.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe80c2d1640 1 -- 172.21.15.28:0/360402480 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7f4009420 con 0x7fe80413a1e0 2023-11-28T19:32:35.804 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.797+0000 7fe7faffd640 1 -- 172.21.15.28:0/360402480 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc003be0 con 0x7fe80413a1e0 2023-11-28T19:32:35.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.801+0000 7fe80c2d1640 1 -- 172.21.15.28:0/360402480 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8041437f0 con 0x7fe80413a1e0 2023-11-28T19:32:35.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.801+0000 7fe80c2d1640 1 -- 172.21.15.28:0/360402480 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8041e4ab0 con 0x7fe80413a1e0 2023-11-28T19:32:35.805 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.801+0000 7fe7faffd640 1 -- 172.21.15.28:0/360402480 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fe7fc014480 con 0x7fe80413a1e0 2023-11-28T19:32:35.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.801+0000 7fe7faffd640 1 --2- 172.21.15.28:0/360402480 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe7e8066470 0x7fe7e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:35.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.801+0000 7fe7faffd640 1 -- 172.21.15.28:0/360402480 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7fc0848c0 con 0x7fe80413a1e0 2023-11-28T19:32:35.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.801+0000 7fe80a06d640 1 --2- 172.21.15.28:0/360402480 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe7e8066470 0x7fe7e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:35.806 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.801+0000 7fe80a06d640 1 --2- 172.21.15.28:0/360402480 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe7e8066470 0x7fe7e8068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe800000f70 tx=0x7fe800007e90 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:35.809 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:35.805+0000 7fe7faffd640 1 -- 172.21.15.28:0/360402480 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fe7fc051de0 con 0x7fe80413a1e0 2023-11-28T19:32:36.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.017+0000 7fe80c2d1640 1 -- 172.21.15.28:0/360402480 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe8041e4410 con 0x7fe80413a1e0 2023-11-28T19:32:36.018 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.017+0000 7fe7faffd640 1 -- 172.21.15.28:0/360402480 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1430 (secure 0 0 0) 0x7fe8041e4410 con 0x7fe80413a1e0 2023-11-28T19:32:36.019 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:36.019 INFO:teuthology.orchestra.run.smithi028.stdout:{"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":75,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1701199891,"num_in_osds":8,"osd_in_since":1701199882,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":242532352,"bytes_avail":772851580928,"bytes_total":773094113280,"write_bytes_sec":1485,"read_op_per_sec":0,"write_op_per_sec":4},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4914}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-11-28T19:32:33.151405+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-11-28T19:32:36.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.017+0000 7fe80c2d1640 1 -- 172.21.15.28:0/360402480 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe7e8066470 msgr2=0x7fe7e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:36.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.017+0000 7fe80c2d1640 1 --2- 172.21.15.28:0/360402480 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe7e8066470 0x7fe7e8068930 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe800000f70 tx=0x7fe800007e90 comp rx=0 tx=0).stop 2023-11-28T19:32:36.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.017+0000 7fe80c2d1640 1 -- 172.21.15.28:0/360402480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe80413a1e0 msgr2=0x7fe8041ddb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:36.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.017+0000 7fe80c2d1640 1 --2- 172.21.15.28:0/360402480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe80413a1e0 0x7fe8041ddb40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00efc0 tx=0x7fe7fc00c490 comp rx=0 tx=0).stop 2023-11-28T19:32:36.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.017+0000 7fe80c2d1640 1 -- 172.21.15.28:0/360402480 shutdown_connections 2023-11-28T19:32:36.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.017+0000 7fe80c2d1640 1 --2- 172.21.15.28:0/360402480 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fe7e8066470 0x7fe7e8068930 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:36.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.017+0000 7fe80c2d1640 1 --2- 172.21.15.28:0/360402480 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fe80413a1e0 0x7fe8041ddb40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:36.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.017+0000 7fe80c2d1640 1 --2- 172.21.15.28:0/360402480 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8040b9650 0x7fe804139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:36.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.017+0000 7fe80c2d1640 1 --2- 172.21.15.28:0/360402480 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fe8040b7a90 0x7fe804141940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:36.022 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.017+0000 7fe80c2d1640 1 -- 172.21.15.28:0/360402480 >> 172.21.15.28:0/360402480 conn(0x7fe80406e770 msgr2=0x7fe8040bca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:36.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.021+0000 7fe80c2d1640 1 -- 172.21.15.28:0/360402480 shutdown_connections 2023-11-28T19:32:36.023 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.021+0000 7fe80c2d1640 1 -- 172.21.15.28:0/360402480 wait complete. 2023-11-28T19:32:36.037 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-11-28T19:32:36.038 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T19:32:36.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f0528d5c640 1 Processor -- start 2023-11-28T19:32:36.162 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f0528d5c640 1 -- start start 2023-11-28T19:32:36.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f0528d5c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f052406ab60 0x7f052414b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:36.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f0528d5c640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05240bce60 con 0x7f05240bbad0 2023-11-28T19:32:36.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f0528d5c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05240a6b70 con 0x7f052406af40 2023-11-28T19:32:36.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f0528d5c640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05240bd5d0 con 0x7f052406ab60 2023-11-28T19:32:36.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f052259c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f052406ab60 0x7f052414b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:36.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f052259c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f052406ab60 0x7f052414b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53074/0 (socket says 172.21.15.28:53074) 2023-11-28T19:32:36.163 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f052259c640 1 -- 172.21.15.28:0/3476990554 learned_addr learned my addr 172.21.15.28:0/3476990554 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:36.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f052259c640 1 -- 172.21.15.28:0/3476990554 >> v1:172.21.15.131:6789/0 conn(0x7f052406af40 legacy=0x7f0524155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:36.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f052259c640 1 -- 172.21.15.28:0/3476990554 >> v1:172.21.15.28:6789/0 conn(0x7f05240bbad0 legacy=0x7f05240a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:36.164 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f052259c640 1 -- 172.21.15.28:0/3476990554 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05240bff70 con 0x7f052406ab60 2023-11-28T19:32:36.165 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f052259c640 1 --2- 172.21.15.28:0/3476990554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f052406ab60 0x7f052414b5f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f051c009e50 tx=0x7f051c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8808168f79a0d0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:36.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f052159a640 1 -- 172.21.15.28:0/3476990554 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c0a5770 con 0x7f052406ab60 2023-11-28T19:32:36.166 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f052159a640 1 -- 172.21.15.28:0/3476990554 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f051c0a58d0 con 0x7f052406ab60 2023-11-28T19:32:36.167 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.161+0000 7f052159a640 1 -- 172.21.15.28:0/3476990554 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f051c0a5c60 con 0x7f052406ab60 2023-11-28T19:32:36.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 -- 172.21.15.28:0/3476990554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f052406ab60 msgr2=0x7f052414b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:36.175 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 --2- 172.21.15.28:0/3476990554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f052406ab60 0x7f052414b5f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f051c009e50 tx=0x7f051c01c9a0 comp rx=0 tx=0).stop 2023-11-28T19:32:36.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 -- 172.21.15.28:0/3476990554 shutdown_connections 2023-11-28T19:32:36.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 --2- 172.21.15.28:0/3476990554 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f052406ab60 0x7f052414b5f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:36.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 -- 172.21.15.28:0/3476990554 >> 172.21.15.28:0/3476990554 conn(0x7f05240c0c90 msgr2=0x7f05240c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:36.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 -- 172.21.15.28:0/3476990554 shutdown_connections 2023-11-28T19:32:36.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 -- 172.21.15.28:0/3476990554 wait complete. 2023-11-28T19:32:36.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 Processor -- start 2023-11-28T19:32:36.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 -- start start 2023-11-28T19:32:36.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f052406ab60 0x7f0524143660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:36.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f052406af40 0x7f05240b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:36.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05240bbad0 0x7f052414a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:36.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05240b5af0 con 0x7f05240bbad0 2023-11-28T19:32:36.176 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05241e4e90 con 0x7f052406ab60 2023-11-28T19:32:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0528d5c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05240b4250 con 0x7f052406af40 2023-11-28T19:32:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0522d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05240bbad0 0x7f052414a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0522d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05240bbad0 0x7f052414a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53076/0 (socket says 172.21.15.28:53076) 2023-11-28T19:32:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0522d9d640 1 -- 172.21.15.28:0/3869412900 learned_addr learned my addr 172.21.15.28:0/3869412900 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f052259c640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f052406ab60 0x7f0524143660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0521d9b640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f052406af40 0x7f05240b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0522d9d640 1 -- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f052406af40 msgr2=0x7f05240b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0522d9d640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f052406af40 0x7f05240b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0522d9d640 1 -- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f052406ab60 msgr2=0x7f0524143660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0522d9d640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f052406ab60 0x7f0524143660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0522d9d640 1 -- 172.21.15.28:0/3869412900 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c009b30 con 0x7f05240bbad0 2023-11-28T19:32:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0521d9b640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f052406af40 0x7f05240b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:36.177 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f0522d9d640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05240bbad0 0x7f052414a850 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f051400c440 tx=0x7f051400c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:36.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.165+0000 7f051affd640 1 -- 172.21.15.28:0/3869412900 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0514003600 con 0x7f05240bbad0 2023-11-28T19:32:36.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.169+0000 7f051affd640 1 -- 172.21.15.28:0/3869412900 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0514003780 con 0x7f05240bbad0 2023-11-28T19:32:36.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.169+0000 7f0528d5c640 1 -- 172.21.15.28:0/3869412900 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05240b5420 con 0x7f05240bbad0 2023-11-28T19:32:36.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.169+0000 7f051affd640 1 -- 172.21.15.28:0/3869412900 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0514003b30 con 0x7f05240bbad0 2023-11-28T19:32:36.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.169+0000 7f0528d5c640 1 -- 172.21.15.28:0/3869412900 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05241e4560 con 0x7f05240bbad0 2023-11-28T19:32:36.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.169+0000 7f0528d5c640 1 -- 172.21.15.28:0/3869412900 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05241e5020 con 0x7f05240bbad0 2023-11-28T19:32:36.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.169+0000 7f051affd640 1 -- 172.21.15.28:0/3869412900 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f0514003c90 con 0x7f05240bbad0 2023-11-28T19:32:36.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.169+0000 7f051affd640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0504066470 0x7f0504068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:36.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.169+0000 7f051affd640 1 -- 172.21.15.28:0/3869412900 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0514083390 con 0x7f05240bbad0 2023-11-28T19:32:36.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.169+0000 7f052259c640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0504066470 0x7f0504068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:36.178 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.169+0000 7f052259c640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0504066470 0x7f0504068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f051c0ae000 tx=0x7f051c0a7070 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:36.179 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.173+0000 7f051affd640 1 -- 172.21.15.28:0/3869412900 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f05140508a0 con 0x7f05240bbad0 2023-11-28T19:32:36.327 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.325+0000 7f0528d5c640 1 -- 172.21.15.28:0/3869412900 --> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0524159d60 con 0x7f0504066470 2023-11-28T19:32:36.347 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.345+0000 7f051affd640 1 -- 172.21.15.28:0/3869412900 <== mgr.4100 v2:172.21.15.131:6832/3367043860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270516 (secure 0 0 0) 0x7f051c0bc090 con 0x7f0504066470 2023-11-28T19:32:36.350 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:36.352 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-28T19:32:36.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.349+0000 7f0528d5c640 1 -- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0504066470 msgr2=0x7f0504068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:36.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.349+0000 7f0528d5c640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0504066470 0x7f0504068930 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f051c0ae000 tx=0x7f051c0a7070 comp rx=0 tx=0).stop 2023-11-28T19:32:36.353 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.349+0000 7f0528d5c640 1 -- 172.21.15.28:0/3869412900 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05240bbad0 msgr2=0x7f052414a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:36.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.349+0000 7f0528d5c640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05240bbad0 0x7f052414a850 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f051400c440 tx=0x7f051400c900 comp rx=0 tx=0).stop 2023-11-28T19:32:36.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.349+0000 7f0528d5c640 1 -- 172.21.15.28:0/3869412900 shutdown_connections 2023-11-28T19:32:36.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.349+0000 7f0528d5c640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f0504066470 0x7f0504068930 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:36.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.349+0000 7f0528d5c640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f05240bbad0 0x7f052414a850 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:36.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.349+0000 7f0528d5c640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f052406af40 0x7f05240b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:36.354 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.349+0000 7f0528d5c640 1 --2- 172.21.15.28:0/3869412900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f052406ab60 0x7f0524143660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:36.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.349+0000 7f0528d5c640 1 -- 172.21.15.28:0/3869412900 >> 172.21.15.28:0/3869412900 conn(0x7f05240c0c90 msgr2=0x7f05240bb2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:36.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.349+0000 7f0528d5c640 1 -- 172.21.15.28:0/3869412900 shutdown_connections 2023-11-28T19:32:36.355 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:36.349+0000 7f0528d5c640 1 -- 172.21.15.28:0/3869412900 wait complete. 2023-11-28T19:32:36.366 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-11-28T19:32:35.151923+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236848,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737872,"statfs":{"total":773094113280,"available":772851580928,"internally_reserved":0,"allocated":4136960,"data_stored":2297116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.639204"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.518995+0000","last_change":"2023-11-28T19:32:23.546975+0000","last_active":"2023-11-28T19:32:24.518995+0000","last_peered":"2023-11-28T19:32:24.518995+0000","last_clean":"2023-11-28T19:32:24.518995+0000","last_became_active":"2023-11-28T19:32:23.542855+0000","last_became_peered":"2023-11-28T19:32:23.542855+0000","last_unstale":"2023-11-28T19:32:24.518995+0000","last_undegraded":"2023-11-28T19:32:24.518995+0000","last_fullsized":"2023-11-28T19:32:24.518995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:44:38.892376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.517837+0000","last_change":"2023-11-28T19:32:23.548077+0000","last_active":"2023-11-28T19:32:24.517837+0000","last_peered":"2023-11-28T19:32:24.517837+0000","last_clean":"2023-11-28T19:32:24.517837+0000","last_became_active":"2023-11-28T19:32:23.546891+0000","last_became_peered":"2023-11-28T19:32:23.546891+0000","last_unstale":"2023-11-28T19:32:24.517837+0000","last_undegraded":"2023-11-28T19:32:24.517837+0000","last_fullsized":"2023-11-28T19:32:24.517837+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:01.121564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.607253+0000","last_change":"2023-11-28T19:32:23.564546+0000","last_active":"2023-11-28T19:32:24.607253+0000","last_peered":"2023-11-28T19:32:24.607253+0000","last_clean":"2023-11-28T19:32:24.607253+0000","last_became_active":"2023-11-28T19:32:23.563811+0000","last_became_peered":"2023-11-28T19:32:23.563811+0000","last_unstale":"2023-11-28T19:32:24.607253+0000","last_undegraded":"2023-11-28T19:32:24.607253+0000","last_fullsized":"2023-11-28T19:32:24.607253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:36.930397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.120707+0000","last_change":"2023-11-28T19:32:23.535855+0000","last_active":"2023-11-28T19:32:25.120707+0000","last_peered":"2023-11-28T19:32:25.120707+0000","last_clean":"2023-11-28T19:32:25.120707+0000","last_became_active":"2023-11-28T19:32:23.534929+0000","last_became_peered":"2023-11-28T19:32:23.534929+0000","last_unstale":"2023-11-28T19:32:25.120707+0000","last_undegraded":"2023-11-28T19:32:25.120707+0000","last_fullsized":"2023-11-28T19:32:25.120707+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:37.200846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707227+0000","last_change":"2023-11-28T19:32:23.535230+0000","last_active":"2023-11-28T19:32:25.707227+0000","last_peered":"2023-11-28T19:32:25.707227+0000","last_clean":"2023-11-28T19:32:25.707227+0000","last_became_active":"2023-11-28T19:32:23.534387+0000","last_became_peered":"2023-11-28T19:32:23.534387+0000","last_unstale":"2023-11-28T19:32:25.707227+0000","last_undegraded":"2023-11-28T19:32:25.707227+0000","last_fullsized":"2023-11-28T19:32:25.707227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:24.428671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.517184+0000","last_change":"2023-11-28T19:32:23.534830+0000","last_active":"2023-11-28T19:32:24.517184+0000","last_peered":"2023-11-28T19:32:24.517184+0000","last_clean":"2023-11-28T19:32:24.517184+0000","last_became_active":"2023-11-28T19:32:23.534056+0000","last_became_peered":"2023-11-28T19:32:23.534056+0000","last_unstale":"2023-11-28T19:32:24.517184+0000","last_undegraded":"2023-11-28T19:32:24.517184+0000","last_fullsized":"2023-11-28T19:32:24.517184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:47.080666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.708179+0000","last_change":"2023-11-28T19:32:23.553651+0000","last_active":"2023-11-28T19:32:25.708179+0000","last_peered":"2023-11-28T19:32:25.708179+0000","last_clean":"2023-11-28T19:32:25.708179+0000","last_became_active":"2023-11-28T19:32:23.551963+0000","last_became_peered":"2023-11-28T19:32:23.551963+0000","last_unstale":"2023-11-28T19:32:25.708179+0000","last_undegraded":"2023-11-28T19:32:25.708179+0000","last_fullsized":"2023-11-28T19:32:25.708179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:41:57.040701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707389+0000","last_change":"2023-11-28T19:32:23.555968+0000","last_active":"2023-11-28T19:32:25.707389+0000","last_peered":"2023-11-28T19:32:25.707389+0000","last_clean":"2023-11-28T19:32:25.707389+0000","last_became_active":"2023-11-28T19:32:23.555228+0000","last_became_peered":"2023-11-28T19:32:23.555228+0000","last_unstale":"2023-11-28T19:32:25.707389+0000","last_undegraded":"2023-11-28T19:32:25.707389+0000","last_fullsized":"2023-11-28T19:32:25.707389+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:37.919182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.518637+0000","last_change":"2023-11-28T19:32:23.536561+0000","last_active":"2023-11-28T19:32:24.518637+0000","last_peered":"2023-11-28T19:32:24.518637+0000","last_clean":"2023-11-28T19:32:24.518637+0000","last_became_active":"2023-11-28T19:32:23.535782+0000","last_became_peered":"2023-11-28T19:32:23.535782+0000","last_unstale":"2023-11-28T19:32:24.518637+0000","last_undegraded":"2023-11-28T19:32:24.518637+0000","last_fullsized":"2023-11-28T19:32:24.518637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:46:22.848432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.121325+0000","last_change":"2023-11-28T19:32:23.533624+0000","last_active":"2023-11-28T19:32:25.121325+0000","last_peered":"2023-11-28T19:32:25.121325+0000","last_clean":"2023-11-28T19:32:25.121325+0000","last_became_active":"2023-11-28T19:32:23.532855+0000","last_became_peered":"2023-11-28T19:32:23.532855+0000","last_unstale":"2023-11-28T19:32:25.121325+0000","last_undegraded":"2023-11-28T19:32:25.121325+0000","last_fullsized":"2023-11-28T19:32:25.121325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:41:57.040701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.708190+0000","last_change":"2023-11-28T19:32:23.556589+0000","last_active":"2023-11-28T19:32:25.708190+0000","last_peered":"2023-11-28T19:32:25.708190+0000","last_clean":"2023-11-28T19:32:25.708190+0000","last_became_active":"2023-11-28T19:32:23.555879+0000","last_became_peered":"2023-11-28T19:32:23.555879+0000","last_unstale":"2023-11-28T19:32:25.708190+0000","last_undegraded":"2023-11-28T19:32:25.708190+0000","last_fullsized":"2023-11-28T19:32:25.708190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:49.417425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.607043+0000","last_change":"2023-11-28T19:32:23.545785+0000","last_active":"2023-11-28T19:32:24.607043+0000","last_peered":"2023-11-28T19:32:24.607043+0000","last_clean":"2023-11-28T19:32:24.607043+0000","last_became_active":"2023-11-28T19:32:23.544332+0000","last_became_peered":"2023-11-28T19:32:23.544332+0000","last_unstale":"2023-11-28T19:32:24.607043+0000","last_undegraded":"2023-11-28T19:32:24.607043+0000","last_fullsized":"2023-11-28T19:32:24.607043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:41:57.040701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707553+0000","last_change":"2023-11-28T19:32:23.529587+0000","last_active":"2023-11-28T19:32:25.707553+0000","last_peered":"2023-11-28T19:32:25.707553+0000","last_clean":"2023-11-28T19:32:25.707553+0000","last_became_active":"2023-11-28T19:32:23.528314+0000","last_became_peered":"2023-11-28T19:32:23.528314+0000","last_unstale":"2023-11-28T19:32:25.707553+0000","last_undegraded":"2023-11-28T19:32:25.707553+0000","last_fullsized":"2023-11-28T19:32:25.707553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:54.096591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516785+0000","last_change":"2023-11-28T19:32:23.541071+0000","last_active":"2023-11-28T19:32:24.516785+0000","last_peered":"2023-11-28T19:32:24.516785+0000","last_clean":"2023-11-28T19:32:24.516785+0000","last_became_active":"2023-11-28T19:32:23.540321+0000","last_became_peered":"2023-11-28T19:32:23.540321+0000","last_unstale":"2023-11-28T19:32:24.516785+0000","last_undegraded":"2023-11-28T19:32:24.516785+0000","last_fullsized":"2023-11-28T19:32:24.516785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:36:42.359597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.606412+0000","last_change":"2023-11-28T19:32:23.561607+0000","last_active":"2023-11-28T19:32:24.606412+0000","last_peered":"2023-11-28T19:32:24.606412+0000","last_clean":"2023-11-28T19:32:24.606412+0000","last_became_active":"2023-11-28T19:32:23.549789+0000","last_became_peered":"2023-11-28T19:32:23.549789+0000","last_unstale":"2023-11-28T19:32:24.606412+0000","last_undegraded":"2023-11-28T19:32:24.606412+0000","last_fullsized":"2023-11-28T19:32:24.606412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:30.423478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.708447+0000","last_change":"2023-11-28T19:32:23.557131+0000","last_active":"2023-11-28T19:32:25.708447+0000","last_peered":"2023-11-28T19:32:25.708447+0000","last_clean":"2023-11-28T19:32:25.708447+0000","last_became_active":"2023-11-28T19:32:23.556461+0000","last_became_peered":"2023-11-28T19:32:23.556461+0000","last_unstale":"2023-11-28T19:32:25.708447+0000","last_undegraded":"2023-11-28T19:32:25.708447+0000","last_fullsized":"2023-11-28T19:32:25.708447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:36.930397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.708369+0000","last_change":"2023-11-28T19:32:23.549553+0000","last_active":"2023-11-28T19:32:25.708369+0000","last_peered":"2023-11-28T19:32:25.708369+0000","last_clean":"2023-11-28T19:32:25.708369+0000","last_became_active":"2023-11-28T19:32:23.548822+0000","last_became_peered":"2023-11-28T19:32:23.548822+0000","last_unstale":"2023-11-28T19:32:25.708369+0000","last_undegraded":"2023-11-28T19:32:25.708369+0000","last_fullsized":"2023-11-28T19:32:25.708369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:25.553951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.517722+0000","last_change":"2023-11-28T19:32:23.554429+0000","last_active":"2023-11-28T19:32:24.517722+0000","last_peered":"2023-11-28T19:32:24.517722+0000","last_clean":"2023-11-28T19:32:24.517722+0000","last_became_active":"2023-11-28T19:32:23.554066+0000","last_became_peered":"2023-11-28T19:32:23.554066+0000","last_unstale":"2023-11-28T19:32:24.517722+0000","last_undegraded":"2023-11-28T19:32:24.517722+0000","last_fullsized":"2023-11-28T19:32:24.517722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:37:18.193272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516263+0000","last_change":"2023-11-28T19:32:23.537198+0000","last_active":"2023-11-28T19:32:24.516263+0000","last_peered":"2023-11-28T19:32:24.516263+0000","last_clean":"2023-11-28T19:32:24.516263+0000","last_became_active":"2023-11-28T19:32:23.536393+0000","last_became_peered":"2023-11-28T19:32:23.536393+0000","last_unstale":"2023-11-28T19:32:24.516263+0000","last_undegraded":"2023-11-28T19:32:24.516263+0000","last_fullsized":"2023-11-28T19:32:24.516263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:22:12.070332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707368+0000","last_change":"2023-11-28T19:32:23.539393+0000","last_active":"2023-11-28T19:32:25.707368+0000","last_peered":"2023-11-28T19:32:25.707368+0000","last_clean":"2023-11-28T19:32:25.707368+0000","last_became_active":"2023-11-28T19:32:23.538571+0000","last_became_peered":"2023-11-28T19:32:23.538571+0000","last_unstale":"2023-11-28T19:32:25.707368+0000","last_undegraded":"2023-11-28T19:32:25.707368+0000","last_fullsized":"2023-11-28T19:32:25.707368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:24.762063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516559+0000","last_change":"2023-11-28T19:32:23.546876+0000","last_active":"2023-11-28T19:32:24.516559+0000","last_peered":"2023-11-28T19:32:24.516559+0000","last_clean":"2023-11-28T19:32:24.516559+0000","last_became_active":"2023-11-28T19:32:23.546220+0000","last_became_peered":"2023-11-28T19:32:23.546220+0000","last_unstale":"2023-11-28T19:32:24.516559+0000","last_undegraded":"2023-11-28T19:32:24.516559+0000","last_fullsized":"2023-11-28T19:32:24.516559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:44:38.892376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516861+0000","last_change":"2023-11-28T19:32:23.561882+0000","last_active":"2023-11-28T19:32:24.516861+0000","last_peered":"2023-11-28T19:32:24.516861+0000","last_clean":"2023-11-28T19:32:24.516861+0000","last_became_active":"2023-11-28T19:32:23.561166+0000","last_became_peered":"2023-11-28T19:32:23.561166+0000","last_unstale":"2023-11-28T19:32:24.516861+0000","last_undegraded":"2023-11-28T19:32:24.516861+0000","last_fullsized":"2023-11-28T19:32:24.516861+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.876246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647101+0000","last_change":"2023-11-28T19:32:23.555413+0000","last_active":"2023-11-28T19:32:24.647101+0000","last_peered":"2023-11-28T19:32:24.647101+0000","last_clean":"2023-11-28T19:32:24.647101+0000","last_became_active":"2023-11-28T19:32:23.555044+0000","last_became_peered":"2023-11-28T19:32:23.555044+0000","last_unstale":"2023-11-28T19:32:24.647101+0000","last_undegraded":"2023-11-28T19:32:24.647101+0000","last_fullsized":"2023-11-28T19:32:24.647101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:44:38.892376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.606427+0000","last_change":"2023-11-28T19:32:23.534811+0000","last_active":"2023-11-28T19:32:24.606427+0000","last_peered":"2023-11-28T19:32:24.606427+0000","last_clean":"2023-11-28T19:32:24.606427+0000","last_became_active":"2023-11-28T19:32:23.534034+0000","last_became_peered":"2023-11-28T19:32:23.534034+0000","last_unstale":"2023-11-28T19:32:24.606427+0000","last_undegraded":"2023-11-28T19:32:24.606427+0000","last_fullsized":"2023-11-28T19:32:24.606427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:46:22.848432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.121626+0000","last_change":"2023-11-28T19:32:23.553216+0000","last_active":"2023-11-28T19:32:25.121626+0000","last_peered":"2023-11-28T19:32:25.121626+0000","last_clean":"2023-11-28T19:32:25.121626+0000","last_became_active":"2023-11-28T19:32:23.552389+0000","last_became_peered":"2023-11-28T19:32:23.552389+0000","last_unstale":"2023-11-28T19:32:25.121626+0000","last_undegraded":"2023-11-28T19:32:25.121626+0000","last_fullsized":"2023-11-28T19:32:25.121626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:25.553951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.517925+0000","last_change":"2023-11-28T19:32:23.551477+0000","last_active":"2023-11-28T19:32:24.517925+0000","last_peered":"2023-11-28T19:32:24.517925+0000","last_clean":"2023-11-28T19:32:24.517925+0000","last_became_active":"2023-11-28T19:32:23.550480+0000","last_became_peered":"2023-11-28T19:32:23.550480+0000","last_unstale":"2023-11-28T19:32:24.517925+0000","last_undegraded":"2023-11-28T19:32:24.517925+0000","last_fullsized":"2023-11-28T19:32:24.517925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:49.804809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.121449+0000","last_change":"2023-11-28T19:32:23.545013+0000","last_active":"2023-11-28T19:32:25.121449+0000","last_peered":"2023-11-28T19:32:25.121449+0000","last_clean":"2023-11-28T19:32:25.121449+0000","last_became_active":"2023-11-28T19:32:23.544225+0000","last_became_peered":"2023-11-28T19:32:23.544225+0000","last_unstale":"2023-11-28T19:32:25.121449+0000","last_undegraded":"2023-11-28T19:32:25.121449+0000","last_fullsized":"2023-11-28T19:32:25.121449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:49.417425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.607182+0000","last_change":"2023-11-28T19:32:23.562910+0000","last_active":"2023-11-28T19:32:24.607182+0000","last_peered":"2023-11-28T19:32:24.607182+0000","last_clean":"2023-11-28T19:32:24.607182+0000","last_became_active":"2023-11-28T19:32:23.562295+0000","last_became_peered":"2023-11-28T19:32:23.562295+0000","last_unstale":"2023-11-28T19:32:24.607182+0000","last_undegraded":"2023-11-28T19:32:24.607182+0000","last_fullsized":"2023-11-28T19:32:24.607182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:49.417425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516915+0000","last_change":"2023-11-28T19:32:23.562250+0000","last_active":"2023-11-28T19:32:24.516915+0000","last_peered":"2023-11-28T19:32:24.516915+0000","last_clean":"2023-11-28T19:32:24.516915+0000","last_became_active":"2023-11-28T19:32:23.561118+0000","last_became_peered":"2023-11-28T19:32:23.561118+0000","last_unstale":"2023-11-28T19:32:24.516915+0000","last_undegraded":"2023-11-28T19:32:24.516915+0000","last_fullsized":"2023-11-28T19:32:24.516915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:43:58.616153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707701+0000","last_change":"2023-11-28T19:32:23.550169+0000","last_active":"2023-11-28T19:32:25.707701+0000","last_peered":"2023-11-28T19:32:25.707701+0000","last_clean":"2023-11-28T19:32:25.707701+0000","last_became_active":"2023-11-28T19:32:23.548617+0000","last_became_peered":"2023-11-28T19:32:23.548617+0000","last_unstale":"2023-11-28T19:32:25.707701+0000","last_undegraded":"2023-11-28T19:32:25.707701+0000","last_fullsized":"2023-11-28T19:32:25.707701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:30.423478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.518615+0000","last_change":"2023-11-28T19:32:23.550973+0000","last_active":"2023-11-28T19:32:24.518615+0000","last_peered":"2023-11-28T19:32:24.518615+0000","last_clean":"2023-11-28T19:32:24.518615+0000","last_became_active":"2023-11-28T19:32:23.546728+0000","last_became_peered":"2023-11-28T19:32:23.546728+0000","last_unstale":"2023-11-28T19:32:24.518615+0000","last_undegraded":"2023-11-28T19:32:24.518615+0000","last_fullsized":"2023-11-28T19:32:24.518615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:31.539700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707443+0000","last_change":"2023-11-28T19:32:23.554484+0000","last_active":"2023-11-28T19:32:25.707443+0000","last_peered":"2023-11-28T19:32:25.707443+0000","last_clean":"2023-11-28T19:32:25.707443+0000","last_became_active":"2023-11-28T19:32:23.551313+0000","last_became_peered":"2023-11-28T19:32:23.551313+0000","last_unstale":"2023-11-28T19:32:25.707443+0000","last_undegraded":"2023-11-28T19:32:25.707443+0000","last_fullsized":"2023-11-28T19:32:25.707443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:43:58.616153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647379+0000","last_change":"2023-11-28T19:32:23.551304+0000","last_active":"2023-11-28T19:32:24.647379+0000","last_peered":"2023-11-28T19:32:24.647379+0000","last_clean":"2023-11-28T19:32:24.647379+0000","last_became_active":"2023-11-28T19:32:23.550939+0000","last_became_peered":"2023-11-28T19:32:23.550939+0000","last_unstale":"2023-11-28T19:32:24.647379+0000","last_undegraded":"2023-11-28T19:32:24.647379+0000","last_fullsized":"2023-11-28T19:32:24.647379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:37.919182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.579926+0000","last_change":"2023-11-28T19:32:22.543742+0000","last_active":"2023-11-28T19:32:23.579926+0000","last_peered":"2023-11-28T19:32:23.579926+0000","last_clean":"2023-11-28T19:32:23.579926+0000","last_became_active":"2023-11-28T19:32:22.543130+0000","last_became_peered":"2023-11-28T19:32:22.543130+0000","last_unstale":"2023-11-28T19:32:23.579926+0000","last_undegraded":"2023-11-28T19:32:23.579926+0000","last_fullsized":"2023-11-28T19:32:23.579926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:48.730471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.519117+0000","last_change":"2023-11-28T19:32:23.542549+0000","last_active":"2023-11-28T19:32:24.519117+0000","last_peered":"2023-11-28T19:32:24.519117+0000","last_clean":"2023-11-28T19:32:24.519117+0000","last_became_active":"2023-11-28T19:32:23.541235+0000","last_became_peered":"2023-11-28T19:32:23.541235+0000","last_unstale":"2023-11-28T19:32:24.519117+0000","last_undegraded":"2023-11-28T19:32:24.519117+0000","last_fullsized":"2023-11-28T19:32:24.519117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.876246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647469+0000","last_change":"2023-11-28T19:32:22.529781+0000","last_active":"2023-11-28T19:32:24.647469+0000","last_peered":"2023-11-28T19:32:24.647469+0000","last_clean":"2023-11-28T19:32:24.647469+0000","last_became_active":"2023-11-28T19:32:22.529362+0000","last_became_peered":"2023-11-28T19:32:22.529362+0000","last_unstale":"2023-11-28T19:32:24.647469+0000","last_undegraded":"2023-11-28T19:32:24.647469+0000","last_fullsized":"2023-11-28T19:32:24.647469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:20:12.097738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.517210+0000","last_change":"2023-11-28T19:32:23.562576+0000","last_active":"2023-11-28T19:32:24.517210+0000","last_peered":"2023-11-28T19:32:24.517210+0000","last_clean":"2023-11-28T19:32:24.517210+0000","last_became_active":"2023-11-28T19:32:23.561766+0000","last_became_peered":"2023-11-28T19:32:23.561766+0000","last_unstale":"2023-11-28T19:32:24.517210+0000","last_undegraded":"2023-11-28T19:32:24.517210+0000","last_fullsized":"2023-11-28T19:32:24.517210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:30.423478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.569669+0000","last_change":"2023-11-28T19:32:22.532019+0000","last_active":"2023-11-28T19:32:23.569669+0000","last_peered":"2023-11-28T19:32:23.569669+0000","last_clean":"2023-11-28T19:32:23.569669+0000","last_became_active":"2023-11-28T19:32:22.531736+0000","last_became_peered":"2023-11-28T19:32:22.531736+0000","last_unstale":"2023-11-28T19:32:23.569669+0000","last_undegraded":"2023-11-28T19:32:23.569669+0000","last_fullsized":"2023-11-28T19:32:23.569669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:30.527363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.121626+0000","last_change":"2023-11-28T19:32:23.544638+0000","last_active":"2023-11-28T19:32:25.121626+0000","last_peered":"2023-11-28T19:32:25.121626+0000","last_clean":"2023-11-28T19:32:25.121626+0000","last_became_active":"2023-11-28T19:32:23.543177+0000","last_became_peered":"2023-11-28T19:32:23.543177+0000","last_unstale":"2023-11-28T19:32:25.121626+0000","last_undegraded":"2023-11-28T19:32:25.121626+0000","last_fullsized":"2023-11-28T19:32:25.121626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:36.930397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.571282+0000","last_change":"2023-11-28T19:32:22.527150+0000","last_active":"2023-11-28T19:32:23.571282+0000","last_peered":"2023-11-28T19:32:23.571282+0000","last_clean":"2023-11-28T19:32:23.571282+0000","last_became_active":"2023-11-28T19:32:22.526767+0000","last_became_peered":"2023-11-28T19:32:22.526767+0000","last_unstale":"2023-11-28T19:32:23.571282+0000","last_undegraded":"2023-11-28T19:32:23.571282+0000","last_fullsized":"2023-11-28T19:32:23.571282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:59.030521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.708026+0000","last_change":"2023-11-28T19:32:23.550658+0000","last_active":"2023-11-28T19:32:25.708026+0000","last_peered":"2023-11-28T19:32:25.708026+0000","last_clean":"2023-11-28T19:32:25.708026+0000","last_became_active":"2023-11-28T19:32:23.549432+0000","last_became_peered":"2023-11-28T19:32:23.549432+0000","last_unstale":"2023-11-28T19:32:25.708026+0000","last_undegraded":"2023-11-28T19:32:25.708026+0000","last_fullsized":"2023-11-28T19:32:25.708026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:58.470226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.577049+0000","last_change":"2023-11-28T19:32:22.529096+0000","last_active":"2023-11-28T19:32:23.577049+0000","last_peered":"2023-11-28T19:32:23.577049+0000","last_clean":"2023-11-28T19:32:23.577049+0000","last_became_active":"2023-11-28T19:32:22.528442+0000","last_became_peered":"2023-11-28T19:32:22.528442+0000","last_unstale":"2023-11-28T19:32:23.577049+0000","last_undegraded":"2023-11-28T19:32:23.577049+0000","last_fullsized":"2023-11-28T19:32:23.577049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:32:07.521544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.606715+0000","last_change":"2023-11-28T19:32:23.562824+0000","last_active":"2023-11-28T19:32:24.606715+0000","last_peered":"2023-11-28T19:32:24.606715+0000","last_clean":"2023-11-28T19:32:24.606715+0000","last_became_active":"2023-11-28T19:32:23.562233+0000","last_became_peered":"2023-11-28T19:32:23.562233+0000","last_unstale":"2023-11-28T19:32:24.606715+0000","last_undegraded":"2023-11-28T19:32:24.606715+0000","last_fullsized":"2023-11-28T19:32:24.606715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:19.482916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.576923+0000","last_change":"2023-11-28T19:32:22.538846+0000","last_active":"2023-11-28T19:32:23.576923+0000","last_peered":"2023-11-28T19:32:23.576923+0000","last_clean":"2023-11-28T19:32:23.576923+0000","last_became_active":"2023-11-28T19:32:22.538210+0000","last_became_peered":"2023-11-28T19:32:22.538210+0000","last_unstale":"2023-11-28T19:32:23.576923+0000","last_undegraded":"2023-11-28T19:32:23.576923+0000","last_fullsized":"2023-11-28T19:32:23.576923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:02.714250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516403+0000","last_change":"2023-11-28T19:32:23.548626+0000","last_active":"2023-11-28T19:32:24.516403+0000","last_peered":"2023-11-28T19:32:24.516403+0000","last_clean":"2023-11-28T19:32:24.516403+0000","last_became_active":"2023-11-28T19:32:23.547946+0000","last_became_peered":"2023-11-28T19:32:23.547946+0000","last_unstale":"2023-11-28T19:32:24.516403+0000","last_undegraded":"2023-11-28T19:32:24.516403+0000","last_fullsized":"2023-11-28T19:32:24.516403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:36.883890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.515875+0000","last_change":"2023-11-28T19:32:22.518161+0000","last_active":"2023-11-28T19:32:23.515875+0000","last_peered":"2023-11-28T19:32:23.515875+0000","last_clean":"2023-11-28T19:32:23.515875+0000","last_became_active":"2023-11-28T19:32:22.517429+0000","last_became_peered":"2023-11-28T19:32:22.517429+0000","last_unstale":"2023-11-28T19:32:23.515875+0000","last_undegraded":"2023-11-28T19:32:23.515875+0000","last_fullsized":"2023-11-28T19:32:23.515875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:17.132804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.120348+0000","last_change":"2023-11-28T19:32:23.544509+0000","last_active":"2023-11-28T19:32:25.120348+0000","last_peered":"2023-11-28T19:32:25.120348+0000","last_clean":"2023-11-28T19:32:25.120348+0000","last_became_active":"2023-11-28T19:32:23.543716+0000","last_became_peered":"2023-11-28T19:32:23.543716+0000","last_unstale":"2023-11-28T19:32:25.120348+0000","last_undegraded":"2023-11-28T19:32:25.120348+0000","last_fullsized":"2023-11-28T19:32:25.120348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:46:22.848432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.518630+0000","last_change":"2023-11-28T19:32:22.543854+0000","last_active":"2023-11-28T19:32:23.518630+0000","last_peered":"2023-11-28T19:32:23.518630+0000","last_clean":"2023-11-28T19:32:23.518630+0000","last_became_active":"2023-11-28T19:32:22.543216+0000","last_became_peered":"2023-11-28T19:32:22.543216+0000","last_unstale":"2023-11-28T19:32:23.518630+0000","last_undegraded":"2023-11-28T19:32:23.518630+0000","last_fullsized":"2023-11-28T19:32:23.518630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:57.306413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.607388+0000","last_change":"2023-11-28T19:32:23.545727+0000","last_active":"2023-11-28T19:32:24.607388+0000","last_peered":"2023-11-28T19:32:24.607388+0000","last_clean":"2023-11-28T19:32:24.607388+0000","last_became_active":"2023-11-28T19:32:23.544734+0000","last_became_peered":"2023-11-28T19:32:23.544734+0000","last_unstale":"2023-11-28T19:32:24.607388+0000","last_undegraded":"2023-11-28T19:32:24.607388+0000","last_fullsized":"2023-11-28T19:32:24.607388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:22:12.070332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.520398+0000","last_change":"2023-11-28T19:32:22.535414+0000","last_active":"2023-11-28T19:32:23.520398+0000","last_peered":"2023-11-28T19:32:23.520398+0000","last_clean":"2023-11-28T19:32:23.520398+0000","last_became_active":"2023-11-28T19:32:22.534719+0000","last_became_peered":"2023-11-28T19:32:22.534719+0000","last_unstale":"2023-11-28T19:32:23.520398+0000","last_undegraded":"2023-11-28T19:32:23.520398+0000","last_fullsized":"2023-11-28T19:32:23.520398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:41:56.028363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.517734+0000","last_change":"2023-11-28T19:32:23.554110+0000","last_active":"2023-11-28T19:32:24.517734+0000","last_peered":"2023-11-28T19:32:24.517734+0000","last_clean":"2023-11-28T19:32:24.517734+0000","last_became_active":"2023-11-28T19:32:23.552020+0000","last_became_peered":"2023-11-28T19:32:23.552020+0000","last_unstale":"2023-11-28T19:32:24.517734+0000","last_undegraded":"2023-11-28T19:32:24.517734+0000","last_fullsized":"2023-11-28T19:32:24.517734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:51.536803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647703+0000","last_change":"2023-11-28T19:32:22.528274+0000","last_active":"2023-11-28T19:32:24.647703+0000","last_peered":"2023-11-28T19:32:24.647703+0000","last_clean":"2023-11-28T19:32:24.647703+0000","last_became_active":"2023-11-28T19:32:22.527831+0000","last_became_peered":"2023-11-28T19:32:22.527831+0000","last_unstale":"2023-11-28T19:32:24.647703+0000","last_undegraded":"2023-11-28T19:32:24.647703+0000","last_fullsized":"2023-11-28T19:32:24.647703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:17.132804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516973+0000","last_change":"2023-11-28T19:32:23.551479+0000","last_active":"2023-11-28T19:32:24.516973+0000","last_peered":"2023-11-28T19:32:24.516973+0000","last_clean":"2023-11-28T19:32:24.516973+0000","last_became_active":"2023-11-28T19:32:23.550374+0000","last_became_peered":"2023-11-28T19:32:23.550374+0000","last_unstale":"2023-11-28T19:32:24.516973+0000","last_undegraded":"2023-11-28T19:32:24.516973+0000","last_fullsized":"2023-11-28T19:32:24.516973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:14.013929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.575523+0000","last_change":"2023-11-28T19:32:22.541667+0000","last_active":"2023-11-28T19:32:23.575523+0000","last_peered":"2023-11-28T19:32:23.575523+0000","last_clean":"2023-11-28T19:32:23.575523+0000","last_became_active":"2023-11-28T19:32:22.541017+0000","last_became_peered":"2023-11-28T19:32:22.541017+0000","last_unstale":"2023-11-28T19:32:23.575523+0000","last_undegraded":"2023-11-28T19:32:23.575523+0000","last_fullsized":"2023-11-28T19:32:23.575523+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:36.906845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.606936+0000","last_change":"2023-11-28T19:32:23.565859+0000","last_active":"2023-11-28T19:32:24.606936+0000","last_peered":"2023-11-28T19:32:24.606936+0000","last_clean":"2023-11-28T19:32:24.606936+0000","last_became_active":"2023-11-28T19:32:23.565138+0000","last_became_peered":"2023-11-28T19:32:23.565138+0000","last_unstale":"2023-11-28T19:32:24.606936+0000","last_undegraded":"2023-11-28T19:32:24.606936+0000","last_fullsized":"2023-11-28T19:32:24.606936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:37.200846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.579042+0000","last_change":"2023-11-28T19:32:22.532782+0000","last_active":"2023-11-28T19:32:23.579042+0000","last_peered":"2023-11-28T19:32:23.579042+0000","last_clean":"2023-11-28T19:32:23.579042+0000","last_became_active":"2023-11-28T19:32:22.532130+0000","last_became_peered":"2023-11-28T19:32:22.532130+0000","last_unstale":"2023-11-28T19:32:23.579042+0000","last_undegraded":"2023-11-28T19:32:23.579042+0000","last_fullsized":"2023-11-28T19:32:23.579042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:36.906845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.120614+0000","last_change":"2023-11-28T19:32:23.535291+0000","last_active":"2023-11-28T19:32:25.120614+0000","last_peered":"2023-11-28T19:32:25.120614+0000","last_clean":"2023-11-28T19:32:25.120614+0000","last_became_active":"2023-11-28T19:32:23.534499+0000","last_became_peered":"2023-11-28T19:32:23.534499+0000","last_unstale":"2023-11-28T19:32:25.120614+0000","last_undegraded":"2023-11-28T19:32:25.120614+0000","last_fullsized":"2023-11-28T19:32:25.120614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:19.482916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.580035+0000","last_change":"2023-11-28T19:32:22.543770+0000","last_active":"2023-11-28T19:32:23.580035+0000","last_peered":"2023-11-28T19:32:23.580035+0000","last_clean":"2023-11-28T19:32:23.580035+0000","last_became_active":"2023-11-28T19:32:22.543093+0000","last_became_peered":"2023-11-28T19:32:22.543093+0000","last_unstale":"2023-11-28T19:32:23.580035+0000","last_undegraded":"2023-11-28T19:32:23.580035+0000","last_fullsized":"2023-11-28T19:32:23.580035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:32:20.333154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516676+0000","last_change":"2023-11-28T19:32:23.547456+0000","last_active":"2023-11-28T19:32:24.516676+0000","last_peered":"2023-11-28T19:32:24.516676+0000","last_clean":"2023-11-28T19:32:24.516676+0000","last_became_active":"2023-11-28T19:32:23.546715+0000","last_became_peered":"2023-11-28T19:32:23.546715+0000","last_unstale":"2023-11-28T19:32:24.516676+0000","last_undegraded":"2023-11-28T19:32:24.516676+0000","last_fullsized":"2023-11-28T19:32:24.516676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:44.803677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.509587+0000","last_change":"2023-11-28T19:32:22.537217+0000","last_active":"2023-11-28T19:32:23.509587+0000","last_peered":"2023-11-28T19:32:23.509587+0000","last_clean":"2023-11-28T19:32:23.509587+0000","last_became_active":"2023-11-28T19:32:22.536807+0000","last_became_peered":"2023-11-28T19:32:22.536807+0000","last_unstale":"2023-11-28T19:32:23.509587+0000","last_undegraded":"2023-11-28T19:32:23.509587+0000","last_fullsized":"2023-11-28T19:32:23.509587+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:32:20.333154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707830+0000","last_change":"2023-11-28T19:32:23.556935+0000","last_active":"2023-11-28T19:32:25.707830+0000","last_peered":"2023-11-28T19:32:25.707830+0000","last_clean":"2023-11-28T19:32:25.707830+0000","last_became_active":"2023-11-28T19:32:23.556199+0000","last_became_peered":"2023-11-28T19:32:23.556199+0000","last_unstale":"2023-11-28T19:32:25.707830+0000","last_undegraded":"2023-11-28T19:32:25.707830+0000","last_fullsized":"2023-11-28T19:32:25.707830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:46:22.848432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.516233+0000","last_change":"2023-11-28T19:32:22.531677+0000","last_active":"2023-11-28T19:32:23.516233+0000","last_peered":"2023-11-28T19:32:23.516233+0000","last_clean":"2023-11-28T19:32:23.516233+0000","last_became_active":"2023-11-28T19:32:22.530853+0000","last_became_peered":"2023-11-28T19:32:22.530853+0000","last_unstale":"2023-11-28T19:32:23.516233+0000","last_undegraded":"2023-11-28T19:32:23.516233+0000","last_fullsized":"2023-11-28T19:32:23.516233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:35.871553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.518635+0000","last_change":"2023-11-28T19:32:23.542698+0000","last_active":"2023-11-28T19:32:24.518635+0000","last_peered":"2023-11-28T19:32:24.518635+0000","last_clean":"2023-11-28T19:32:24.518635+0000","last_became_active":"2023-11-28T19:32:23.541155+0000","last_became_peered":"2023-11-28T19:32:23.541155+0000","last_unstale":"2023-11-28T19:32:24.518635+0000","last_undegraded":"2023-11-28T19:32:24.518635+0000","last_fullsized":"2023-11-28T19:32:24.518635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:36.883890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.572293+0000","last_change":"2023-11-28T19:32:22.522503+0000","last_active":"2023-11-28T19:32:23.572293+0000","last_peered":"2023-11-28T19:32:23.572293+0000","last_clean":"2023-11-28T19:32:23.572293+0000","last_became_active":"2023-11-28T19:32:22.522095+0000","last_became_peered":"2023-11-28T19:32:22.522095+0000","last_unstale":"2023-11-28T19:32:23.572293+0000","last_undegraded":"2023-11-28T19:32:23.572293+0000","last_fullsized":"2023-11-28T19:32:23.572293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:57.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516876+0000","last_change":"2023-11-28T19:32:23.544008+0000","last_active":"2023-11-28T19:32:24.516876+0000","last_peered":"2023-11-28T19:32:24.516876+0000","last_clean":"2023-11-28T19:32:24.516876+0000","last_became_active":"2023-11-28T19:32:23.543254+0000","last_became_peered":"2023-11-28T19:32:23.543254+0000","last_unstale":"2023-11-28T19:32:24.516876+0000","last_undegraded":"2023-11-28T19:32:24.516876+0000","last_fullsized":"2023-11-28T19:32:24.516876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:37.919182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.572345+0000","last_change":"2023-11-28T19:32:22.531733+0000","last_active":"2023-11-28T19:32:23.572345+0000","last_peered":"2023-11-28T19:32:23.572345+0000","last_clean":"2023-11-28T19:32:23.572345+0000","last_became_active":"2023-11-28T19:32:22.530869+0000","last_became_peered":"2023-11-28T19:32:22.530869+0000","last_unstale":"2023-11-28T19:32:23.572345+0000","last_undegraded":"2023-11-28T19:32:23.572345+0000","last_fullsized":"2023-11-28T19:32:23.572345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:30.527363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.607028+0000","last_change":"2023-11-28T19:32:23.544517+0000","last_active":"2023-11-28T19:32:24.607028+0000","last_peered":"2023-11-28T19:32:24.607028+0000","last_clean":"2023-11-28T19:32:24.607028+0000","last_became_active":"2023-11-28T19:32:23.543790+0000","last_became_peered":"2023-11-28T19:32:23.543790+0000","last_unstale":"2023-11-28T19:32:24.607028+0000","last_undegraded":"2023-11-28T19:32:24.607028+0000","last_fullsized":"2023-11-28T19:32:24.607028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:58.470226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.579752+0000","last_change":"2023-11-28T19:32:22.543877+0000","last_active":"2023-11-28T19:32:23.579752+0000","last_peered":"2023-11-28T19:32:23.579752+0000","last_clean":"2023-11-28T19:32:23.579752+0000","last_became_active":"2023-11-28T19:32:22.543299+0000","last_became_peered":"2023-11-28T19:32:22.543299+0000","last_unstale":"2023-11-28T19:32:23.579752+0000","last_undegraded":"2023-11-28T19:32:23.579752+0000","last_fullsized":"2023-11-28T19:32:23.579752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:23.749725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.120832+0000","last_change":"2023-11-28T19:32:23.543742+0000","last_active":"2023-11-28T19:32:25.120832+0000","last_peered":"2023-11-28T19:32:25.120832+0000","last_clean":"2023-11-28T19:32:25.120832+0000","last_became_active":"2023-11-28T19:32:23.535753+0000","last_became_peered":"2023-11-28T19:32:23.535753+0000","last_unstale":"2023-11-28T19:32:25.120832+0000","last_undegraded":"2023-11-28T19:32:25.120832+0000","last_fullsized":"2023-11-28T19:32:25.120832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:58.470226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.577026+0000","last_change":"2023-11-28T19:32:22.539255+0000","last_active":"2023-11-28T19:32:23.577026+0000","last_peered":"2023-11-28T19:32:23.577026+0000","last_clean":"2023-11-28T19:32:23.577026+0000","last_became_active":"2023-11-28T19:32:22.538357+0000","last_became_peered":"2023-11-28T19:32:22.538357+0000","last_unstale":"2023-11-28T19:32:23.577026+0000","last_undegraded":"2023-11-28T19:32:23.577026+0000","last_fullsized":"2023-11-28T19:32:23.577026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:17.132804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707460+0000","last_change":"2023-11-28T19:32:23.550638+0000","last_active":"2023-11-28T19:32:25.707460+0000","last_peered":"2023-11-28T19:32:25.707460+0000","last_clean":"2023-11-28T19:32:25.707460+0000","last_became_active":"2023-11-28T19:32:23.549678+0000","last_became_peered":"2023-11-28T19:32:23.549678+0000","last_unstale":"2023-11-28T19:32:25.707460+0000","last_undegraded":"2023-11-28T19:32:25.707460+0000","last_fullsized":"2023-11-28T19:32:25.707460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:07:00.007948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.520339+0000","last_change":"2023-11-28T19:32:22.529288+0000","last_active":"2023-11-28T19:32:23.520339+0000","last_peered":"2023-11-28T19:32:23.520339+0000","last_clean":"2023-11-28T19:32:23.520339+0000","last_became_active":"2023-11-28T19:32:22.528510+0000","last_became_peered":"2023-11-28T19:32:22.528510+0000","last_unstale":"2023-11-28T19:32:23.520339+0000","last_undegraded":"2023-11-28T19:32:23.520339+0000","last_fullsized":"2023-11-28T19:32:23.520339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:06:58.995611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707430+0000","last_change":"2023-11-28T19:32:23.531642+0000","last_active":"2023-11-28T19:32:25.707430+0000","last_peered":"2023-11-28T19:32:25.707430+0000","last_clean":"2023-11-28T19:32:25.707430+0000","last_became_active":"2023-11-28T19:32:23.530824+0000","last_became_peered":"2023-11-28T19:32:23.530824+0000","last_unstale":"2023-11-28T19:32:25.707430+0000","last_undegraded":"2023-11-28T19:32:25.707430+0000","last_fullsized":"2023-11-28T19:32:25.707430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:27.914234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647331+0000","last_change":"2023-11-28T19:32:22.526386+0000","last_active":"2023-11-28T19:32:24.647331+0000","last_peered":"2023-11-28T19:32:24.647331+0000","last_clean":"2023-11-28T19:32:24.647331+0000","last_became_active":"2023-11-28T19:32:22.525967+0000","last_became_peered":"2023-11-28T19:32:22.525967+0000","last_unstale":"2023-11-28T19:32:24.647331+0000","last_undegraded":"2023-11-28T19:32:24.647331+0000","last_fullsized":"2023-11-28T19:32:24.647331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:53.084254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707436+0000","last_change":"2023-11-28T19:32:23.538825+0000","last_active":"2023-11-28T19:32:25.707436+0000","last_peered":"2023-11-28T19:32:25.707436+0000","last_clean":"2023-11-28T19:32:25.707436+0000","last_became_active":"2023-11-28T19:32:23.537978+0000","last_became_peered":"2023-11-28T19:32:23.537978+0000","last_unstale":"2023-11-28T19:32:25.707436+0000","last_undegraded":"2023-11-28T19:32:25.707436+0000","last_fullsized":"2023-11-28T19:32:25.707436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:58.318750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.521178+0000","last_change":"2023-11-28T19:32:22.543860+0000","last_active":"2023-11-28T19:32:23.521178+0000","last_peered":"2023-11-28T19:32:23.521178+0000","last_clean":"2023-11-28T19:32:23.521178+0000","last_became_active":"2023-11-28T19:32:22.543178+0000","last_became_peered":"2023-11-28T19:32:22.543178+0000","last_unstale":"2023-11-28T19:32:23.521178+0000","last_undegraded":"2023-11-28T19:32:23.521178+0000","last_fullsized":"2023-11-28T19:32:23.521178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:32:20.333154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707161+0000","last_change":"2023-11-28T19:32:23.536191+0000","last_active":"2023-11-28T19:32:25.707161+0000","last_peered":"2023-11-28T19:32:25.707161+0000","last_clean":"2023-11-28T19:32:25.707161+0000","last_became_active":"2023-11-28T19:32:23.532704+0000","last_became_peered":"2023-11-28T19:32:23.532704+0000","last_unstale":"2023-11-28T19:32:25.707161+0000","last_undegraded":"2023-11-28T19:32:25.707161+0000","last_fullsized":"2023-11-28T19:32:25.707161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:57:41.734781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.525964+0000","last_change":"2023-11-28T19:32:22.528890+0000","last_active":"2023-11-28T19:32:23.525964+0000","last_peered":"2023-11-28T19:32:23.525964+0000","last_clean":"2023-11-28T19:32:23.525964+0000","last_became_active":"2023-11-28T19:32:22.528049+0000","last_became_peered":"2023-11-28T19:32:22.528049+0000","last_unstale":"2023-11-28T19:32:23.525964+0000","last_undegraded":"2023-11-28T19:32:23.525964+0000","last_fullsized":"2023-11-28T19:32:23.525964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:48.730471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707950+0000","last_change":"2023-11-28T19:32:23.553676+0000","last_active":"2023-11-28T19:32:25.707950+0000","last_peered":"2023-11-28T19:32:25.707950+0000","last_clean":"2023-11-28T19:32:25.707950+0000","last_became_active":"2023-11-28T19:32:23.552782+0000","last_became_peered":"2023-11-28T19:32:23.552782+0000","last_unstale":"2023-11-28T19:32:25.707950+0000","last_undegraded":"2023-11-28T19:32:25.707950+0000","last_fullsized":"2023-11-28T19:32:25.707950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:37.200846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.527784+0000","last_change":"2023-11-28T19:32:22.541005+0000","last_active":"2023-11-28T19:32:23.527784+0000","last_peered":"2023-11-28T19:32:23.527784+0000","last_clean":"2023-11-28T19:32:23.527784+0000","last_became_active":"2023-11-28T19:32:22.540352+0000","last_became_peered":"2023-11-28T19:32:22.540352+0000","last_unstale":"2023-11-28T19:32:23.527784+0000","last_undegraded":"2023-11-28T19:32:23.527784+0000","last_fullsized":"2023-11-28T19:32:23.527784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:55.863909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707441+0000","last_change":"2023-11-28T19:32:23.539081+0000","last_active":"2023-11-28T19:32:25.707441+0000","last_peered":"2023-11-28T19:32:25.707441+0000","last_clean":"2023-11-28T19:32:25.707441+0000","last_became_active":"2023-11-28T19:32:23.538292+0000","last_became_peered":"2023-11-28T19:32:23.538292+0000","last_unstale":"2023-11-28T19:32:25.707441+0000","last_undegraded":"2023-11-28T19:32:25.707441+0000","last_fullsized":"2023-11-28T19:32:25.707441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:50:36.525952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.576074+0000","last_change":"2023-11-28T19:32:22.535486+0000","last_active":"2023-11-28T19:32:23.576074+0000","last_peered":"2023-11-28T19:32:23.576074+0000","last_clean":"2023-11-28T19:32:23.576074+0000","last_became_active":"2023-11-28T19:32:22.534916+0000","last_became_peered":"2023-11-28T19:32:22.534916+0000","last_unstale":"2023-11-28T19:32:23.576074+0000","last_undegraded":"2023-11-28T19:32:23.576074+0000","last_fullsized":"2023-11-28T19:32:23.576074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:55.863909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.607183+0000","last_change":"2023-11-28T19:32:23.563030+0000","last_active":"2023-11-28T19:32:24.607183+0000","last_peered":"2023-11-28T19:32:24.607183+0000","last_clean":"2023-11-28T19:32:24.607183+0000","last_became_active":"2023-11-28T19:32:23.562422+0000","last_became_peered":"2023-11-28T19:32:23.562422+0000","last_unstale":"2023-11-28T19:32:24.607183+0000","last_undegraded":"2023-11-28T19:32:24.607183+0000","last_fullsized":"2023-11-28T19:32:24.607183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:25.553951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.608165+0000","last_change":"2023-11-28T19:32:22.527160+0000","last_active":"2023-11-28T19:32:25.608165+0000","last_peered":"2023-11-28T19:32:25.608165+0000","last_clean":"2023-11-28T19:32:25.608165+0000","last_became_active":"2023-11-28T19:32:22.526709+0000","last_became_peered":"2023-11-28T19:32:22.526709+0000","last_unstale":"2023-11-28T19:32:25.608165+0000","last_undegraded":"2023-11-28T19:32:25.608165+0000","last_fullsized":"2023-11-28T19:32:25.608165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:30.527363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647350+0000","last_change":"2023-11-28T19:32:23.531809+0000","last_active":"2023-11-28T19:32:24.647350+0000","last_peered":"2023-11-28T19:32:24.647350+0000","last_clean":"2023-11-28T19:32:24.647350+0000","last_became_active":"2023-11-28T19:32:23.530993+0000","last_became_peered":"2023-11-28T19:32:23.530993+0000","last_unstale":"2023-11-28T19:32:24.647350+0000","last_undegraded":"2023-11-28T19:32:24.647350+0000","last_fullsized":"2023-11-28T19:32:24.647350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.876246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.512603+0000","last_change":"2023-11-28T19:32:22.529327+0000","last_active":"2023-11-28T19:32:23.512603+0000","last_peered":"2023-11-28T19:32:23.512603+0000","last_clean":"2023-11-28T19:32:23.512603+0000","last_became_active":"2023-11-28T19:32:22.528646+0000","last_became_peered":"2023-11-28T19:32:22.528646+0000","last_unstale":"2023-11-28T19:32:23.512603+0000","last_undegraded":"2023-11-28T19:32:23.512603+0000","last_fullsized":"2023-11-28T19:32:23.512603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:36.906845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.518173+0000","last_change":"2023-11-28T19:32:23.546408+0000","last_active":"2023-11-28T19:32:24.518173+0000","last_peered":"2023-11-28T19:32:24.518173+0000","last_clean":"2023-11-28T19:32:24.518173+0000","last_became_active":"2023-11-28T19:32:23.545773+0000","last_became_peered":"2023-11-28T19:32:23.545773+0000","last_unstale":"2023-11-28T19:32:24.518173+0000","last_undegraded":"2023-11-28T19:32:24.518173+0000","last_fullsized":"2023-11-28T19:32:24.518173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:18.145142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647563+0000","last_change":"2023-11-28T19:32:22.529821+0000","last_active":"2023-11-28T19:32:24.647563+0000","last_peered":"2023-11-28T19:32:24.647563+0000","last_clean":"2023-11-28T19:32:24.647563+0000","last_became_active":"2023-11-28T19:32:22.529455+0000","last_became_peered":"2023-11-28T19:32:22.529455+0000","last_unstale":"2023-11-28T19:32:24.647563+0000","last_undegraded":"2023-11-28T19:32:24.647563+0000","last_fullsized":"2023-11-28T19:32:24.647563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:02.714250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647415+0000","last_change":"2023-11-28T19:32:23.544784+0000","last_active":"2023-11-28T19:32:24.647415+0000","last_peered":"2023-11-28T19:32:24.647415+0000","last_clean":"2023-11-28T19:32:24.647415+0000","last_became_active":"2023-11-28T19:32:23.544016+0000","last_became_peered":"2023-11-28T19:32:23.544016+0000","last_unstale":"2023-11-28T19:32:24.647415+0000","last_undegraded":"2023-11-28T19:32:24.647415+0000","last_fullsized":"2023-11-28T19:32:24.647415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:43:58.616153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.510021+0000","last_change":"2023-11-28T19:32:22.534691+0000","last_active":"2023-11-28T19:32:23.510021+0000","last_peered":"2023-11-28T19:32:23.510021+0000","last_clean":"2023-11-28T19:32:23.510021+0000","last_became_active":"2023-11-28T19:32:22.534281+0000","last_became_peered":"2023-11-28T19:32:22.534281+0000","last_unstale":"2023-11-28T19:32:23.510021+0000","last_undegraded":"2023-11-28T19:32:23.510021+0000","last_fullsized":"2023-11-28T19:32:23.510021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:17.132804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.515810+0000","last_change":"2023-11-28T19:32:23.554968+0000","last_active":"2023-11-28T19:32:24.515810+0000","last_peered":"2023-11-28T19:32:24.515810+0000","last_clean":"2023-11-28T19:32:24.515810+0000","last_became_active":"2023-11-28T19:32:23.551736+0000","last_became_peered":"2023-11-28T19:32:23.551736+0000","last_unstale":"2023-11-28T19:32:24.515810+0000","last_undegraded":"2023-11-28T19:32:24.515810+0000","last_fullsized":"2023-11-28T19:32:24.515810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:36.930397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.525966+0000","last_change":"2023-11-28T19:32:22.535588+0000","last_active":"2023-11-28T19:32:23.525966+0000","last_peered":"2023-11-28T19:32:23.525966+0000","last_clean":"2023-11-28T19:32:23.525966+0000","last_became_active":"2023-11-28T19:32:22.533969+0000","last_became_peered":"2023-11-28T19:32:22.533969+0000","last_unstale":"2023-11-28T19:32:23.525966+0000","last_undegraded":"2023-11-28T19:32:23.525966+0000","last_fullsized":"2023-11-28T19:32:23.525966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:20:12.097738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516400+0000","last_change":"2023-11-28T19:32:23.541181+0000","last_active":"2023-11-28T19:32:24.516400+0000","last_peered":"2023-11-28T19:32:24.516400+0000","last_clean":"2023-11-28T19:32:24.516400+0000","last_became_active":"2023-11-28T19:32:23.540535+0000","last_became_peered":"2023-11-28T19:32:23.540535+0000","last_unstale":"2023-11-28T19:32:24.516400+0000","last_undegraded":"2023-11-28T19:32:24.516400+0000","last_fullsized":"2023-11-28T19:32:24.516400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:31.539700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.520503+0000","last_change":"2023-11-28T19:32:22.530719+0000","last_active":"2023-11-28T19:32:23.520503+0000","last_peered":"2023-11-28T19:32:23.520503+0000","last_clean":"2023-11-28T19:32:23.520503+0000","last_became_active":"2023-11-28T19:32:22.530309+0000","last_became_peered":"2023-11-28T19:32:22.530309+0000","last_unstale":"2023-11-28T19:32:23.520503+0000","last_undegraded":"2023-11-28T19:32:23.520503+0000","last_fullsized":"2023-11-28T19:32:23.520503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:48.405088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707919+0000","last_change":"2023-11-28T19:32:23.554896+0000","last_active":"2023-11-28T19:32:25.707919+0000","last_peered":"2023-11-28T19:32:25.707919+0000","last_clean":"2023-11-28T19:32:25.707919+0000","last_became_active":"2023-11-28T19:32:23.553538+0000","last_became_peered":"2023-11-28T19:32:23.553538+0000","last_unstale":"2023-11-28T19:32:25.707919+0000","last_undegraded":"2023-11-28T19:32:25.707919+0000","last_fullsized":"2023-11-28T19:32:25.707919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:19.482916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.518549+0000","last_change":"2023-11-28T19:32:22.546949+0000","last_active":"2023-11-28T19:32:23.518549+0000","last_peered":"2023-11-28T19:32:23.518549+0000","last_clean":"2023-11-28T19:32:23.518549+0000","last_became_active":"2023-11-28T19:32:22.546404+0000","last_became_peered":"2023-11-28T19:32:22.546404+0000","last_unstale":"2023-11-28T19:32:23.518549+0000","last_undegraded":"2023-11-28T19:32:23.518549+0000","last_fullsized":"2023-11-28T19:32:23.518549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:50:35.513615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.537343+0000","last_change":"2023-11-28T19:31:35.378105+0000","last_active":"2023-11-28T19:32:23.537343+0000","last_peered":"2023-11-28T19:32:23.537343+0000","last_clean":"2023-11-28T19:32:23.537343+0000","last_became_active":"2023-11-28T19:31:35.375035+0000","last_became_peered":"2023-11-28T19:31:35.375035+0000","last_unstale":"2023-11-28T19:32:23.537343+0000","last_undegraded":"2023-11-28T19:32:23.537343+0000","last_fullsized":"2023-11-28T19:32:23.537343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_clean_scrub_stamp":"2023-11-28T19:31:33.813158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:07.043315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":729403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3140000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.117}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79400000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.242}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574862,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.98499999999999999}]},{"osd":1,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.1679999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.90300000000000002}]},{"osd":2,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.1319999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":0.95099999999999996}]},{"osd":3,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.2629999999999999}]},{"osd":4,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.79500000000000004},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":1.024}]},{"osd":5,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.099},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":1.206}]},{"osd":7,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3049999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.038}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.115}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.159}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.071}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":140579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1859999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.222}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":139015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1990000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.878}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0609999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1619999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":140579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.62}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0860000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":954368,"data_stored":729313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.65200000000000002}]},{"osd":2,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.93300000000000005}]},{"osd":3,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":0.86899999999999999}]},{"osd":4,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.82999999999999996},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.0600000000000001}]},{"osd":5,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.266},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.1020000000000001}]},{"osd":6,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":0.98599999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.212}]},{"osd":7,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":1.1279999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.024}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T19:32:39.371 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-11-28T19:32:39.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.501+0000 7fdce272c640 1 Processor -- start 2023-11-28T19:32:39.506 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdce272c640 1 -- start start 2023-11-28T19:32:39.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdce272c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcdc06aaf0 0x7fdcdc06aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:39.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdce272c640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdcdc14bdf0 0x7fdcdc155da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:39.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdce272c640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcdc0bd5e0 con 0x7fdcdc14ac70 2023-11-28T19:32:39.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdce272c640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcdc0bc1c0 con 0x7fdcdc14bdf0 2023-11-28T19:32:39.507 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdce272c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc06bca0 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdce0cc9640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fdcdc14bdf0 0x7fdcdc155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:39.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdcdbfff640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcdc06aaf0 0x7fdcdc06aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:39.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdcdb7fe640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fdcdc14ac70 0x7fdcdc14b6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:35676/0 (socket says 172.21.15.28:35676) 2023-11-28T19:32:39.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdcdb7fe640 1 -- 172.21.15.28:0/164304365 learned_addr learned my addr 172.21.15.28:0/164304365 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:39.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdcdbfff640 1 -- 172.21.15.28:0/164304365 >> v2:172.21.15.131:3300/0 conn(0x7fdcdc14bdf0 msgr2=0x7fdcdc155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:39.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdcdbfff640 1 --2- 172.21.15.28:0/164304365 >> v2:172.21.15.131:3300/0 conn(0x7fdcdc14bdf0 0x7fdcdc155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:39.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdcdbfff640 1 -- 172.21.15.28:0/164304365 >> v1:172.21.15.131:6789/0 conn(0x7fdcdc14ac70 legacy=0x7fdcdc14b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:39.508 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdcdaffd640 1 -- 172.21.15.28:0/164304365 <== mon.1 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055534076 0 0) 0x7fdcdc0bd5e0 con 0x7fdcdc14ac70 2023-11-28T19:32:39.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdcdbfff640 1 -- 172.21.15.28:0/164304365 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc06b7a0 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.509 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.505+0000 7fdce0cc9640 1 --2- 172.21.15.28:0/164304365 >> v2:172.21.15.131:3300/0 conn(0x7fdcdc14bdf0 0x7fdcdc155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:32:39.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdcdbfff640 1 --2- 172.21.15.28:0/164304365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcdc06aaf0 0x7fdcdc06aed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0097c0 tx=0x7fdccc01c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3c7d0c6d79b4630 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:39.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdcdaffd640 1 -- 172.21.15.28:0/164304365 <== mon.2 v2:172.21.15.131:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc0ad680 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.510 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdcdaffd640 1 -- 172.21.15.28:0/164304365 <== mon.2 v2:172.21.15.131:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc0ad7e0 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdcdaffd640 1 -- 172.21.15.28:0/164304365 <== mon.2 v2:172.21.15.131:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc0adb70 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 -- 172.21.15.28:0/164304365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcdc06aaf0 msgr2=0x7fdcdc06aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:39.511 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 --2- 172.21.15.28:0/164304365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcdc06aaf0 0x7fdcdc06aed0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0097c0 tx=0x7fdccc01c450 comp rx=0 tx=0).stop 2023-11-28T19:32:39.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 -- 172.21.15.28:0/164304365 shutdown_connections 2023-11-28T19:32:39.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 --2- 172.21.15.28:0/164304365 >> v2:172.21.15.131:3300/0 conn(0x7fdcdc14bdf0 0x7fdcdc155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:39.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 --2- 172.21.15.28:0/164304365 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcdc06aaf0 0x7fdcdc06aed0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:39.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 -- 172.21.15.28:0/164304365 >> 172.21.15.28:0/164304365 conn(0x7fdcdc0bd790 msgr2=0x7fdcdc0bdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:39.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 -- 172.21.15.28:0/164304365 shutdown_connections 2023-11-28T19:32:39.512 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 -- 172.21.15.28:0/164304365 wait complete. 2023-11-28T19:32:39.514 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 Processor -- start 2023-11-28T19:32:39.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 -- start start 2023-11-28T19:32:39.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcdc06aaf0 0x7fdcdc0a31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:39.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcdc14ac70 0x7fdcdc0b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:39.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcdc14bdf0 0x7fdcdc1e71e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:39.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0a3700 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0b46d0 con 0x7fdcdc14bdf0 2023-11-28T19:32:39.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce272c640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcdc0b6980 con 0x7fdcdc14ac70 2023-11-28T19:32:39.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdcdbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcdc06aaf0 0x7fdcdc0a31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:39.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdcdbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcdc06aaf0 0x7fdcdc0a31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53088/0 (socket says 172.21.15.28:53088) 2023-11-28T19:32:39.515 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdcdbfff640 1 -- 172.21.15.28:0/2453853752 learned_addr learned my addr 172.21.15.28:0/2453853752 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:39.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce0cc9640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcdc14bdf0 0x7fdcdc1e71e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:39.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdcdb7fe640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcdc14ac70 0x7fdcdc0b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:39.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdcdbfff640 1 -- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcdc14ac70 msgr2=0x7fdcdc0b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:39.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdcdbfff640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcdc14ac70 0x7fdcdc0b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:39.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdcdbfff640 1 -- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcdc14bdf0 msgr2=0x7fdcdc1e71e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:39.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdcdbfff640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcdc14bdf0 0x7fdcdc1e71e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:39.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdcdbfff640 1 -- 172.21.15.28:0/2453853752 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd4009a70 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.509+0000 7fdce0cc9640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcdc14bdf0 0x7fdcdc1e71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:39.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.513+0000 7fdcdbfff640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcdc06aaf0 0x7fdcdc0a31c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdccc019060 tx=0x7fdccc01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:39.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.513+0000 7fdcd8ff9640 1 -- 172.21.15.28:0/2453853752 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc0ade20 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.513+0000 7fdcd8ff9640 1 -- 172.21.15.28:0/2453853752 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdccc0b9450 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.516 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.513+0000 7fdcd8ff9640 1 -- 172.21.15.28:0/2453853752 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdccc0b9800 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.513+0000 7fdce272c640 1 -- 172.21.15.28:0/2453853752 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdccc009420 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.513+0000 7fdce272c640 1 -- 172.21.15.28:0/2453853752 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcdc0a29c0 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.513+0000 7fdce272c640 1 -- 172.21.15.28:0/2453853752 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcdc074a90 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.517 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.513+0000 7fdcd8ff9640 1 -- 172.21.15.28:0/2453853752 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fdccc0b9960 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.513+0000 7fdcd8ff9640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdcc8066470 0x7fdcc8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:39.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.513+0000 7fdcd8ff9640 1 -- 172.21.15.28:0/2453853752 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdccc11e920 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.513+0000 7fdcdb7fe640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdcc8066470 0x7fdcc8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:39.518 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.513+0000 7fdcdb7fe640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdcc8066470 0x7fdcc8068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0a0080 tx=0x7fdcd0007b80 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:39.520 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.517+0000 7fdcd8ff9640 1 -- 172.21.15.28:0/2453853752 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fdccc0ebe30 con 0x7fdcdc06aaf0 2023-11-28T19:32:39.674 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.673+0000 7fdce272c640 1 -- 172.21.15.28:0/2453853752 --> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdcdc158b00 con 0x7fdcc8066470 2023-11-28T19:32:39.696 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.693+0000 7fdcd8ff9640 1 -- 172.21.15.28:0/2453853752 <== mgr.4100 v2:172.21.15.131:6832/3367043860 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287554 (secure 0 0 0) 0x7fdcd00071f0 con 0x7fdcc8066470 2023-11-28T19:32:39.699 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:39.701 INFO:teuthology.orchestra.run.smithi028.stderr:dumped all 2023-11-28T19:32:39.702 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.697+0000 7fdce272c640 1 -- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdcc8066470 msgr2=0x7fdcc8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:39.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.697+0000 7fdce272c640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdcc8066470 0x7fdcc8068930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc0a0080 tx=0x7fdcd0007b80 comp rx=0 tx=0).stop 2023-11-28T19:32:39.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.697+0000 7fdce272c640 1 -- 172.21.15.28:0/2453853752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcdc06aaf0 msgr2=0x7fdcdc0a31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:39.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.697+0000 7fdce272c640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcdc06aaf0 0x7fdcdc0a31c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdccc019060 tx=0x7fdccc01ac90 comp rx=0 tx=0).stop 2023-11-28T19:32:39.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.697+0000 7fdce272c640 1 -- 172.21.15.28:0/2453853752 shutdown_connections 2023-11-28T19:32:39.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.697+0000 7fdce272c640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fdcc8066470 0x7fdcc8068930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:39.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.697+0000 7fdce272c640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdcdc14bdf0 0x7fdcdc1e71e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:39.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.697+0000 7fdce272c640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fdcdc14ac70 0x7fdcdc0b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:39.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.697+0000 7fdce272c640 1 --2- 172.21.15.28:0/2453853752 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fdcdc06aaf0 0x7fdcdc0a31c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:39.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.697+0000 7fdce272c640 1 -- 172.21.15.28:0/2453853752 >> 172.21.15.28:0/2453853752 conn(0x7fdcdc0bd790 msgr2=0x7fdcdc0bf8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:39.703 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.697+0000 7fdce272c640 1 -- 172.21.15.28:0/2453853752 shutdown_connections 2023-11-28T19:32:39.704 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.697+0000 7fdce272c640 1 -- 172.21.15.28:0/2453853752 wait complete. 2023-11-28T19:32:39.718 INFO:teuthology.orchestra.run.smithi028.stdout:{"pg_ready":true,"pg_map":{"version":59,"stamp":"2023-11-28T19:32:39.153105+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236848,"kb_used_data":4040,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754737872,"statfs":{"total":773094113280,"available":772851580928,"internally_reserved":0,"allocated":4136960,"data_stored":2297116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":238276145},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004296"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.518995+0000","last_change":"2023-11-28T19:32:23.546975+0000","last_active":"2023-11-28T19:32:24.518995+0000","last_peered":"2023-11-28T19:32:24.518995+0000","last_clean":"2023-11-28T19:32:24.518995+0000","last_became_active":"2023-11-28T19:32:23.542855+0000","last_became_peered":"2023-11-28T19:32:23.542855+0000","last_unstale":"2023-11-28T19:32:24.518995+0000","last_undegraded":"2023-11-28T19:32:24.518995+0000","last_fullsized":"2023-11-28T19:32:24.518995+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:44:38.892376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.517837+0000","last_change":"2023-11-28T19:32:23.548077+0000","last_active":"2023-11-28T19:32:24.517837+0000","last_peered":"2023-11-28T19:32:24.517837+0000","last_clean":"2023-11-28T19:32:24.517837+0000","last_became_active":"2023-11-28T19:32:23.546891+0000","last_became_peered":"2023-11-28T19:32:23.546891+0000","last_unstale":"2023-11-28T19:32:24.517837+0000","last_undegraded":"2023-11-28T19:32:24.517837+0000","last_fullsized":"2023-11-28T19:32:24.517837+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:10:01.121564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.607253+0000","last_change":"2023-11-28T19:32:23.564546+0000","last_active":"2023-11-28T19:32:24.607253+0000","last_peered":"2023-11-28T19:32:24.607253+0000","last_clean":"2023-11-28T19:32:24.607253+0000","last_became_active":"2023-11-28T19:32:23.563811+0000","last_became_peered":"2023-11-28T19:32:23.563811+0000","last_unstale":"2023-11-28T19:32:24.607253+0000","last_undegraded":"2023-11-28T19:32:24.607253+0000","last_fullsized":"2023-11-28T19:32:24.607253+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:36.930397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.120707+0000","last_change":"2023-11-28T19:32:23.535855+0000","last_active":"2023-11-28T19:32:25.120707+0000","last_peered":"2023-11-28T19:32:25.120707+0000","last_clean":"2023-11-28T19:32:25.120707+0000","last_became_active":"2023-11-28T19:32:23.534929+0000","last_became_peered":"2023-11-28T19:32:23.534929+0000","last_unstale":"2023-11-28T19:32:25.120707+0000","last_undegraded":"2023-11-28T19:32:25.120707+0000","last_fullsized":"2023-11-28T19:32:25.120707+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:37.200846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707227+0000","last_change":"2023-11-28T19:32:23.535230+0000","last_active":"2023-11-28T19:32:25.707227+0000","last_peered":"2023-11-28T19:32:25.707227+0000","last_clean":"2023-11-28T19:32:25.707227+0000","last_became_active":"2023-11-28T19:32:23.534387+0000","last_became_peered":"2023-11-28T19:32:23.534387+0000","last_unstale":"2023-11-28T19:32:25.707227+0000","last_undegraded":"2023-11-28T19:32:25.707227+0000","last_fullsized":"2023-11-28T19:32:25.707227+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:59:24.428671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.517184+0000","last_change":"2023-11-28T19:32:23.534830+0000","last_active":"2023-11-28T19:32:24.517184+0000","last_peered":"2023-11-28T19:32:24.517184+0000","last_clean":"2023-11-28T19:32:24.517184+0000","last_became_active":"2023-11-28T19:32:23.534056+0000","last_became_peered":"2023-11-28T19:32:23.534056+0000","last_unstale":"2023-11-28T19:32:24.517184+0000","last_undegraded":"2023-11-28T19:32:24.517184+0000","last_fullsized":"2023-11-28T19:32:24.517184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:51:47.080666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.708179+0000","last_change":"2023-11-28T19:32:23.553651+0000","last_active":"2023-11-28T19:32:25.708179+0000","last_peered":"2023-11-28T19:32:25.708179+0000","last_clean":"2023-11-28T19:32:25.708179+0000","last_became_active":"2023-11-28T19:32:23.551963+0000","last_became_peered":"2023-11-28T19:32:23.551963+0000","last_unstale":"2023-11-28T19:32:25.708179+0000","last_undegraded":"2023-11-28T19:32:25.708179+0000","last_fullsized":"2023-11-28T19:32:25.708179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:41:57.040701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707389+0000","last_change":"2023-11-28T19:32:23.555968+0000","last_active":"2023-11-28T19:32:25.707389+0000","last_peered":"2023-11-28T19:32:25.707389+0000","last_clean":"2023-11-28T19:32:25.707389+0000","last_became_active":"2023-11-28T19:32:23.555228+0000","last_became_peered":"2023-11-28T19:32:23.555228+0000","last_unstale":"2023-11-28T19:32:25.707389+0000","last_undegraded":"2023-11-28T19:32:25.707389+0000","last_fullsized":"2023-11-28T19:32:25.707389+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:37.919182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.518637+0000","last_change":"2023-11-28T19:32:23.536561+0000","last_active":"2023-11-28T19:32:24.518637+0000","last_peered":"2023-11-28T19:32:24.518637+0000","last_clean":"2023-11-28T19:32:24.518637+0000","last_became_active":"2023-11-28T19:32:23.535782+0000","last_became_peered":"2023-11-28T19:32:23.535782+0000","last_unstale":"2023-11-28T19:32:24.518637+0000","last_undegraded":"2023-11-28T19:32:24.518637+0000","last_fullsized":"2023-11-28T19:32:24.518637+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:46:22.848432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.121325+0000","last_change":"2023-11-28T19:32:23.533624+0000","last_active":"2023-11-28T19:32:25.121325+0000","last_peered":"2023-11-28T19:32:25.121325+0000","last_clean":"2023-11-28T19:32:25.121325+0000","last_became_active":"2023-11-28T19:32:23.532855+0000","last_became_peered":"2023-11-28T19:32:23.532855+0000","last_unstale":"2023-11-28T19:32:25.121325+0000","last_undegraded":"2023-11-28T19:32:25.121325+0000","last_fullsized":"2023-11-28T19:32:25.121325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:41:57.040701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.708190+0000","last_change":"2023-11-28T19:32:23.556589+0000","last_active":"2023-11-28T19:32:25.708190+0000","last_peered":"2023-11-28T19:32:25.708190+0000","last_clean":"2023-11-28T19:32:25.708190+0000","last_became_active":"2023-11-28T19:32:23.555879+0000","last_became_peered":"2023-11-28T19:32:23.555879+0000","last_unstale":"2023-11-28T19:32:25.708190+0000","last_undegraded":"2023-11-28T19:32:25.708190+0000","last_fullsized":"2023-11-28T19:32:25.708190+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:49.417425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.607043+0000","last_change":"2023-11-28T19:32:23.545785+0000","last_active":"2023-11-28T19:32:24.607043+0000","last_peered":"2023-11-28T19:32:24.607043+0000","last_clean":"2023-11-28T19:32:24.607043+0000","last_became_active":"2023-11-28T19:32:23.544332+0000","last_became_peered":"2023-11-28T19:32:23.544332+0000","last_unstale":"2023-11-28T19:32:24.607043+0000","last_undegraded":"2023-11-28T19:32:24.607043+0000","last_fullsized":"2023-11-28T19:32:24.607043+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:41:57.040701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707553+0000","last_change":"2023-11-28T19:32:23.529587+0000","last_active":"2023-11-28T19:32:25.707553+0000","last_peered":"2023-11-28T19:32:25.707553+0000","last_clean":"2023-11-28T19:32:25.707553+0000","last_became_active":"2023-11-28T19:32:23.528314+0000","last_became_peered":"2023-11-28T19:32:23.528314+0000","last_unstale":"2023-11-28T19:32:25.707553+0000","last_undegraded":"2023-11-28T19:32:25.707553+0000","last_fullsized":"2023-11-28T19:32:25.707553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:54.096591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516785+0000","last_change":"2023-11-28T19:32:23.541071+0000","last_active":"2023-11-28T19:32:24.516785+0000","last_peered":"2023-11-28T19:32:24.516785+0000","last_clean":"2023-11-28T19:32:24.516785+0000","last_became_active":"2023-11-28T19:32:23.540321+0000","last_became_peered":"2023-11-28T19:32:23.540321+0000","last_unstale":"2023-11-28T19:32:24.516785+0000","last_undegraded":"2023-11-28T19:32:24.516785+0000","last_fullsized":"2023-11-28T19:32:24.516785+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:36:42.359597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.606412+0000","last_change":"2023-11-28T19:32:23.561607+0000","last_active":"2023-11-28T19:32:24.606412+0000","last_peered":"2023-11-28T19:32:24.606412+0000","last_clean":"2023-11-28T19:32:24.606412+0000","last_became_active":"2023-11-28T19:32:23.549789+0000","last_became_peered":"2023-11-28T19:32:23.549789+0000","last_unstale":"2023-11-28T19:32:24.606412+0000","last_undegraded":"2023-11-28T19:32:24.606412+0000","last_fullsized":"2023-11-28T19:32:24.606412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:30.423478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.708447+0000","last_change":"2023-11-28T19:32:23.557131+0000","last_active":"2023-11-28T19:32:25.708447+0000","last_peered":"2023-11-28T19:32:25.708447+0000","last_clean":"2023-11-28T19:32:25.708447+0000","last_became_active":"2023-11-28T19:32:23.556461+0000","last_became_peered":"2023-11-28T19:32:23.556461+0000","last_unstale":"2023-11-28T19:32:25.708447+0000","last_undegraded":"2023-11-28T19:32:25.708447+0000","last_fullsized":"2023-11-28T19:32:25.708447+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:36.930397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.708369+0000","last_change":"2023-11-28T19:32:23.549553+0000","last_active":"2023-11-28T19:32:25.708369+0000","last_peered":"2023-11-28T19:32:25.708369+0000","last_clean":"2023-11-28T19:32:25.708369+0000","last_became_active":"2023-11-28T19:32:23.548822+0000","last_became_peered":"2023-11-28T19:32:23.548822+0000","last_unstale":"2023-11-28T19:32:25.708369+0000","last_undegraded":"2023-11-28T19:32:25.708369+0000","last_fullsized":"2023-11-28T19:32:25.708369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:25.553951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.517722+0000","last_change":"2023-11-28T19:32:23.554429+0000","last_active":"2023-11-28T19:32:24.517722+0000","last_peered":"2023-11-28T19:32:24.517722+0000","last_clean":"2023-11-28T19:32:24.517722+0000","last_became_active":"2023-11-28T19:32:23.554066+0000","last_became_peered":"2023-11-28T19:32:23.554066+0000","last_unstale":"2023-11-28T19:32:24.517722+0000","last_undegraded":"2023-11-28T19:32:24.517722+0000","last_fullsized":"2023-11-28T19:32:24.517722+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:37:18.193272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516263+0000","last_change":"2023-11-28T19:32:23.537198+0000","last_active":"2023-11-28T19:32:24.516263+0000","last_peered":"2023-11-28T19:32:24.516263+0000","last_clean":"2023-11-28T19:32:24.516263+0000","last_became_active":"2023-11-28T19:32:23.536393+0000","last_became_peered":"2023-11-28T19:32:23.536393+0000","last_unstale":"2023-11-28T19:32:24.516263+0000","last_undegraded":"2023-11-28T19:32:24.516263+0000","last_fullsized":"2023-11-28T19:32:24.516263+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:22:12.070332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707368+0000","last_change":"2023-11-28T19:32:23.539393+0000","last_active":"2023-11-28T19:32:25.707368+0000","last_peered":"2023-11-28T19:32:25.707368+0000","last_clean":"2023-11-28T19:32:25.707368+0000","last_became_active":"2023-11-28T19:32:23.538571+0000","last_became_peered":"2023-11-28T19:32:23.538571+0000","last_unstale":"2023-11-28T19:32:25.707368+0000","last_undegraded":"2023-11-28T19:32:25.707368+0000","last_fullsized":"2023-11-28T19:32:25.707368+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:24.762063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516559+0000","last_change":"2023-11-28T19:32:23.546876+0000","last_active":"2023-11-28T19:32:24.516559+0000","last_peered":"2023-11-28T19:32:24.516559+0000","last_clean":"2023-11-28T19:32:24.516559+0000","last_became_active":"2023-11-28T19:32:23.546220+0000","last_became_peered":"2023-11-28T19:32:23.546220+0000","last_unstale":"2023-11-28T19:32:24.516559+0000","last_undegraded":"2023-11-28T19:32:24.516559+0000","last_fullsized":"2023-11-28T19:32:24.516559+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:44:38.892376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516861+0000","last_change":"2023-11-28T19:32:23.561882+0000","last_active":"2023-11-28T19:32:24.516861+0000","last_peered":"2023-11-28T19:32:24.516861+0000","last_clean":"2023-11-28T19:32:24.516861+0000","last_became_active":"2023-11-28T19:32:23.561166+0000","last_became_peered":"2023-11-28T19:32:23.561166+0000","last_unstale":"2023-11-28T19:32:24.516861+0000","last_undegraded":"2023-11-28T19:32:24.516861+0000","last_fullsized":"2023-11-28T19:32:24.516861+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.876246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647101+0000","last_change":"2023-11-28T19:32:23.555413+0000","last_active":"2023-11-28T19:32:24.647101+0000","last_peered":"2023-11-28T19:32:24.647101+0000","last_clean":"2023-11-28T19:32:24.647101+0000","last_became_active":"2023-11-28T19:32:23.555044+0000","last_became_peered":"2023-11-28T19:32:23.555044+0000","last_unstale":"2023-11-28T19:32:24.647101+0000","last_undegraded":"2023-11-28T19:32:24.647101+0000","last_fullsized":"2023-11-28T19:32:24.647101+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:44:38.892376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.606427+0000","last_change":"2023-11-28T19:32:23.534811+0000","last_active":"2023-11-28T19:32:24.606427+0000","last_peered":"2023-11-28T19:32:24.606427+0000","last_clean":"2023-11-28T19:32:24.606427+0000","last_became_active":"2023-11-28T19:32:23.534034+0000","last_became_peered":"2023-11-28T19:32:23.534034+0000","last_unstale":"2023-11-28T19:32:24.606427+0000","last_undegraded":"2023-11-28T19:32:24.606427+0000","last_fullsized":"2023-11-28T19:32:24.606427+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:46:22.848432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.121626+0000","last_change":"2023-11-28T19:32:23.553216+0000","last_active":"2023-11-28T19:32:25.121626+0000","last_peered":"2023-11-28T19:32:25.121626+0000","last_clean":"2023-11-28T19:32:25.121626+0000","last_became_active":"2023-11-28T19:32:23.552389+0000","last_became_peered":"2023-11-28T19:32:23.552389+0000","last_unstale":"2023-11-28T19:32:25.121626+0000","last_undegraded":"2023-11-28T19:32:25.121626+0000","last_fullsized":"2023-11-28T19:32:25.121626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:25.553951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.517925+0000","last_change":"2023-11-28T19:32:23.551477+0000","last_active":"2023-11-28T19:32:24.517925+0000","last_peered":"2023-11-28T19:32:24.517925+0000","last_clean":"2023-11-28T19:32:24.517925+0000","last_became_active":"2023-11-28T19:32:23.550480+0000","last_became_peered":"2023-11-28T19:32:23.550480+0000","last_unstale":"2023-11-28T19:32:24.517925+0000","last_undegraded":"2023-11-28T19:32:24.517925+0000","last_fullsized":"2023-11-28T19:32:24.517925+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:45:49.804809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.121449+0000","last_change":"2023-11-28T19:32:23.545013+0000","last_active":"2023-11-28T19:32:25.121449+0000","last_peered":"2023-11-28T19:32:25.121449+0000","last_clean":"2023-11-28T19:32:25.121449+0000","last_became_active":"2023-11-28T19:32:23.544225+0000","last_became_peered":"2023-11-28T19:32:23.544225+0000","last_unstale":"2023-11-28T19:32:25.121449+0000","last_undegraded":"2023-11-28T19:32:25.121449+0000","last_fullsized":"2023-11-28T19:32:25.121449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:49.417425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.607182+0000","last_change":"2023-11-28T19:32:23.562910+0000","last_active":"2023-11-28T19:32:24.607182+0000","last_peered":"2023-11-28T19:32:24.607182+0000","last_clean":"2023-11-28T19:32:24.607182+0000","last_became_active":"2023-11-28T19:32:23.562295+0000","last_became_peered":"2023-11-28T19:32:23.562295+0000","last_unstale":"2023-11-28T19:32:24.607182+0000","last_undegraded":"2023-11-28T19:32:24.607182+0000","last_fullsized":"2023-11-28T19:32:24.607182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:49.417425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516915+0000","last_change":"2023-11-28T19:32:23.562250+0000","last_active":"2023-11-28T19:32:24.516915+0000","last_peered":"2023-11-28T19:32:24.516915+0000","last_clean":"2023-11-28T19:32:24.516915+0000","last_became_active":"2023-11-28T19:32:23.561118+0000","last_became_peered":"2023-11-28T19:32:23.561118+0000","last_unstale":"2023-11-28T19:32:24.516915+0000","last_undegraded":"2023-11-28T19:32:24.516915+0000","last_fullsized":"2023-11-28T19:32:24.516915+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:43:58.616153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707701+0000","last_change":"2023-11-28T19:32:23.550169+0000","last_active":"2023-11-28T19:32:25.707701+0000","last_peered":"2023-11-28T19:32:25.707701+0000","last_clean":"2023-11-28T19:32:25.707701+0000","last_became_active":"2023-11-28T19:32:23.548617+0000","last_became_peered":"2023-11-28T19:32:23.548617+0000","last_unstale":"2023-11-28T19:32:25.707701+0000","last_undegraded":"2023-11-28T19:32:25.707701+0000","last_fullsized":"2023-11-28T19:32:25.707701+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:30.423478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.518615+0000","last_change":"2023-11-28T19:32:23.550973+0000","last_active":"2023-11-28T19:32:24.518615+0000","last_peered":"2023-11-28T19:32:24.518615+0000","last_clean":"2023-11-28T19:32:24.518615+0000","last_became_active":"2023-11-28T19:32:23.546728+0000","last_became_peered":"2023-11-28T19:32:23.546728+0000","last_unstale":"2023-11-28T19:32:24.518615+0000","last_undegraded":"2023-11-28T19:32:24.518615+0000","last_fullsized":"2023-11-28T19:32:24.518615+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:31.539700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707443+0000","last_change":"2023-11-28T19:32:23.554484+0000","last_active":"2023-11-28T19:32:25.707443+0000","last_peered":"2023-11-28T19:32:25.707443+0000","last_clean":"2023-11-28T19:32:25.707443+0000","last_became_active":"2023-11-28T19:32:23.551313+0000","last_became_peered":"2023-11-28T19:32:23.551313+0000","last_unstale":"2023-11-28T19:32:25.707443+0000","last_undegraded":"2023-11-28T19:32:25.707443+0000","last_fullsized":"2023-11-28T19:32:25.707443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:43:58.616153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647379+0000","last_change":"2023-11-28T19:32:23.551304+0000","last_active":"2023-11-28T19:32:24.647379+0000","last_peered":"2023-11-28T19:32:24.647379+0000","last_clean":"2023-11-28T19:32:24.647379+0000","last_became_active":"2023-11-28T19:32:23.550939+0000","last_became_peered":"2023-11-28T19:32:23.550939+0000","last_unstale":"2023-11-28T19:32:24.647379+0000","last_undegraded":"2023-11-28T19:32:24.647379+0000","last_fullsized":"2023-11-28T19:32:24.647379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:37.919182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.579926+0000","last_change":"2023-11-28T19:32:22.543742+0000","last_active":"2023-11-28T19:32:23.579926+0000","last_peered":"2023-11-28T19:32:23.579926+0000","last_clean":"2023-11-28T19:32:23.579926+0000","last_became_active":"2023-11-28T19:32:22.543130+0000","last_became_peered":"2023-11-28T19:32:22.543130+0000","last_unstale":"2023-11-28T19:32:23.579926+0000","last_undegraded":"2023-11-28T19:32:23.579926+0000","last_fullsized":"2023-11-28T19:32:23.579926+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:48.730471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.519117+0000","last_change":"2023-11-28T19:32:23.542549+0000","last_active":"2023-11-28T19:32:24.519117+0000","last_peered":"2023-11-28T19:32:24.519117+0000","last_clean":"2023-11-28T19:32:24.519117+0000","last_became_active":"2023-11-28T19:32:23.541235+0000","last_became_peered":"2023-11-28T19:32:23.541235+0000","last_unstale":"2023-11-28T19:32:24.519117+0000","last_undegraded":"2023-11-28T19:32:24.519117+0000","last_fullsized":"2023-11-28T19:32:24.519117+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.876246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647469+0000","last_change":"2023-11-28T19:32:22.529781+0000","last_active":"2023-11-28T19:32:24.647469+0000","last_peered":"2023-11-28T19:32:24.647469+0000","last_clean":"2023-11-28T19:32:24.647469+0000","last_became_active":"2023-11-28T19:32:22.529362+0000","last_became_peered":"2023-11-28T19:32:22.529362+0000","last_unstale":"2023-11-28T19:32:24.647469+0000","last_undegraded":"2023-11-28T19:32:24.647469+0000","last_fullsized":"2023-11-28T19:32:24.647469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:20:12.097738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.517210+0000","last_change":"2023-11-28T19:32:23.562576+0000","last_active":"2023-11-28T19:32:24.517210+0000","last_peered":"2023-11-28T19:32:24.517210+0000","last_clean":"2023-11-28T19:32:24.517210+0000","last_became_active":"2023-11-28T19:32:23.561766+0000","last_became_peered":"2023-11-28T19:32:23.561766+0000","last_unstale":"2023-11-28T19:32:24.517210+0000","last_undegraded":"2023-11-28T19:32:24.517210+0000","last_fullsized":"2023-11-28T19:32:24.517210+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:15:30.423478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.569669+0000","last_change":"2023-11-28T19:32:22.532019+0000","last_active":"2023-11-28T19:32:23.569669+0000","last_peered":"2023-11-28T19:32:23.569669+0000","last_clean":"2023-11-28T19:32:23.569669+0000","last_became_active":"2023-11-28T19:32:22.531736+0000","last_became_peered":"2023-11-28T19:32:22.531736+0000","last_unstale":"2023-11-28T19:32:23.569669+0000","last_undegraded":"2023-11-28T19:32:23.569669+0000","last_fullsized":"2023-11-28T19:32:23.569669+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:30.527363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.121626+0000","last_change":"2023-11-28T19:32:23.544638+0000","last_active":"2023-11-28T19:32:25.121626+0000","last_peered":"2023-11-28T19:32:25.121626+0000","last_clean":"2023-11-28T19:32:25.121626+0000","last_became_active":"2023-11-28T19:32:23.543177+0000","last_became_peered":"2023-11-28T19:32:23.543177+0000","last_unstale":"2023-11-28T19:32:25.121626+0000","last_undegraded":"2023-11-28T19:32:25.121626+0000","last_fullsized":"2023-11-28T19:32:25.121626+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:36.930397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.571282+0000","last_change":"2023-11-28T19:32:22.527150+0000","last_active":"2023-11-28T19:32:23.571282+0000","last_peered":"2023-11-28T19:32:23.571282+0000","last_clean":"2023-11-28T19:32:23.571282+0000","last_became_active":"2023-11-28T19:32:22.526767+0000","last_became_peered":"2023-11-28T19:32:22.526767+0000","last_unstale":"2023-11-28T19:32:23.571282+0000","last_undegraded":"2023-11-28T19:32:23.571282+0000","last_fullsized":"2023-11-28T19:32:23.571282+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T04:33:59.030521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.708026+0000","last_change":"2023-11-28T19:32:23.550658+0000","last_active":"2023-11-28T19:32:25.708026+0000","last_peered":"2023-11-28T19:32:25.708026+0000","last_clean":"2023-11-28T19:32:25.708026+0000","last_became_active":"2023-11-28T19:32:23.549432+0000","last_became_peered":"2023-11-28T19:32:23.549432+0000","last_unstale":"2023-11-28T19:32:25.708026+0000","last_undegraded":"2023-11-28T19:32:25.708026+0000","last_fullsized":"2023-11-28T19:32:25.708026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:58.470226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.577049+0000","last_change":"2023-11-28T19:32:22.529096+0000","last_active":"2023-11-28T19:32:23.577049+0000","last_peered":"2023-11-28T19:32:23.577049+0000","last_clean":"2023-11-28T19:32:23.577049+0000","last_became_active":"2023-11-28T19:32:22.528442+0000","last_became_peered":"2023-11-28T19:32:22.528442+0000","last_unstale":"2023-11-28T19:32:23.577049+0000","last_undegraded":"2023-11-28T19:32:23.577049+0000","last_fullsized":"2023-11-28T19:32:23.577049+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:32:07.521544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.606715+0000","last_change":"2023-11-28T19:32:23.562824+0000","last_active":"2023-11-28T19:32:24.606715+0000","last_peered":"2023-11-28T19:32:24.606715+0000","last_clean":"2023-11-28T19:32:24.606715+0000","last_became_active":"2023-11-28T19:32:23.562233+0000","last_became_peered":"2023-11-28T19:32:23.562233+0000","last_unstale":"2023-11-28T19:32:24.606715+0000","last_undegraded":"2023-11-28T19:32:24.606715+0000","last_fullsized":"2023-11-28T19:32:24.606715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:19.482916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.576923+0000","last_change":"2023-11-28T19:32:22.538846+0000","last_active":"2023-11-28T19:32:23.576923+0000","last_peered":"2023-11-28T19:32:23.576923+0000","last_clean":"2023-11-28T19:32:23.576923+0000","last_became_active":"2023-11-28T19:32:22.538210+0000","last_became_peered":"2023-11-28T19:32:22.538210+0000","last_unstale":"2023-11-28T19:32:23.576923+0000","last_undegraded":"2023-11-28T19:32:23.576923+0000","last_fullsized":"2023-11-28T19:32:23.576923+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:02.714250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516403+0000","last_change":"2023-11-28T19:32:23.548626+0000","last_active":"2023-11-28T19:32:24.516403+0000","last_peered":"2023-11-28T19:32:24.516403+0000","last_clean":"2023-11-28T19:32:24.516403+0000","last_became_active":"2023-11-28T19:32:23.547946+0000","last_became_peered":"2023-11-28T19:32:23.547946+0000","last_unstale":"2023-11-28T19:32:24.516403+0000","last_undegraded":"2023-11-28T19:32:24.516403+0000","last_fullsized":"2023-11-28T19:32:24.516403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:36.883890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.515875+0000","last_change":"2023-11-28T19:32:22.518161+0000","last_active":"2023-11-28T19:32:23.515875+0000","last_peered":"2023-11-28T19:32:23.515875+0000","last_clean":"2023-11-28T19:32:23.515875+0000","last_became_active":"2023-11-28T19:32:22.517429+0000","last_became_peered":"2023-11-28T19:32:22.517429+0000","last_unstale":"2023-11-28T19:32:23.515875+0000","last_undegraded":"2023-11-28T19:32:23.515875+0000","last_fullsized":"2023-11-28T19:32:23.515875+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:17.132804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.120348+0000","last_change":"2023-11-28T19:32:23.544509+0000","last_active":"2023-11-28T19:32:25.120348+0000","last_peered":"2023-11-28T19:32:25.120348+0000","last_clean":"2023-11-28T19:32:25.120348+0000","last_became_active":"2023-11-28T19:32:23.543716+0000","last_became_peered":"2023-11-28T19:32:23.543716+0000","last_unstale":"2023-11-28T19:32:25.120348+0000","last_undegraded":"2023-11-28T19:32:25.120348+0000","last_fullsized":"2023-11-28T19:32:25.120348+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:46:22.848432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.518630+0000","last_change":"2023-11-28T19:32:22.543854+0000","last_active":"2023-11-28T19:32:23.518630+0000","last_peered":"2023-11-28T19:32:23.518630+0000","last_clean":"2023-11-28T19:32:23.518630+0000","last_became_active":"2023-11-28T19:32:22.543216+0000","last_became_peered":"2023-11-28T19:32:22.543216+0000","last_unstale":"2023-11-28T19:32:23.518630+0000","last_undegraded":"2023-11-28T19:32:23.518630+0000","last_fullsized":"2023-11-28T19:32:23.518630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:57.306413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.607388+0000","last_change":"2023-11-28T19:32:23.545727+0000","last_active":"2023-11-28T19:32:24.607388+0000","last_peered":"2023-11-28T19:32:24.607388+0000","last_clean":"2023-11-28T19:32:24.607388+0000","last_became_active":"2023-11-28T19:32:23.544734+0000","last_became_peered":"2023-11-28T19:32:23.544734+0000","last_unstale":"2023-11-28T19:32:24.607388+0000","last_undegraded":"2023-11-28T19:32:24.607388+0000","last_fullsized":"2023-11-28T19:32:24.607388+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:22:12.070332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.520398+0000","last_change":"2023-11-28T19:32:22.535414+0000","last_active":"2023-11-28T19:32:23.520398+0000","last_peered":"2023-11-28T19:32:23.520398+0000","last_clean":"2023-11-28T19:32:23.520398+0000","last_became_active":"2023-11-28T19:32:22.534719+0000","last_became_peered":"2023-11-28T19:32:22.534719+0000","last_unstale":"2023-11-28T19:32:23.520398+0000","last_undegraded":"2023-11-28T19:32:23.520398+0000","last_fullsized":"2023-11-28T19:32:23.520398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:41:56.028363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.517734+0000","last_change":"2023-11-28T19:32:23.554110+0000","last_active":"2023-11-28T19:32:24.517734+0000","last_peered":"2023-11-28T19:32:24.517734+0000","last_clean":"2023-11-28T19:32:24.517734+0000","last_became_active":"2023-11-28T19:32:23.552020+0000","last_became_peered":"2023-11-28T19:32:23.552020+0000","last_unstale":"2023-11-28T19:32:24.517734+0000","last_undegraded":"2023-11-28T19:32:24.517734+0000","last_fullsized":"2023-11-28T19:32:24.517734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:23:51.536803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647703+0000","last_change":"2023-11-28T19:32:22.528274+0000","last_active":"2023-11-28T19:32:24.647703+0000","last_peered":"2023-11-28T19:32:24.647703+0000","last_clean":"2023-11-28T19:32:24.647703+0000","last_became_active":"2023-11-28T19:32:22.527831+0000","last_became_peered":"2023-11-28T19:32:22.527831+0000","last_unstale":"2023-11-28T19:32:24.647703+0000","last_undegraded":"2023-11-28T19:32:24.647703+0000","last_fullsized":"2023-11-28T19:32:24.647703+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:17.132804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516973+0000","last_change":"2023-11-28T19:32:23.551479+0000","last_active":"2023-11-28T19:32:24.516973+0000","last_peered":"2023-11-28T19:32:24.516973+0000","last_clean":"2023-11-28T19:32:24.516973+0000","last_became_active":"2023-11-28T19:32:23.550374+0000","last_became_peered":"2023-11-28T19:32:23.550374+0000","last_unstale":"2023-11-28T19:32:24.516973+0000","last_undegraded":"2023-11-28T19:32:24.516973+0000","last_fullsized":"2023-11-28T19:32:24.516973+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:49:14.013929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":15,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.575523+0000","last_change":"2023-11-28T19:32:22.541667+0000","last_active":"2023-11-28T19:32:23.575523+0000","last_peered":"2023-11-28T19:32:23.575523+0000","last_clean":"2023-11-28T19:32:23.575523+0000","last_became_active":"2023-11-28T19:32:22.541017+0000","last_became_peered":"2023-11-28T19:32:22.541017+0000","last_unstale":"2023-11-28T19:32:23.575523+0000","last_undegraded":"2023-11-28T19:32:23.575523+0000","last_fullsized":"2023-11-28T19:32:23.575523+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:36.906845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.606936+0000","last_change":"2023-11-28T19:32:23.565859+0000","last_active":"2023-11-28T19:32:24.606936+0000","last_peered":"2023-11-28T19:32:24.606936+0000","last_clean":"2023-11-28T19:32:24.606936+0000","last_became_active":"2023-11-28T19:32:23.565138+0000","last_became_peered":"2023-11-28T19:32:23.565138+0000","last_unstale":"2023-11-28T19:32:24.606936+0000","last_undegraded":"2023-11-28T19:32:24.606936+0000","last_fullsized":"2023-11-28T19:32:24.606936+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:37.200846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.579042+0000","last_change":"2023-11-28T19:32:22.532782+0000","last_active":"2023-11-28T19:32:23.579042+0000","last_peered":"2023-11-28T19:32:23.579042+0000","last_clean":"2023-11-28T19:32:23.579042+0000","last_became_active":"2023-11-28T19:32:22.532130+0000","last_became_peered":"2023-11-28T19:32:22.532130+0000","last_unstale":"2023-11-28T19:32:23.579042+0000","last_undegraded":"2023-11-28T19:32:23.579042+0000","last_fullsized":"2023-11-28T19:32:23.579042+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:36.906845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.120614+0000","last_change":"2023-11-28T19:32:23.535291+0000","last_active":"2023-11-28T19:32:25.120614+0000","last_peered":"2023-11-28T19:32:25.120614+0000","last_clean":"2023-11-28T19:32:25.120614+0000","last_became_active":"2023-11-28T19:32:23.534499+0000","last_became_peered":"2023-11-28T19:32:23.534499+0000","last_unstale":"2023-11-28T19:32:25.120614+0000","last_undegraded":"2023-11-28T19:32:25.120614+0000","last_fullsized":"2023-11-28T19:32:25.120614+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:19.482916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.580035+0000","last_change":"2023-11-28T19:32:22.543770+0000","last_active":"2023-11-28T19:32:23.580035+0000","last_peered":"2023-11-28T19:32:23.580035+0000","last_clean":"2023-11-28T19:32:23.580035+0000","last_became_active":"2023-11-28T19:32:22.543093+0000","last_became_peered":"2023-11-28T19:32:22.543093+0000","last_unstale":"2023-11-28T19:32:23.580035+0000","last_undegraded":"2023-11-28T19:32:23.580035+0000","last_fullsized":"2023-11-28T19:32:23.580035+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:32:20.333154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516676+0000","last_change":"2023-11-28T19:32:23.547456+0000","last_active":"2023-11-28T19:32:24.516676+0000","last_peered":"2023-11-28T19:32:24.516676+0000","last_clean":"2023-11-28T19:32:24.516676+0000","last_became_active":"2023-11-28T19:32:23.546715+0000","last_became_peered":"2023-11-28T19:32:23.546715+0000","last_unstale":"2023-11-28T19:32:24.516676+0000","last_undegraded":"2023-11-28T19:32:24.516676+0000","last_fullsized":"2023-11-28T19:32:24.516676+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:55:44.803677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.509587+0000","last_change":"2023-11-28T19:32:22.537217+0000","last_active":"2023-11-28T19:32:23.509587+0000","last_peered":"2023-11-28T19:32:23.509587+0000","last_clean":"2023-11-28T19:32:23.509587+0000","last_became_active":"2023-11-28T19:32:22.536807+0000","last_became_peered":"2023-11-28T19:32:22.536807+0000","last_unstale":"2023-11-28T19:32:23.509587+0000","last_undegraded":"2023-11-28T19:32:23.509587+0000","last_fullsized":"2023-11-28T19:32:23.509587+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:32:20.333154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707830+0000","last_change":"2023-11-28T19:32:23.556935+0000","last_active":"2023-11-28T19:32:25.707830+0000","last_peered":"2023-11-28T19:32:25.707830+0000","last_clean":"2023-11-28T19:32:25.707830+0000","last_became_active":"2023-11-28T19:32:23.556199+0000","last_became_peered":"2023-11-28T19:32:23.556199+0000","last_unstale":"2023-11-28T19:32:25.707830+0000","last_undegraded":"2023-11-28T19:32:25.707830+0000","last_fullsized":"2023-11-28T19:32:25.707830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T00:46:22.848432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.516233+0000","last_change":"2023-11-28T19:32:22.531677+0000","last_active":"2023-11-28T19:32:23.516233+0000","last_peered":"2023-11-28T19:32:23.516233+0000","last_clean":"2023-11-28T19:32:23.516233+0000","last_became_active":"2023-11-28T19:32:22.530853+0000","last_became_peered":"2023-11-28T19:32:22.530853+0000","last_unstale":"2023-11-28T19:32:23.516233+0000","last_undegraded":"2023-11-28T19:32:23.516233+0000","last_fullsized":"2023-11-28T19:32:23.516233+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:35.871553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.518635+0000","last_change":"2023-11-28T19:32:23.542698+0000","last_active":"2023-11-28T19:32:24.518635+0000","last_peered":"2023-11-28T19:32:24.518635+0000","last_clean":"2023-11-28T19:32:24.518635+0000","last_became_active":"2023-11-28T19:32:23.541155+0000","last_became_peered":"2023-11-28T19:32:23.541155+0000","last_unstale":"2023-11-28T19:32:24.518635+0000","last_undegraded":"2023-11-28T19:32:24.518635+0000","last_fullsized":"2023-11-28T19:32:24.518635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:23:36.883890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":20,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.572293+0000","last_change":"2023-11-28T19:32:22.522503+0000","last_active":"2023-11-28T19:32:23.572293+0000","last_peered":"2023-11-28T19:32:23.572293+0000","last_clean":"2023-11-28T19:32:23.572293+0000","last_became_active":"2023-11-28T19:32:22.522095+0000","last_became_peered":"2023-11-28T19:32:22.522095+0000","last_unstale":"2023-11-28T19:32:23.572293+0000","last_undegraded":"2023-11-28T19:32:23.572293+0000","last_fullsized":"2023-11-28T19:32:23.572293+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:57.457888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516876+0000","last_change":"2023-11-28T19:32:23.544008+0000","last_active":"2023-11-28T19:32:24.516876+0000","last_peered":"2023-11-28T19:32:24.516876+0000","last_clean":"2023-11-28T19:32:24.516876+0000","last_became_active":"2023-11-28T19:32:23.543254+0000","last_became_peered":"2023-11-28T19:32:23.543254+0000","last_unstale":"2023-11-28T19:32:24.516876+0000","last_undegraded":"2023-11-28T19:32:24.516876+0000","last_fullsized":"2023-11-28T19:32:24.516876+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:37.919182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.572345+0000","last_change":"2023-11-28T19:32:22.531733+0000","last_active":"2023-11-28T19:32:23.572345+0000","last_peered":"2023-11-28T19:32:23.572345+0000","last_clean":"2023-11-28T19:32:23.572345+0000","last_became_active":"2023-11-28T19:32:22.530869+0000","last_became_peered":"2023-11-28T19:32:22.530869+0000","last_unstale":"2023-11-28T19:32:23.572345+0000","last_undegraded":"2023-11-28T19:32:23.572345+0000","last_fullsized":"2023-11-28T19:32:23.572345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:30.527363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.607028+0000","last_change":"2023-11-28T19:32:23.544517+0000","last_active":"2023-11-28T19:32:24.607028+0000","last_peered":"2023-11-28T19:32:24.607028+0000","last_clean":"2023-11-28T19:32:24.607028+0000","last_became_active":"2023-11-28T19:32:23.543790+0000","last_became_peered":"2023-11-28T19:32:23.543790+0000","last_unstale":"2023-11-28T19:32:24.607028+0000","last_undegraded":"2023-11-28T19:32:24.607028+0000","last_fullsized":"2023-11-28T19:32:24.607028+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:58.470226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.579752+0000","last_change":"2023-11-28T19:32:22.543877+0000","last_active":"2023-11-28T19:32:23.579752+0000","last_peered":"2023-11-28T19:32:23.579752+0000","last_clean":"2023-11-28T19:32:23.579752+0000","last_became_active":"2023-11-28T19:32:22.543299+0000","last_became_peered":"2023-11-28T19:32:22.543299+0000","last_unstale":"2023-11-28T19:32:23.579752+0000","last_undegraded":"2023-11-28T19:32:23.579752+0000","last_fullsized":"2023-11-28T19:32:23.579752+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:28:23.749725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.120832+0000","last_change":"2023-11-28T19:32:23.543742+0000","last_active":"2023-11-28T19:32:25.120832+0000","last_peered":"2023-11-28T19:32:25.120832+0000","last_clean":"2023-11-28T19:32:25.120832+0000","last_became_active":"2023-11-28T19:32:23.535753+0000","last_became_peered":"2023-11-28T19:32:23.535753+0000","last_unstale":"2023-11-28T19:32:25.120832+0000","last_undegraded":"2023-11-28T19:32:25.120832+0000","last_fullsized":"2023-11-28T19:32:25.120832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:25:58.470226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.577026+0000","last_change":"2023-11-28T19:32:22.539255+0000","last_active":"2023-11-28T19:32:23.577026+0000","last_peered":"2023-11-28T19:32:23.577026+0000","last_clean":"2023-11-28T19:32:23.577026+0000","last_became_active":"2023-11-28T19:32:22.538357+0000","last_became_peered":"2023-11-28T19:32:22.538357+0000","last_unstale":"2023-11-28T19:32:23.577026+0000","last_undegraded":"2023-11-28T19:32:23.577026+0000","last_fullsized":"2023-11-28T19:32:23.577026+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:17.132804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707460+0000","last_change":"2023-11-28T19:32:23.550638+0000","last_active":"2023-11-28T19:32:25.707460+0000","last_peered":"2023-11-28T19:32:25.707460+0000","last_clean":"2023-11-28T19:32:25.707460+0000","last_became_active":"2023-11-28T19:32:23.549678+0000","last_became_peered":"2023-11-28T19:32:23.549678+0000","last_unstale":"2023-11-28T19:32:25.707460+0000","last_undegraded":"2023-11-28T19:32:25.707460+0000","last_fullsized":"2023-11-28T19:32:25.707460+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:07:00.007948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.520339+0000","last_change":"2023-11-28T19:32:22.529288+0000","last_active":"2023-11-28T19:32:23.520339+0000","last_peered":"2023-11-28T19:32:23.520339+0000","last_clean":"2023-11-28T19:32:23.520339+0000","last_became_active":"2023-11-28T19:32:22.528510+0000","last_became_peered":"2023-11-28T19:32:22.528510+0000","last_unstale":"2023-11-28T19:32:23.520339+0000","last_undegraded":"2023-11-28T19:32:23.520339+0000","last_fullsized":"2023-11-28T19:32:23.520339+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:06:58.995611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707430+0000","last_change":"2023-11-28T19:32:23.531642+0000","last_active":"2023-11-28T19:32:25.707430+0000","last_peered":"2023-11-28T19:32:25.707430+0000","last_clean":"2023-11-28T19:32:25.707430+0000","last_became_active":"2023-11-28T19:32:23.530824+0000","last_became_peered":"2023-11-28T19:32:23.530824+0000","last_unstale":"2023-11-28T19:32:25.707430+0000","last_undegraded":"2023-11-28T19:32:25.707430+0000","last_fullsized":"2023-11-28T19:32:25.707430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T02:09:27.914234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647331+0000","last_change":"2023-11-28T19:32:22.526386+0000","last_active":"2023-11-28T19:32:24.647331+0000","last_peered":"2023-11-28T19:32:24.647331+0000","last_clean":"2023-11-28T19:32:24.647331+0000","last_became_active":"2023-11-28T19:32:22.525967+0000","last_became_peered":"2023-11-28T19:32:22.525967+0000","last_unstale":"2023-11-28T19:32:24.647331+0000","last_undegraded":"2023-11-28T19:32:24.647331+0000","last_fullsized":"2023-11-28T19:32:24.647331+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:40:53.084254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707436+0000","last_change":"2023-11-28T19:32:23.538825+0000","last_active":"2023-11-28T19:32:25.707436+0000","last_peered":"2023-11-28T19:32:25.707436+0000","last_clean":"2023-11-28T19:32:25.707436+0000","last_became_active":"2023-11-28T19:32:23.537978+0000","last_became_peered":"2023-11-28T19:32:23.537978+0000","last_unstale":"2023-11-28T19:32:25.707436+0000","last_undegraded":"2023-11-28T19:32:25.707436+0000","last_fullsized":"2023-11-28T19:32:25.707436+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:32:58.318750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.521178+0000","last_change":"2023-11-28T19:32:22.543860+0000","last_active":"2023-11-28T19:32:23.521178+0000","last_peered":"2023-11-28T19:32:23.521178+0000","last_clean":"2023-11-28T19:32:23.521178+0000","last_became_active":"2023-11-28T19:32:22.543178+0000","last_became_peered":"2023-11-28T19:32:22.543178+0000","last_unstale":"2023-11-28T19:32:23.521178+0000","last_undegraded":"2023-11-28T19:32:23.521178+0000","last_fullsized":"2023-11-28T19:32:23.521178+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T07:32:20.333154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707161+0000","last_change":"2023-11-28T19:32:23.536191+0000","last_active":"2023-11-28T19:32:25.707161+0000","last_peered":"2023-11-28T19:32:25.707161+0000","last_clean":"2023-11-28T19:32:25.707161+0000","last_became_active":"2023-11-28T19:32:23.532704+0000","last_became_peered":"2023-11-28T19:32:23.532704+0000","last_unstale":"2023-11-28T19:32:25.707161+0000","last_undegraded":"2023-11-28T19:32:25.707161+0000","last_fullsized":"2023-11-28T19:32:25.707161+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T01:57:41.734781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.525964+0000","last_change":"2023-11-28T19:32:22.528890+0000","last_active":"2023-11-28T19:32:23.525964+0000","last_peered":"2023-11-28T19:32:23.525964+0000","last_clean":"2023-11-28T19:32:23.525964+0000","last_became_active":"2023-11-28T19:32:22.528049+0000","last_became_peered":"2023-11-28T19:32:22.528049+0000","last_unstale":"2023-11-28T19:32:23.525964+0000","last_undegraded":"2023-11-28T19:32:23.525964+0000","last_fullsized":"2023-11-28T19:32:23.525964+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:34:48.730471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707950+0000","last_change":"2023-11-28T19:32:23.553676+0000","last_active":"2023-11-28T19:32:25.707950+0000","last_peered":"2023-11-28T19:32:25.707950+0000","last_clean":"2023-11-28T19:32:25.707950+0000","last_became_active":"2023-11-28T19:32:23.552782+0000","last_became_peered":"2023-11-28T19:32:23.552782+0000","last_unstale":"2023-11-28T19:32:25.707950+0000","last_undegraded":"2023-11-28T19:32:25.707950+0000","last_fullsized":"2023-11-28T19:32:25.707950+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:17:37.200846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.527784+0000","last_change":"2023-11-28T19:32:22.541005+0000","last_active":"2023-11-28T19:32:23.527784+0000","last_peered":"2023-11-28T19:32:23.527784+0000","last_clean":"2023-11-28T19:32:23.527784+0000","last_became_active":"2023-11-28T19:32:22.540352+0000","last_became_peered":"2023-11-28T19:32:22.540352+0000","last_unstale":"2023-11-28T19:32:23.527784+0000","last_undegraded":"2023-11-28T19:32:23.527784+0000","last_fullsized":"2023-11-28T19:32:23.527784+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:55.863909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707441+0000","last_change":"2023-11-28T19:32:23.539081+0000","last_active":"2023-11-28T19:32:25.707441+0000","last_peered":"2023-11-28T19:32:25.707441+0000","last_clean":"2023-11-28T19:32:25.707441+0000","last_became_active":"2023-11-28T19:32:23.538292+0000","last_became_peered":"2023-11-28T19:32:23.538292+0000","last_unstale":"2023-11-28T19:32:25.707441+0000","last_undegraded":"2023-11-28T19:32:25.707441+0000","last_fullsized":"2023-11-28T19:32:25.707441+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:50:36.525952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.576074+0000","last_change":"2023-11-28T19:32:22.535486+0000","last_active":"2023-11-28T19:32:23.576074+0000","last_peered":"2023-11-28T19:32:23.576074+0000","last_clean":"2023-11-28T19:32:23.576074+0000","last_became_active":"2023-11-28T19:32:22.534916+0000","last_became_peered":"2023-11-28T19:32:22.534916+0000","last_unstale":"2023-11-28T19:32:23.576074+0000","last_undegraded":"2023-11-28T19:32:23.576074+0000","last_fullsized":"2023-11-28T19:32:23.576074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:55.863909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.607183+0000","last_change":"2023-11-28T19:32:23.563030+0000","last_active":"2023-11-28T19:32:24.607183+0000","last_peered":"2023-11-28T19:32:24.607183+0000","last_clean":"2023-11-28T19:32:24.607183+0000","last_became_active":"2023-11-28T19:32:23.562422+0000","last_became_peered":"2023-11-28T19:32:23.562422+0000","last_unstale":"2023-11-28T19:32:24.607183+0000","last_undegraded":"2023-11-28T19:32:24.607183+0000","last_fullsized":"2023-11-28T19:32:24.607183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:30:25.553951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.608165+0000","last_change":"2023-11-28T19:32:22.527160+0000","last_active":"2023-11-28T19:32:25.608165+0000","last_peered":"2023-11-28T19:32:25.608165+0000","last_clean":"2023-11-28T19:32:25.608165+0000","last_became_active":"2023-11-28T19:32:22.526709+0000","last_became_peered":"2023-11-28T19:32:22.526709+0000","last_unstale":"2023-11-28T19:32:25.608165+0000","last_undegraded":"2023-11-28T19:32:25.608165+0000","last_fullsized":"2023-11-28T19:32:25.608165+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:30.527363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647350+0000","last_change":"2023-11-28T19:32:23.531809+0000","last_active":"2023-11-28T19:32:24.647350+0000","last_peered":"2023-11-28T19:32:24.647350+0000","last_clean":"2023-11-28T19:32:24.647350+0000","last_became_active":"2023-11-28T19:32:23.530993+0000","last_became_peered":"2023-11-28T19:32:23.530993+0000","last_unstale":"2023-11-28T19:32:24.647350+0000","last_undegraded":"2023-11-28T19:32:24.647350+0000","last_fullsized":"2023-11-28T19:32:24.647350+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:31:56.876246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.512603+0000","last_change":"2023-11-28T19:32:22.529327+0000","last_active":"2023-11-28T19:32:23.512603+0000","last_peered":"2023-11-28T19:32:23.512603+0000","last_clean":"2023-11-28T19:32:23.512603+0000","last_became_active":"2023-11-28T19:32:22.528646+0000","last_became_peered":"2023-11-28T19:32:22.528646+0000","last_unstale":"2023-11-28T19:32:23.512603+0000","last_undegraded":"2023-11-28T19:32:23.512603+0000","last_fullsized":"2023-11-28T19:32:23.512603+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:51:36.906845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.518173+0000","last_change":"2023-11-28T19:32:23.546408+0000","last_active":"2023-11-28T19:32:24.518173+0000","last_peered":"2023-11-28T19:32:24.518173+0000","last_clean":"2023-11-28T19:32:24.518173+0000","last_became_active":"2023-11-28T19:32:23.545773+0000","last_became_peered":"2023-11-28T19:32:23.545773+0000","last_unstale":"2023-11-28T19:32:24.518173+0000","last_undegraded":"2023-11-28T19:32:24.518173+0000","last_fullsized":"2023-11-28T19:32:24.518173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:18.145142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647563+0000","last_change":"2023-11-28T19:32:22.529821+0000","last_active":"2023-11-28T19:32:24.647563+0000","last_peered":"2023-11-28T19:32:24.647563+0000","last_clean":"2023-11-28T19:32:24.647563+0000","last_became_active":"2023-11-28T19:32:22.529455+0000","last_became_peered":"2023-11-28T19:32:22.529455+0000","last_unstale":"2023-11-28T19:32:24.647563+0000","last_undegraded":"2023-11-28T19:32:24.647563+0000","last_fullsized":"2023-11-28T19:32:24.647563+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T20:20:02.714250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.647415+0000","last_change":"2023-11-28T19:32:23.544784+0000","last_active":"2023-11-28T19:32:24.647415+0000","last_peered":"2023-11-28T19:32:24.647415+0000","last_clean":"2023-11-28T19:32:24.647415+0000","last_became_active":"2023-11-28T19:32:23.544016+0000","last_became_peered":"2023-11-28T19:32:23.544016+0000","last_unstale":"2023-11-28T19:32:24.647415+0000","last_undegraded":"2023-11-28T19:32:24.647415+0000","last_fullsized":"2023-11-28T19:32:24.647415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T06:43:58.616153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.510021+0000","last_change":"2023-11-28T19:32:22.534691+0000","last_active":"2023-11-28T19:32:23.510021+0000","last_peered":"2023-11-28T19:32:23.510021+0000","last_clean":"2023-11-28T19:32:23.510021+0000","last_became_active":"2023-11-28T19:32:22.534281+0000","last_became_peered":"2023-11-28T19:32:22.534281+0000","last_unstale":"2023-11-28T19:32:23.510021+0000","last_undegraded":"2023-11-28T19:32:23.510021+0000","last_fullsized":"2023-11-28T19:32:23.510021+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T21:04:17.132804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.515810+0000","last_change":"2023-11-28T19:32:23.554968+0000","last_active":"2023-11-28T19:32:24.515810+0000","last_peered":"2023-11-28T19:32:24.515810+0000","last_clean":"2023-11-28T19:32:24.515810+0000","last_became_active":"2023-11-28T19:32:23.551736+0000","last_became_peered":"2023-11-28T19:32:23.551736+0000","last_unstale":"2023-11-28T19:32:24.515810+0000","last_undegraded":"2023-11-28T19:32:24.515810+0000","last_fullsized":"2023-11-28T19:32:24.515810+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T23:59:36.930397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.525966+0000","last_change":"2023-11-28T19:32:22.535588+0000","last_active":"2023-11-28T19:32:23.525966+0000","last_peered":"2023-11-28T19:32:23.525966+0000","last_clean":"2023-11-28T19:32:23.525966+0000","last_became_active":"2023-11-28T19:32:22.533969+0000","last_became_peered":"2023-11-28T19:32:22.533969+0000","last_unstale":"2023-11-28T19:32:23.525966+0000","last_undegraded":"2023-11-28T19:32:23.525966+0000","last_fullsized":"2023-11-28T19:32:23.525966+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:20:12.097738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:24.516400+0000","last_change":"2023-11-28T19:32:23.541181+0000","last_active":"2023-11-28T19:32:24.516400+0000","last_peered":"2023-11-28T19:32:24.516400+0000","last_clean":"2023-11-28T19:32:24.516400+0000","last_became_active":"2023-11-28T19:32:23.540535+0000","last_became_peered":"2023-11-28T19:32:23.540535+0000","last_unstale":"2023-11-28T19:32:24.516400+0000","last_undegraded":"2023-11-28T19:32:24.516400+0000","last_fullsized":"2023-11-28T19:32:24.516400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T05:11:31.539700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.520503+0000","last_change":"2023-11-28T19:32:22.530719+0000","last_active":"2023-11-28T19:32:23.520503+0000","last_peered":"2023-11-28T19:32:23.520503+0000","last_clean":"2023-11-28T19:32:23.520503+0000","last_became_active":"2023-11-28T19:32:22.530309+0000","last_became_peered":"2023-11-28T19:32:22.530309+0000","last_unstale":"2023-11-28T19:32:23.520503+0000","last_undegraded":"2023-11-28T19:32:23.520503+0000","last_fullsized":"2023-11-28T19:32:23.520503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:14:48.405088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-11-28T19:32:25.707919+0000","last_change":"2023-11-28T19:32:23.554896+0000","last_active":"2023-11-28T19:32:25.707919+0000","last_peered":"2023-11-28T19:32:25.707919+0000","last_clean":"2023-11-28T19:32:25.707919+0000","last_became_active":"2023-11-28T19:32:23.553538+0000","last_became_peered":"2023-11-28T19:32:23.553538+0000","last_unstale":"2023-11-28T19:32:25.707919+0000","last_undegraded":"2023-11-28T19:32:25.707919+0000","last_fullsized":"2023-11-28T19:32:25.707919+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:22.485054+0000","last_clean_scrub_stamp":"2023-11-28T19:32:22.485054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-30T03:40:19.482916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.518549+0000","last_change":"2023-11-28T19:32:22.546949+0000","last_active":"2023-11-28T19:32:23.518549+0000","last_peered":"2023-11-28T19:32:23.518549+0000","last_clean":"2023-11-28T19:32:23.518549+0000","last_became_active":"2023-11-28T19:32:22.546404+0000","last_became_peered":"2023-11-28T19:32:22.546404+0000","last_unstale":"2023-11-28T19:32:23.518549+0000","last_undegraded":"2023-11-28T19:32:23.518549+0000","last_fullsized":"2023-11-28T19:32:23.518549+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:32:21.472717+0000","last_clean_scrub_stamp":"2023-11-28T19:32:21.472717+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T19:50:35.513615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":173,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-11-28T19:32:23.537343+0000","last_change":"2023-11-28T19:31:35.378105+0000","last_active":"2023-11-28T19:32:23.537343+0000","last_peered":"2023-11-28T19:32:23.537343+0000","last_clean":"2023-11-28T19:32:23.537343+0000","last_became_active":"2023-11-28T19:31:35.375035+0000","last_became_peered":"2023-11-28T19:31:35.375035+0000","last_unstale":"2023-11-28T19:32:23.537343+0000","last_undegraded":"2023-11-28T19:32:23.537343+0000","last_fullsized":"2023-11-28T19:32:23.537343+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-11-28T19:31:33.813158+0000","last_clean_scrub_stamp":"2023-11-28T19:31:33.813158+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-11-29T22:50:07.043315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":958464,"data_stored":729403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"min":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.97299999999999998},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.87}]},{"osd":1,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1,"5min":1,"15min":1},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.032},{"interface":"front","average":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.78600000000000003}]},{"osd":2,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.528,"5min":1.528,"15min":1.528},"last":0.82599999999999996},{"interface":"front","average":{"1min":1.089,"5min":1.089,"15min":1.089},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.0790000000000002,"5min":2.0790000000000002,"15min":2.0790000000000002},"last":0.90700000000000003}]},{"osd":3,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.3819999999999999,"5min":1.3819999999999999,"15min":1.3819999999999999},"last":0.624},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"max":{"1min":2.181,"5min":2.181,"15min":2.181},"last":0.94699999999999995}]},{"osd":4,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.282,"5min":1.282,"15min":1.282},"last":0.98799999999999999},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.401,"5min":1.401,"15min":1.401},"last":0.89200000000000002}]},{"osd":5,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.179,"15min":1.179},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":2.3239999999999998,"5min":2.3239999999999998,"15min":2.3239999999999998},"last":0.84799999999999998},{"interface":"front","average":{"1min":1.054,"5min":1.054,"15min":1.054},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.0800000000000001}]},{"osd":6,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.103,"5min":1.103,"15min":1.103},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":1.214},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.611,"5min":1.611,"15min":1.611},"last":0.92900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.02,"5min":1.02,"15min":1.02},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.8129999999999999,"5min":1.8129999999999999,"15min":1.8129999999999999},"last":0.97799999999999998}]},{"osd":1,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.6140000000000001,"5min":1.6140000000000001,"15min":1.6140000000000001},"last":1.0089999999999999},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2669999999999999,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.90600000000000003}]},{"osd":2,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.6739999999999999,"5min":1.6739999999999999,"15min":1.6739999999999999},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.3319999999999999,"5min":2.3319999999999999,"15min":2.3319999999999999},"last":1.1279999999999999}]},{"osd":3,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":1.228},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"max":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"last":1.1599999999999999}]},{"osd":4,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.304,"5min":1.304,"15min":1.304},"last":0.84699999999999998},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.68799999999999994}]},{"osd":5,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"min":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"last":1.194},{"interface":"front","average":{"1min":1.163,"5min":1.163,"15min":1.163},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.679,"5min":1.679,"15min":1.679},"last":0.94199999999999995}]},{"osd":7,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"min":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"max":{"1min":1.919,"5min":1.919,"15min":1.919},"last":0.80100000000000005},{"interface":"front","average":{"1min":1.3160000000000001,"5min":1.3160000000000001,"15min":1.3160000000000001},"min":{"1min":1.028,"5min":1.028,"15min":1.028},"max":{"1min":1.7649999999999999,"5min":1.7649999999999999,"15min":1.7649999999999999},"last":1.3089999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139617,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.94799999999999995,"5min":0.94799999999999995,"15min":0.94799999999999995},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.3120000000000001,"5min":1.3120000000000001,"15min":1.3120000000000001},"last":1.2390000000000001}]},{"osd":1,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.161,"5min":1.161,"15min":1.161},"last":1.161}]},{"osd":2,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"last":0.997},{"interface":"front","average":{"1min":1.024,"5min":1.024,"15min":1.024},"min":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":1.8400000000000001,"5min":1.8400000000000001,"15min":1.8400000000000001},"last":0.74099999999999999}]},{"osd":3,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":1.0640000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"last":1.095}]},{"osd":4,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"min":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"max":{"1min":1.218,"5min":1.218,"15min":1.218},"last":0.94299999999999995},{"interface":"front","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.4139999999999999,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.88400000000000001}]},{"osd":6,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.91200000000000003},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"max":{"1min":1.3140000000000001,"5min":1.3140000000000001,"15min":1.3140000000000001},"last":1.036}]},{"osd":7,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.45,"5min":1.45,"15min":1.45},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":1.7729999999999999,"5min":1.7729999999999999,"15min":1.7729999999999999},"last":1.198}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":139049,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.115}]},{"osd":1,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":1.0269999999999999}]},{"osd":2,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.268,"5min":1.268,"15min":1.268},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":1.488,"5min":1.488,"15min":1.488},"last":0.69599999999999995}]},{"osd":3,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":1.365,"5min":1.365,"15min":1.365},"last":1.2370000000000001},{"interface":"front","average":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":1.5389999999999999},"last":0.91200000000000003}]},{"osd":5,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":0.97999999999999998},{"interface":"front","average":{"1min":1.018,"5min":1.018,"15min":1.018},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.85499999999999998}]},{"osd":6,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.081,"15min":1.081},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":1.0900000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.095,"15min":1.095},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":1.8440000000000001},"last":1.204}]},{"osd":7,"last update":"Tue Nov 28 19:32:35 2023","interfaces":[{"interface":"back","average":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"min":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"max":{"1min":1.6419999999999999,"5min":1.6419999999999999,"15min":1.6419999999999999},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":1.7669999999999999,"5min":1.7669999999999999,"15min":1.7669999999999999},"last":1.167}]}]},{"osd":3,"up_from":13,"seq":55834574863,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":140579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.77900000000000003}]},{"osd":1,"last update":"Tue Nov 28 19:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.5409999999999999,"5min":1.5409999999999999,"15min":1.5409999999999999},"last":0.67700000000000005}]},{"osd":2,"last update":"Tue Nov 28 19:32:33 2023","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.2949999999999999},{"interface":"front","average":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":0.98199999999999998}]},{"osd":4,"last update":"Tue Nov 28 19:32:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":1.2430000000000001},{"interface":"front","average":{"1min":1.012,"5min":1.012,"15min":1.012},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":1.1899999999999999}]},{"osd":5,"last update":"Tue Nov 28 19:32:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.88100000000000001},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"min":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"max":{"1min":2.7320000000000002,"5min":2.7320000000000002,"15min":2.7320000000000002},"last":1.157}]},{"osd":6,"last update":"Tue Nov 28 19:32:33 2023","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.6139999999999999,"5min":2.6139999999999999,"15min":2.6139999999999999},"last":1.129},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":3.3639999999999999,"5min":3.3639999999999999,"15min":3.3639999999999999},"last":1.377}]},{"osd":7,"last update":"Tue Nov 28 19:32:33 2023","interfaces":[{"interface":"back","average":{"1min":1.139,"5min":1.139,"15min":1.139},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"last":1.0880000000000001},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.736,"5min":1.736,"15min":1.736},"last":1.0289999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31536,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340304,"statfs":{"total":96636764160,"available":96604471296,"internally_reserved":0,"allocated":364544,"data_stored":139015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":2.3860000000000001,"5min":2.3860000000000001,"15min":2.3860000000000001},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":1.4470000000000001},"last":0.79300000000000004}]},{"osd":1,"last update":"Tue Nov 28 19:32:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":8.6400000000000006,"5min":8.6400000000000006,"15min":8.6400000000000006},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":6.0309999999999997,"5min":6.0309999999999997,"15min":6.0309999999999997},"last":0.93799999999999994}]},{"osd":3,"last update":"Tue Nov 28 19:32:34 2023","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":2.2160000000000002,"5min":2.2160000000000002,"15min":2.2160000000000002},"last":0.73499999999999999}]},{"osd":4,"last update":"Tue Nov 28 19:32:34 2023","interfaces":[{"interface":"back","average":{"1min":1.077,"5min":1.077,"15min":1.077},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":2.302,"5min":2.302,"15min":2.302},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.121,"5min":1.121,"15min":1.121},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.8460000000000001,"5min":1.8460000000000001,"15min":1.8460000000000001},"last":1.133}]},{"osd":5,"last update":"Tue Nov 28 19:32:34 2023","interfaces":[{"interface":"back","average":{"1min":1.0589999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"min":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.179},{"interface":"front","average":{"1min":1.536,"5min":1.536,"15min":1.536},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":10.132,"5min":10.132,"15min":10.132},"last":1.028}]},{"osd":6,"last update":"Tue Nov 28 19:32:34 2023","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.278,"15min":1.278},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":3.9100000000000001,"5min":3.9100000000000001,"15min":3.9100000000000001},"last":1.0620000000000001},{"interface":"front","average":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":1.1359999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":1.944,"5min":1.944,"15min":1.944},"last":1.095}]},{"osd":7,"last update":"Tue Nov 28 19:32:34 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":1.825,"5min":1.825,"15min":1.825},"last":1.218},{"interface":"front","average":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":1.1870000000000001},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":2.04,"5min":2.04,"15min":2.04},"last":1.2470000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31548,"kb_used_data":368,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340292,"statfs":{"total":96636764160,"available":96604459008,"internally_reserved":0,"allocated":376832,"data_stored":140579,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Nov 28 19:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.70399999999999996}]},{"osd":2,"last update":"Tue Nov 28 19:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.6180000000000001,"5min":1.6180000000000001,"15min":1.6180000000000001},"last":0.79500000000000004}]},{"osd":3,"last update":"Tue Nov 28 19:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.26,"5min":1.26,"15min":1.26},"last":0.878},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3759999999999999,"5min":1.3759999999999999,"15min":1.3759999999999999},"last":0.91300000000000003}]},{"osd":4,"last update":"Tue Nov 28 19:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.55,"5min":1.55,"15min":1.55},"last":1.208},{"interface":"front","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":1.0529999999999999}]},{"osd":5,"last update":"Tue Nov 28 19:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.5009999999999999,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.0189999999999999,"5min":1.0189999999999999,"15min":1.0189999999999999},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.381,"5min":1.381,"15min":1.381},"last":1.022}]},{"osd":6,"last update":"Tue Nov 28 19:32:36 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":2.0600000000000001,"5min":2.0600000000000001,"15min":2.0600000000000001},"last":1.075},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.1160000000000001}]},{"osd":7,"last update":"Tue Nov 28 19:32:36 2023","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.085,"15min":1.085},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.4450000000000001,"5min":1.4450000000000001,"15min":1.4450000000000001},"last":1.0940000000000001},{"interface":"front","average":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.9239999999999999,"5min":1.9239999999999999,"15min":1.9239999999999999},"last":1.1459999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32120,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339720,"statfs":{"total":96636764160,"available":96603873280,"internally_reserved":0,"allocated":954368,"data_stored":729313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.91800000000000004,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66600000000000004}]},{"osd":2,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.5449999999999999,"5min":1.5449999999999999,"15min":1.5449999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.4350000000000001,"5min":1.4350000000000001,"15min":1.4350000000000001},"last":1.181}]},{"osd":4,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.92800000000000005},{"interface":"front","average":{"1min":1.01,"5min":1.01,"15min":1.01},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.3660000000000001,"5min":1.3660000000000001,"15min":1.3660000000000001},"last":1.028}]},{"osd":5,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.105,"5min":1.105,"15min":1.105},"min":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":1.2310000000000001},{"interface":"front","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":1.266}]},{"osd":6,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.6240000000000001,"5min":1.6240000000000001,"15min":1.6240000000000001},"last":1.2989999999999999},{"interface":"front","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.6200000000000001,"5min":1.6200000000000001,"15min":1.6200000000000001},"last":1.139}]},{"osd":7,"last update":"Tue Nov 28 19:32:32 2023","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.153,"15min":1.153},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.98499999999999999},{"interface":"front","average":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":1.3400000000000001},"last":1.083}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-11-28T19:32:39.723 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-11-28T19:32:39.723 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-11-28T19:32:39.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10c273d640 1 Processor -- start 2023-11-28T19:32:39.900 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10c273d640 1 -- start start 2023-11-28T19:32:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10c273d640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f10bc0bc120 0x7f10bc0bd0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10c273d640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f10bc072940 0x7f10bc153c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:39.902 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10c273d640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc143b60 con 0x7f10bc0a2d60 2023-11-28T19:32:39.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10c273d640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc0b6f30 con 0x7f10bc072940 2023-11-28T19:32:39.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10c273d640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc0b7aa0 con 0x7f10bc0bc120 2023-11-28T19:32:39.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10c0cda640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f10bc072940 0x7f10bc153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:39.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10c0cda640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f10bc072940 0x7f10bc153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53100/0 (socket says 172.21.15.28:53100) 2023-11-28T19:32:39.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10c0cda640 1 -- 172.21.15.28:0/1783992737 learned_addr learned my addr 172.21.15.28:0/1783992737 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:39.903 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10bbfff640 1 --2- 172.21.15.28:0/1783992737 >> v2:172.21.15.131:3300/0 conn(0x7f10bc0bc120 0x7f10bc0bd0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:39.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10c0cda640 1 -- 172.21.15.28:0/1783992737 >> v2:172.21.15.131:3300/0 conn(0x7f10bc0bc120 msgr2=0x7f10bc0bd0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:39.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10c0cda640 1 --2- 172.21.15.28:0/1783992737 >> v2:172.21.15.131:3300/0 conn(0x7f10bc0bc120 0x7f10bc0bd0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:39.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10c0cda640 1 -- 172.21.15.28:0/1783992737 >> v1:172.21.15.131:6789/0 conn(0x7f10bc0a2d60 legacy=0x7f10bc14c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:39.904 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.897+0000 7f10c0cda640 1 -- 172.21.15.28:0/1783992737 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0b7d60 con 0x7f10bc072940 2023-11-28T19:32:39.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.901+0000 7f10c0cda640 1 --2- 172.21.15.28:0/1783992737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc072940 0x7f10bc153c80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f10bc06d940 tx=0x7f10b401f180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6119ee5a58513e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:39.906 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.901+0000 7f10baffd640 1 -- 172.21.15.28:0/1783992737 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b40af400 con 0x7f10bc072940 2023-11-28T19:32:39.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.901+0000 7f10baffd640 1 -- 172.21.15.28:0/1783992737 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b40ab050 con 0x7f10bc072940 2023-11-28T19:32:39.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.901+0000 7f10baffd640 1 -- 172.21.15.28:0/1783992737 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b40af780 con 0x7f10bc072940 2023-11-28T19:32:39.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.901+0000 7f10c273d640 1 -- 172.21.15.28:0/1783992737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc072940 msgr2=0x7f10bc153c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:39.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.901+0000 7f10c273d640 1 --2- 172.21.15.28:0/1783992737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc072940 0x7f10bc153c80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f10bc06d940 tx=0x7f10b401f180 comp rx=0 tx=0).stop 2023-11-28T19:32:39.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.901+0000 7f10c273d640 1 -- 172.21.15.28:0/1783992737 shutdown_connections 2023-11-28T19:32:39.907 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.901+0000 7f10c273d640 1 --2- 172.21.15.28:0/1783992737 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc072940 0x7f10bc153c80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.901+0000 7f10c273d640 1 --2- 172.21.15.28:0/1783992737 >> v2:172.21.15.131:3300/0 conn(0x7f10bc0bc120 0x7f10bc0bd0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.901+0000 7f10c273d640 1 -- 172.21.15.28:0/1783992737 >> 172.21.15.28:0/1783992737 conn(0x7f10bc06ab80 msgr2=0x7f10bc0bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.901+0000 7f10c273d640 1 -- 172.21.15.28:0/1783992737 shutdown_connections 2023-11-28T19:32:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.901+0000 7f10c273d640 1 -- 172.21.15.28:0/1783992737 wait complete. 2023-11-28T19:32:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10c273d640 1 Processor -- start 2023-11-28T19:32:39.908 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10c273d640 1 -- start start 2023-11-28T19:32:39.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10c273d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc072940 0x7f10bc13a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:39.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10c273d640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc0a2d60 0x7f10bc149a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:39.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10c273d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc0bc120 0x7f10bc13b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:39.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10c273d640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc13a7d0 con 0x7f10bc072940 2023-11-28T19:32:39.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10c273d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc148f70 con 0x7f10bc0bc120 2023-11-28T19:32:39.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10c273d640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc13ca60 con 0x7f10bc0a2d60 2023-11-28T19:32:39.911 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10bbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc072940 0x7f10bc13a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:39.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10bbfff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc072940 0x7f10bc13a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53102/0 (socket says 172.21.15.28:53102) 2023-11-28T19:32:39.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10bbfff640 1 -- 172.21.15.28:0/3318392502 learned_addr learned my addr 172.21.15.28:0/3318392502 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:39.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10c0cda640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc0bc120 0x7f10bc13b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:39.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10bbfff640 1 -- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc0a2d60 msgr2=0x7f10bc149a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:39.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10bb7fe640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc0a2d60 0x7f10bc149a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:39.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10bbfff640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc0a2d60 0x7f10bc149a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:39.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10bbfff640 1 -- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc0bc120 msgr2=0x7f10bc13b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:39.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10bbfff640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc0bc120 0x7f10bc13b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:39.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10bbfff640 1 -- 172.21.15.28:0/3318392502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b4009b30 con 0x7f10bc072940 2023-11-28T19:32:39.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10c0cda640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc0bc120 0x7f10bc13b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:39.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10bbfff640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc072940 0x7f10bc13a290 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00d5f0 tx=0x7f10ac00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:39.912 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10b8ff9640 1 -- 172.21.15.28:0/3318392502 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac0125f0 con 0x7f10bc072940 2023-11-28T19:32:39.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10b8ff9640 1 -- 172.21.15.28:0/3318392502 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac012750 con 0x7f10bc072940 2023-11-28T19:32:39.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10c273d640 1 -- 172.21.15.28:0/3318392502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc1deca0 con 0x7f10bc072940 2023-11-28T19:32:39.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10b8ff9640 1 -- 172.21.15.28:0/3318392502 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac012ae0 con 0x7f10bc072940 2023-11-28T19:32:39.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10c273d640 1 -- 172.21.15.28:0/3318392502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc13c780 con 0x7f10bc072940 2023-11-28T19:32:39.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10c273d640 1 -- 172.21.15.28:0/3318392502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc074a90 con 0x7f10bc072940 2023-11-28T19:32:39.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.905+0000 7f10b8ff9640 1 -- 172.21.15.28:0/3318392502 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f10ac012c40 con 0x7f10bc072940 2023-11-28T19:32:39.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.909+0000 7f10b8ff9640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f10a8066470 0x7f10a8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:39.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.909+0000 7f10b8ff9640 1 -- 172.21.15.28:0/3318392502 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10ac084de0 con 0x7f10bc072940 2023-11-28T19:32:39.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.909+0000 7f10bb7fe640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f10a8066470 0x7f10a8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:39.913 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.909+0000 7f10bb7fe640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f10a8066470 0x7f10a8068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0a2d30 tx=0x7f10b0009040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:39.914 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:39.913+0000 7f10b8ff9640 1 -- 172.21.15.28:0/3318392502 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f10ac0522d0 con 0x7f10bc072940 2023-11-28T19:32:40.126 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.125+0000 7f10c273d640 1 -- 172.21.15.28:0/3318392502 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f10bc0b2f70 con 0x7f10bc072940 2023-11-28T19:32:40.131 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.129+0000 7f10b8ff9640 1 -- 172.21.15.28:0/3318392502 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+147 (secure 0 0 0) 0x7f10ac007380 con 0x7f10bc072940 2023-11-28T19:32:40.131 INFO:teuthology.orchestra.run.smithi028.stdout:[client.0] 2023-11-28T19:32:40.131 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDeP2ZlIJB6KhAAD1X87Jdr4Z4RDtIDK8BvXg== 2023-11-28T19:32:40.131 INFO:teuthology.orchestra.run.smithi028.stdout: caps mds = "allow" 2023-11-28T19:32:40.131 INFO:teuthology.orchestra.run.smithi028.stdout: caps mon = "allow r" 2023-11-28T19:32:40.132 INFO:teuthology.orchestra.run.smithi028.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-11-28T19:32:40.132 INFO:teuthology.orchestra.run.smithi028.stderr:updated caps for client.0 2023-11-28T19:32:40.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.129+0000 7f10c273d640 1 -- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f10a8066470 msgr2=0x7f10a8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.133 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.129+0000 7f10c273d640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f10a8066470 0x7f10a8068930 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f10bc0a2d30 tx=0x7f10b0009040 comp rx=0 tx=0).stop 2023-11-28T19:32:40.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.129+0000 7f10c273d640 1 -- 172.21.15.28:0/3318392502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc072940 msgr2=0x7f10bc13a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.129+0000 7f10c273d640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc072940 0x7f10bc13a290 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f10ac00d5f0 tx=0x7f10ac00dab0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.129+0000 7f10c273d640 1 -- 172.21.15.28:0/3318392502 shutdown_connections 2023-11-28T19:32:40.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.129+0000 7f10c273d640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f10a8066470 0x7f10a8068930 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.129+0000 7f10c273d640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10bc0bc120 0x7f10bc13b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.129+0000 7f10c273d640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f10bc0a2d60 0x7f10bc149a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.129+0000 7f10c273d640 1 --2- 172.21.15.28:0/3318392502 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f10bc072940 0x7f10bc13a290 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.129+0000 7f10c273d640 1 -- 172.21.15.28:0/3318392502 >> 172.21.15.28:0/3318392502 conn(0x7f10bc06ab80 msgr2=0x7f10bc0b2740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:40.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.129+0000 7f10c273d640 1 -- 172.21.15.28:0/3318392502 shutdown_connections 2023-11-28T19:32:40.134 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.129+0000 7f10c273d640 1 -- 172.21.15.28:0/3318392502 wait complete. 2023-11-28T19:32:40.150 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-11-28T19:32:40.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbddaae640 1 Processor -- start 2023-11-28T19:32:40.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbddaae640 1 -- start start 2023-11-28T19:32:40.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbddaae640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffbd814c860 0x7ffbd80b6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbddaae640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffbd814ccc0 0x7ffbd80b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbddaae640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbd806f780 con 0x7ffbd80b8f30 2023-11-28T19:32:40.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbddaae640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbd80b6cd0 con 0x7ffbd814c860 2023-11-28T19:32:40.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbddaae640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8143aa0 con 0x7ffbd814ccc0 2023-11-28T19:32:40.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbd6ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffbd814c860 0x7ffbd80b6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbd77fe640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7ffbd80b8f30 0x7ffbd8071790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48474/0 (socket says 172.21.15.28:48474) 2023-11-28T19:32:40.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbd77fe640 1 -- 172.21.15.28:0/1765452735 learned_addr learned my addr 172.21.15.28:0/1765452735 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:40.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbd6ffd640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7ffbd814c860 0x7ffbd80b6250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53112/0 (socket says 172.21.15.28:53112) 2023-11-28T19:32:40.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbd7fff640 1 --2- 172.21.15.28:0/1765452735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffbd814ccc0 0x7ffbd80b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbd6ffd640 1 -- 172.21.15.28:0/1765452735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffbd814ccc0 msgr2=0x7ffbd80b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:40.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbd6ffd640 1 --2- 172.21.15.28:0/1765452735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffbd814ccc0 0x7ffbd80b6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbd6ffd640 1 -- 172.21.15.28:0/1765452735 >> v1:172.21.15.28:6789/0 conn(0x7ffbd80b8f30 legacy=0x7ffbd8071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbd67fc640 1 -- 172.21.15.28:0/1765452735 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 130456018 0 0) 0x7ffbc8001120 con 0x7ffbd80b8f30 2023-11-28T19:32:40.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.269+0000 7ffbd6ffd640 1 -- 172.21.15.28:0/1765452735 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbd8072320 con 0x7ffbd814c860 2023-11-28T19:32:40.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd6ffd640 1 --2- 172.21.15.28:0/1765452735 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbd814c860 0x7ffbd80b6250 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0097c0 tx=0x7ffbcc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a755f2e35cd80 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:40.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd67fc640 1 -- 172.21.15.28:0/1765452735 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc0ab600 con 0x7ffbd814c860 2023-11-28T19:32:40.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd67fc640 1 -- 172.21.15.28:0/1765452735 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc0a7050 con 0x7ffbd814c860 2023-11-28T19:32:40.275 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd67fc640 1 -- 172.21.15.28:0/1765452735 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc0ab980 con 0x7ffbd814c860 2023-11-28T19:32:40.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 -- 172.21.15.28:0/1765452735 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbd814c860 msgr2=0x7ffbd80b6250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 --2- 172.21.15.28:0/1765452735 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbd814c860 0x7ffbd80b6250 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc0097c0 tx=0x7ffbcc01c480 comp rx=0 tx=0).stop 2023-11-28T19:32:40.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 -- 172.21.15.28:0/1765452735 shutdown_connections 2023-11-28T19:32:40.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 --2- 172.21.15.28:0/1765452735 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffbd814ccc0 0x7ffbd80b6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 --2- 172.21.15.28:0/1765452735 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbd814c860 0x7ffbd80b6250 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 -- 172.21.15.28:0/1765452735 >> 172.21.15.28:0/1765452735 conn(0x7ffbd80bcb40 msgr2=0x7ffbd80bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:40.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 -- 172.21.15.28:0/1765452735 shutdown_connections 2023-11-28T19:32:40.276 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 -- 172.21.15.28:0/1765452735 wait complete. 2023-11-28T19:32:40.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 Processor -- start 2023-11-28T19:32:40.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 -- start start 2023-11-28T19:32:40.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffbd80b8f30 0x7ffbd8143df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbd814c860 0x7ffbd8146810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffbd814ccc0 0x7ffbd8142900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8142e40 con 0x7ffbd814c860 2023-11-28T19:32:40.279 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd8146380 con 0x7ffbd814ccc0 2023-11-28T19:32:40.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbddaae640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbd813f150 con 0x7ffbd80b8f30 2023-11-28T19:32:40.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbd814c860 0x7ffbd8146810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd6ffd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbd814c860 0x7ffbd8146810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53116/0 (socket says 172.21.15.28:53116) 2023-11-28T19:32:40.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd6ffd640 1 -- 172.21.15.28:0/726105189 learned_addr learned my addr 172.21.15.28:0/726105189 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:40.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd77fe640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffbd80b8f30 0x7ffbd8143df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd7fff640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffbd814ccc0 0x7ffbd8142900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.280 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd6ffd640 1 -- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffbd80b8f30 msgr2=0x7ffbd8143df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd6ffd640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffbd80b8f30 0x7ffbd8143df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd6ffd640 1 -- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffbd814ccc0 msgr2=0x7ffbd8142900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd6ffd640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffbd814ccc0 0x7ffbd8142900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd6ffd640 1 -- 172.21.15.28:0/726105189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbcc009420 con 0x7ffbd814c860 2023-11-28T19:32:40.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.273+0000 7ffbd7fff640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffbd814ccc0 0x7ffbd8142900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:40.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.277+0000 7ffbd6ffd640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbd814c860 0x7ffbd8146810 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc01ab30 tx=0x7ffbcc019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:40.281 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.277+0000 7ffbbffff640 1 -- 172.21.15.28:0/726105189 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc004220 con 0x7ffbd814c860 2023-11-28T19:32:40.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.277+0000 7ffbbffff640 1 -- 172.21.15.28:0/726105189 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbcc004380 con 0x7ffbd814c860 2023-11-28T19:32:40.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.277+0000 7ffbddaae640 1 -- 172.21.15.28:0/726105189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbd8145d30 con 0x7ffbd814c860 2023-11-28T19:32:40.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.277+0000 7ffbbffff640 1 -- 172.21.15.28:0/726105189 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffbcc003820 con 0x7ffbd814c860 2023-11-28T19:32:40.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.277+0000 7ffbddaae640 1 -- 172.21.15.28:0/726105189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbd813ee70 con 0x7ffbd814c860 2023-11-28T19:32:40.282 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.277+0000 7ffbddaae640 1 -- 172.21.15.28:0/726105189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbd8146530 con 0x7ffbd814c860 2023-11-28T19:32:40.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.277+0000 7ffbbffff640 1 -- 172.21.15.28:0/726105189 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7ffbcc0b2040 con 0x7ffbd814c860 2023-11-28T19:32:40.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.277+0000 7ffbbffff640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ffbc4066470 0x7ffbc4068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.277+0000 7ffbbffff640 1 -- 172.21.15.28:0/726105189 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffbcc11ddc0 con 0x7ffbd814c860 2023-11-28T19:32:40.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.277+0000 7ffbd77fe640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ffbc4066470 0x7ffbc4068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.283 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.277+0000 7ffbd77fe640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ffbc4066470 0x7ffbc4068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8000f70 tx=0x7ffbc8007c10 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:40.284 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.281+0000 7ffbbffff640 1 -- 172.21.15.28:0/726105189 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7ffbd8146530 con 0x7ffbd814c860 2023-11-28T19:32:40.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.473+0000 7ffbddaae640 1 -- 172.21.15.28:0/726105189 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffbd8146d50 con 0x7ffbd814c860 2023-11-28T19:32:40.475 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.473+0000 7ffbbffff640 1 -- 172.21.15.28:0/726105189 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4125 (secure 0 0 0) 0x7ffbd8146d50 con 0x7ffbd814c860 2023-11-28T19:32:40.476 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:32:40.476 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4514,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6835/1377411437","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":1377411437},{"type":"v1","addr":"172.21.15.131:6835","nonce":1377411437}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11},{"gid":4672,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.28:6835/1536974468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6833","nonce":1536974468},{"type":"v1","addr":"172.21.15.28:6835","nonce":1536974468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-11-28T19:32:22.871529+0000","modified":"2023-11-28T19:32:25.923656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4914},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4914":{"gid":4914,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.28:6834/1057392898","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:6832","nonce":1057392898},{"type":"v1","addr":"172.21.15.28:6834","nonce":1057392898}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-11-28T19:32:40.476 INFO:teuthology.orchestra.run.smithi028.stderr:dumped fsmap epoch 16 2023-11-28T19:32:40.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.473+0000 7ffbddaae640 1 -- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ffbc4066470 msgr2=0x7ffbc4068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.473+0000 7ffbddaae640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ffbc4066470 0x7ffbc4068930 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffbc8000f70 tx=0x7ffbc8007c10 comp rx=0 tx=0).stop 2023-11-28T19:32:40.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.473+0000 7ffbddaae640 1 -- 172.21.15.28:0/726105189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbd814c860 msgr2=0x7ffbd8146810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.473+0000 7ffbddaae640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbd814c860 0x7ffbd8146810 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7ffbcc01ab30 tx=0x7ffbcc019220 comp rx=0 tx=0).stop 2023-11-28T19:32:40.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.473+0000 7ffbddaae640 1 -- 172.21.15.28:0/726105189 shutdown_connections 2023-11-28T19:32:40.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.473+0000 7ffbddaae640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7ffbc4066470 0x7ffbc4068930 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.478 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.473+0000 7ffbddaae640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffbd814ccc0 0x7ffbd8142900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.473+0000 7ffbddaae640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7ffbd814c860 0x7ffbd8146810 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.473+0000 7ffbddaae640 1 --2- 172.21.15.28:0/726105189 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7ffbd80b8f30 0x7ffbd8143df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.473+0000 7ffbddaae640 1 -- 172.21.15.28:0/726105189 >> 172.21.15.28:0/726105189 conn(0x7ffbd80bcb40 msgr2=0x7ffbd80b6250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:40.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.477+0000 7ffbddaae640 1 -- 172.21.15.28:0/726105189 shutdown_connections 2023-11-28T19:32:40.479 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.477+0000 7ffbddaae640 1 -- 172.21.15.28:0/726105189 wait complete. 2023-11-28T19:32:40.797 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-11-28T19:32:22.871529+0000', 'modified': '2023-11-28T19:32:25.923656+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4914}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4914': {'gid': 4914, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.28:6834/1057392898', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.28:6832', 'nonce': 1057392898}, {'type': 'v1', 'addr': '172.21.15.28:6834', 'nonce': 1057392898}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-11-28T19:32:40.797 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-11-28T19:32:40.798 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-11-28T19:32:40.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.925+0000 7fa748665640 1 Processor -- start 2023-11-28T19:32:40.929 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.925+0000 7fa748665640 1 -- start start 2023-11-28T19:32:40.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.925+0000 7fa748665640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74006ab60 0x7fa74014b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa748665640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa7400bbad0 0x7fa7400a6040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa748665640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7400bce60 con 0x7fa74006af40 2023-11-28T19:32:40.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa748665640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7400bd5d0 con 0x7fa7400bbad0 2023-11-28T19:32:40.930 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa748665640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7400a6b70 con 0x7fa74006ab60 2023-11-28T19:32:40.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa746401640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74006ab60 0x7fa74014b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa745c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa7400bbad0 0x7fa7400a6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa746c02640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa74006af40 0x7fa74014eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.28:35702/0 (socket says 172.21.15.28:35702) 2023-11-28T19:32:40.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa745c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa7400bbad0 0x7fa7400a6040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.28:43904/0 (socket says 172.21.15.28:43904) 2023-11-28T19:32:40.931 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa746c02640 1 -- 172.21.15.28:0/1421620117 learned_addr learned my addr 172.21.15.28:0/1421620117 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:40.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa745c00640 1 -- 172.21.15.28:0/1421620117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74006ab60 msgr2=0x7fa74014b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:40.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa745c00640 1 --2- 172.21.15.28:0/1421620117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74006ab60 0x7fa74014b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa745c00640 1 -- 172.21.15.28:0/1421620117 >> v1:172.21.15.131:6789/0 conn(0x7fa74006af40 legacy=0x7fa74014eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa745c00640 1 -- 172.21.15.28:0/1421620117 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7400bff70 con 0x7fa7400bbad0 2023-11-28T19:32:40.932 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa746401640 1 --2- 172.21.15.28:0/1421620117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74006ab60 0x7fa74014b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-11-28T19:32:40.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa745c00640 1 --2- 172.21.15.28:0/1421620117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7400bbad0 0x7fa7400a6040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa7300097c0 tx=0x7fa73001c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=29a95c1c3517a220 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:40.933 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa7453ff640 1 -- 172.21.15.28:0/1421620117 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300ad660 con 0x7fa7400bbad0 2023-11-28T19:32:40.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa7453ff640 1 -- 172.21.15.28:0/1421620117 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7300ad7c0 con 0x7fa7400bbad0 2023-11-28T19:32:40.934 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.929+0000 7fa7453ff640 1 -- 172.21.15.28:0/1421620117 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300adb50 con 0x7fa7400bbad0 2023-11-28T19:32:40.935 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 -- 172.21.15.28:0/1421620117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7400bbad0 msgr2=0x7fa7400a6040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 --2- 172.21.15.28:0/1421620117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7400bbad0 0x7fa7400a6040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa7300097c0 tx=0x7fa73001c450 comp rx=0 tx=0).stop 2023-11-28T19:32:40.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 -- 172.21.15.28:0/1421620117 shutdown_connections 2023-11-28T19:32:40.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 --2- 172.21.15.28:0/1421620117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7400bbad0 0x7fa7400a6040 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 --2- 172.21.15.28:0/1421620117 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74006ab60 0x7fa74014b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 -- 172.21.15.28:0/1421620117 >> 172.21.15.28:0/1421620117 conn(0x7fa7400c0c90 msgr2=0x7fa7400c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:40.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 -- 172.21.15.28:0/1421620117 shutdown_connections 2023-11-28T19:32:40.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 -- 172.21.15.28:0/1421620117 wait complete. 2023-11-28T19:32:40.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 Processor -- start 2023-11-28T19:32:40.936 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 -- start start 2023-11-28T19:32:40.938 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74006ab60 0x7fa7401e41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74006af40 0x7fa74014b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.939 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7400bbad0 0x7fa7401499f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7401e4700 con 0x7fa74006ab60 2023-11-28T19:32:40.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74014b7b0 con 0x7fa7400bbad0 2023-11-28T19:32:40.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7401e5180 con 0x7fa74006af40 2023-11-28T19:32:40.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa746401640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74006ab60 0x7fa7401e41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa746401640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74006ab60 0x7fa7401e41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53132/0 (socket says 172.21.15.28:53132) 2023-11-28T19:32:40.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa746401640 1 -- 172.21.15.28:0/71973329 learned_addr learned my addr 172.21.15.28:0/71973329 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:40.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa745c00640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74006af40 0x7fa74014b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa746c02640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7400bbad0 0x7fa7401499f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.940 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa746401640 1 -- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74006af40 msgr2=0x7fa74014b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa746401640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74006af40 0x7fa74014b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa746401640 1 -- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7400bbad0 msgr2=0x7fa7401499f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa746401640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7400bbad0 0x7fa7401499f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa746401640 1 -- 172.21.15.28:0/71973329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c009420 con 0x7fa74006ab60 2023-11-28T19:32:40.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa746c02640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7400bbad0 0x7fa7401499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-11-28T19:32:40.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa746401640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74006ab60 0x7fa7401e41c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00ec10 tx=0x7fa73c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:40.941 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa736ffd640 1 -- 172.21.15.28:0/71973329 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c00cc30 con 0x7fa74006ab60 2023-11-28T19:32:40.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa736ffd640 1 -- 172.21.15.28:0/71973329 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c00cd90 con 0x7fa74006ab60 2023-11-28T19:32:40.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 -- 172.21.15.28:0/71973329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa730009420 con 0x7fa74006ab60 2023-11-28T19:32:40.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa736ffd640 1 -- 172.21.15.28:0/71973329 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c013690 con 0x7fa74006ab60 2023-11-28T19:32:40.942 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.933+0000 7fa748665640 1 -- 172.21.15.28:0/71973329 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7401e48e0 con 0x7fa74006ab60 2023-11-28T19:32:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa736ffd640 1 -- 172.21.15.28:0/71973329 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fa73c0137f0 con 0x7fa74006ab60 2023-11-28T19:32:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa736ffd640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa7240664a0 0x7fa724068960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa736ffd640 1 -- 172.21.15.28:0/71973329 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa73c084130 con 0x7fa74006ab60 2023-11-28T19:32:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa745c00640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa7240664a0 0x7fa724068960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa74b798000 1 Processor -- start 2023-11-28T19:32:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa74b798000 1 -- start start 2023-11-28T19:32:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa745c00640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa7240664a0 0x7fa724068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa7300af000 tx=0x7fa7300a7000 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa74b798000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb8350 0x5564aecb8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.949 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa74b798000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aecb30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa74b798000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb3630 0x5564aecb3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa74b798000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564aeae9130 con 0x5564aecb8c70 2023-11-28T19:32:40.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa74b798000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564aead69a0 con 0x5564aecb8350 2023-11-28T19:32:40.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa74b798000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564aead3ed0 con 0x5564aecb3630 2023-11-28T19:32:40.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa745c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aecb30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa745c00640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aecb30f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53144/0 (socket says 172.21.15.28:53144) 2023-11-28T19:32:40.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa745c00640 1 -- 172.21.15.28:0/1999181684 learned_addr learned my addr 172.21.15.28:0/1999181684 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:40.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa746401640 1 --2- 172.21.15.28:0/1999181684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb8350 0x5564aecb8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa746c02640 1 --2- 172.21.15.28:0/1999181684 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb3630 0x5564aecb3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa745c00640 1 -- 172.21.15.28:0/1999181684 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb3630 msgr2=0x5564aecb3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:40.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa745c00640 1 --2- 172.21.15.28:0/1999181684 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb3630 0x5564aecb3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa745c00640 1 -- 172.21.15.28:0/1999181684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb8350 msgr2=0x5564aecb8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:40.950 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa745c00640 1 --2- 172.21.15.28:0/1999181684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb8350 0x5564aecb8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.937+0000 7fa745c00640 1 -- 172.21.15.28:0/1999181684 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564ae7c7890 con 0x5564aecb8c70 2023-11-28T19:32:40.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa745c00640 1 --2- 172.21.15.28:0/1999181684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aecb30f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa730097e30 tx=0x7fa730004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9105f60ff8a7ffd server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:40.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa723fff640 1 -- 172.21.15.28:0/1999181684 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300b8ba0 con 0x5564aecb8c70 2023-11-28T19:32:40.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa723fff640 1 -- 172.21.15.28:0/1999181684 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7300b8d00 con 0x5564aecb8c70 2023-11-28T19:32:40.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa723fff640 1 -- 172.21.15.28:0/1999181684 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7300c3660 con 0x5564aecb8c70 2023-11-28T19:32:40.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 -- 172.21.15.28:0/1999181684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 msgr2=0x5564aecb30f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 --2- 172.21.15.28:0/1999181684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aecb30f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa730097e30 tx=0x7fa730004740 comp rx=0 tx=0).stop 2023-11-28T19:32:40.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 -- 172.21.15.28:0/1999181684 shutdown_connections 2023-11-28T19:32:40.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 --2- 172.21.15.28:0/1999181684 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb3630 0x5564aecb3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.951 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 --2- 172.21.15.28:0/1999181684 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aecb30f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 --2- 172.21.15.28:0/1999181684 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb8350 0x5564aecb8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 -- 172.21.15.28:0/1999181684 >> 172.21.15.28:0/1999181684 conn(0x5564aecaeea0 msgr2=0x5564aecb1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:40.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 -- 172.21.15.28:0/1999181684 shutdown_connections 2023-11-28T19:32:40.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 -- 172.21.15.28:0/1999181684 wait complete. 2023-11-28T19:32:40.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 -- start start 2023-11-28T19:32:40.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 Processor -- start 2023-11-28T19:32:40.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb3630 0x5564aec7ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb8350 0x5564aec7bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aec7c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564aeacf7c0 con 0x5564aecb8c70 2023-11-28T19:32:40.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564aea87bf0 con 0x5564aecb3630 2023-11-28T19:32:40.952 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564aea8da90 con 0x5564aecb8350 2023-11-28T19:32:40.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 10 client.0 _ll_register_callbacks cb 0x5564aec6a3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T19:32:40.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa746c02640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aec7c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa746c02640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aec7c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53150/0 (socket says 172.21.15.28:53150) 2023-11-28T19:32:40.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa746c02640 1 -- 172.21.15.28:0/3311453922 learned_addr learned my addr 172.21.15.28:0/3311453922 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:40.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa746401640 1 --2- 172.21.15.28:0/3311453922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb3630 0x5564aec7ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa745c00640 1 --2- 172.21.15.28:0/3311453922 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb8350 0x5564aec7bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa746c02640 1 -- 172.21.15.28:0/3311453922 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb8350 msgr2=0x5564aec7bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:40.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa746c02640 1 --2- 172.21.15.28:0/3311453922 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb8350 0x5564aec7bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.953 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa746c02640 1 -- 172.21.15.28:0/3311453922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb3630 msgr2=0x5564aec7ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:40.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa746c02640 1 --2- 172.21.15.28:0/3311453922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb3630 0x5564aec7ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa746c02640 1 -- 172.21.15.28:0/3311453922 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7400bff70 con 0x5564aecb8c70 2023-11-28T19:32:40.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa746401640 1 --2- 172.21.15.28:0/3311453922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb3630 0x5564aec7ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:40.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa746c02640 1 --2- 172.21.15.28:0/3311453922 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aec7c510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa738007670 tx=0x7fa738007b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ad6afcafe3db16 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:40.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa7217fa640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-11-28T19:32:40.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa7217fa640 1 -- 172.21.15.28:0/3311453922 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa738010af0 con 0x5564aecb8c70 2023-11-28T19:32:40.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa7217fa640 1 -- 172.21.15.28:0/3311453922 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa738010c50 con 0x5564aecb8c70 2023-11-28T19:32:40.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 -- 172.21.15.28:0/3311453922 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564aea91470 con 0x5564aecb8c70 2023-11-28T19:32:40.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa7217fa640 1 -- 172.21.15.28:0/3311453922 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa738010e10 con 0x5564aecb8c70 2023-11-28T19:32:40.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 10 client.5103 fetch_fsmap learned FSMap version 16 2023-11-28T19:32:40.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 -- 172.21.15.28:0/3311453922 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5564aea90190 con 0x5564aecb8c70 2023-11-28T19:32:40.954 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa7217fa640 1 -- 172.21.15.28:0/3311453922 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5564aea91470 con 0x5564aecb8c70 2023-11-28T19:32:40.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa7217fa640 1 -- 172.21.15.28:0/3311453922 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 16) v1 ==== 2719+0+0 (secure 0 0 0) 0x7fa73801c3a0 con 0x5564aecb8c70 2023-11-28T19:32:40.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 10 client.5103 fetch_fsmap finished waiting for FSMap version 16 2023-11-28T19:32:40.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 10 client.5103 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T19:32:40.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 20 client.5103 populate_metadata read hostname 'smithi028' 2023-11-28T19:32:40.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 --2- 172.21.15.28:0/3311453922 >> [v2:172.21.15.28:6832/1057392898,v1:172.21.15.28:6834/1057392898] conn(0x5564aecc73e0 0x5564aecc97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 4 client.5103 mds_command: new command op to 4914 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-11-28T19:32:40.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa74b798000 1 -- 172.21.15.28:0/3311453922 --> [v2:172.21.15.28:6832/1057392898,v1:172.21.15.28:6834/1057392898] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5564aea94b50 con 0x5564aecc73e0 2023-11-28T19:32:40.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.941+0000 7fa746401640 1 --2- 172.21.15.28:0/3311453922 >> [v2:172.21.15.28:6832/1057392898,v1:172.21.15.28:6834/1057392898] conn(0x5564aecc73e0 0x5564aecc97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa746401640 1 --2- 172.21.15.28:0/3311453922 >> [v2:172.21.15.28:6832/1057392898,v1:172.21.15.28:6834/1057392898] conn(0x5564aecc73e0 0x5564aecc97d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6bc7d36c68f559aa server_cookie=7282164eab065be4 in_seq=0 out_seq=0 2023-11-28T19:32:40.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa7217fa640 10 client.5103 ms_handle_connect on v2:172.21.15.28:6832/1057392898 2023-11-28T19:32:40.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa7217fa640 1 -- 172.21.15.28:0/3311453922 <== mds.0 v2:172.21.15.28:6832/1057392898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x5564aea94b50 con 0x5564aecc73e0 2023-11-28T19:32:40.955 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa7217fa640 10 client.5103 handle_command_reply: tid=0 2023-11-28T19:32:40.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa74b798000 1 client.5103 shutdown 2023-11-28T19:32:40.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa74b798000 1 -- 172.21.15.28:0/3311453922 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 msgr2=0x5564aec7c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa74b798000 1 --2- 172.21.15.28:0/3311453922 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aec7c510 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa738007670 tx=0x7fa738007b30 comp rx=0 tx=0).stop 2023-11-28T19:32:40.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa74b798000 1 -- 172.21.15.28:0/3311453922 shutdown_connections 2023-11-28T19:32:40.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa74b798000 1 --2- 172.21.15.28:0/3311453922 >> [v2:172.21.15.28:6832/1057392898,v1:172.21.15.28:6834/1057392898] conn(0x5564aecc73e0 0x5564aecc97d0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa74b798000 1 --2- 172.21.15.28:0/3311453922 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aec7c510 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa74b798000 1 --2- 172.21.15.28:0/3311453922 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb8350 0x5564aec7bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa74b798000 1 --2- 172.21.15.28:0/3311453922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb3630 0x5564aec7ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa7217fa640 0 client.5103 ms_handle_reset on v2:172.21.15.28:6832/1057392898 2023-11-28T19:32:40.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa74b798000 1 -- 172.21.15.28:0/3311453922 >> 172.21.15.28:0/3311453922 conn(0x5564aecaeea0 msgr2=0x5564aecb1290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:40.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa74b798000 1 -- 172.21.15.28:0/3311453922 shutdown_connections 2023-11-28T19:32:40.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa74b798000 1 -- 172.21.15.28:0/3311453922 wait complete. 2023-11-28T19:32:40.956 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.945+0000 7fa74b798000 20 client.5103 trim_cache size 0 max 16384 2023-11-28T19:32:40.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 Processor -- start 2023-11-28T19:32:40.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 -- start start 2023-11-28T19:32:40.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb3630 0x5564aed155f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb8350 0x5564aed17b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb8c70 0x5564aed1a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564ae788940 con 0x5564aecb3630 2023-11-28T19:32:40.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564aead2320 con 0x5564aecb8c70 2023-11-28T19:32:40.969 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564aea84760 con 0x5564aecb8350 2023-11-28T19:32:40.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa746401640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb3630 0x5564aed155f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa746401640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb3630 0x5564aed155f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53160/0 (socket says 172.21.15.28:53160) 2023-11-28T19:32:40.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa746401640 1 -- 172.21.15.28:0/189712827 learned_addr learned my addr 172.21.15.28:0/189712827 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:40.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa746401640 1 -- 172.21.15.28:0/189712827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb8350 msgr2=0x5564aed17b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:40.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa746401640 1 --2- 172.21.15.28:0/189712827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb8350 0x5564aed17b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa746401640 1 -- 172.21.15.28:0/189712827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb8c70 msgr2=0x5564aed1a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:40.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa746401640 1 --2- 172.21.15.28:0/189712827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb8c70 0x5564aed1a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa746401640 1 -- 172.21.15.28:0/189712827 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564aea76490 con 0x5564aecb3630 2023-11-28T19:32:40.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa746401640 1 --2- 172.21.15.28:0/189712827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb3630 0x5564aed155f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0551c0 tx=0x7fa73c082490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c28cd1a24c0481c server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:40.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa734ff9640 1 -- 172.21.15.28:0/189712827 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c059320 con 0x5564aecb3630 2023-11-28T19:32:40.970 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa734ff9640 1 -- 172.21.15.28:0/189712827 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c05d4d0 con 0x5564aecb3630 2023-11-28T19:32:40.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa734ff9640 1 -- 172.21.15.28:0/189712827 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c053620 con 0x5564aecb3630 2023-11-28T19:32:40.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 -- 172.21.15.28:0/189712827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb3630 msgr2=0x5564aed155f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 --2- 172.21.15.28:0/189712827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb3630 0x5564aed155f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa73c0551c0 tx=0x7fa73c082490 comp rx=0 tx=0).stop 2023-11-28T19:32:40.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 -- 172.21.15.28:0/189712827 shutdown_connections 2023-11-28T19:32:40.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 --2- 172.21.15.28:0/189712827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb8c70 0x5564aed1a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 --2- 172.21.15.28:0/189712827 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb8350 0x5564aed17b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 --2- 172.21.15.28:0/189712827 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb3630 0x5564aed155f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 -- 172.21.15.28:0/189712827 >> 172.21.15.28:0/189712827 conn(0x5564aecaeea0 msgr2=0x5564aec832e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:40.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 -- 172.21.15.28:0/189712827 shutdown_connections 2023-11-28T19:32:40.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 -- 172.21.15.28:0/189712827 wait complete. 2023-11-28T19:32:40.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 -- start start 2023-11-28T19:32:40.971 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 Processor -- start 2023-11-28T19:32:40.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb3630 0x5564aece55f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb8350 0x5564aece5b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aece6070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564aeace650 con 0x5564aecb8c70 2023-11-28T19:32:40.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564aeb11140 con 0x5564aecb8350 2023-11-28T19:32:40.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x5564aeacb130 con 0x5564aecb3630 2023-11-28T19:32:40.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.961+0000 7fa74b798000 10 client.0 _ll_register_callbacks cb 0x5564aea536e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-11-28T19:32:40.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa746c02640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aece6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.972 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa746c02640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aece6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53162/0 (socket says 172.21.15.28:53162) 2023-11-28T19:32:40.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa746c02640 1 -- 172.21.15.28:0/2702940947 learned_addr learned my addr 172.21.15.28:0/2702940947 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:40.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa746401640 1 --2- 172.21.15.28:0/2702940947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb3630 0x5564aece55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa745c00640 1 --2- 172.21.15.28:0/2702940947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb8350 0x5564aece5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa746c02640 1 -- 172.21.15.28:0/2702940947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb3630 msgr2=0x5564aece55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:40.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa746c02640 1 --2- 172.21.15.28:0/2702940947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb3630 0x5564aece55f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa746c02640 1 -- 172.21.15.28:0/2702940947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb8350 msgr2=0x5564aece5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:40.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa746c02640 1 --2- 172.21.15.28:0/2702940947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb8350 0x5564aece5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa746c02640 1 -- 172.21.15.28:0/2702940947 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7401e48e0 con 0x5564aecb8c70 2023-11-28T19:32:40.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa746c02640 1 --2- 172.21.15.28:0/2702940947 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aece6070 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa738007600 tx=0x7fa738001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c223c9a7ee8c588b server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:40.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa7217fa640 10 client.0 ms_handle_connect on v2:172.21.15.28:3300/0 2023-11-28T19:32:40.973 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa7217fa640 1 -- 172.21.15.28:0/2702940947 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7380105b0 con 0x5564aecb8c70 2023-11-28T19:32:40.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa7217fa640 1 -- 172.21.15.28:0/2702940947 <== mon.0 v2:172.21.15.28:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa738010d00 con 0x5564aecb8c70 2023-11-28T19:32:40.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 -- 172.21.15.28:0/2702940947 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564aeace110 con 0x5564aecb8c70 2023-11-28T19:32:40.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa7217fa640 1 -- 172.21.15.28:0/2702940947 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa738010ec0 con 0x5564aecb8c70 2023-11-28T19:32:40.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 10 client.5109 fetch_fsmap learned FSMap version 16 2023-11-28T19:32:40.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 -- 172.21.15.28:0/2702940947 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x5564ae7c7cc0 con 0x5564aecb8c70 2023-11-28T19:32:40.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa7217fa640 1 -- 172.21.15.28:0/2702940947 <== mon.0 v2:172.21.15.28:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5564aeace110 con 0x5564aecb8c70 2023-11-28T19:32:40.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa7217fa640 1 -- 172.21.15.28:0/2702940947 <== mon.0 v2:172.21.15.28:3300/0 5 ==== fsmap(e 16) v1 ==== 2719+0+0 (secure 0 0 0) 0x7fa73801c860 con 0x5564aecb8c70 2023-11-28T19:32:40.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 10 client.5109 fetch_fsmap finished waiting for FSMap version 16 2023-11-28T19:32:40.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 10 client.5109 resolve_mds: resolved name 'a' to daemon mds.a 2023-11-28T19:32:40.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 20 client.5109 populate_metadata read hostname 'smithi028' 2023-11-28T19:32:40.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 --2- 172.21.15.28:0/2702940947 >> [v2:172.21.15.28:6832/1057392898,v1:172.21.15.28:6834/1057392898] conn(0x5564aece65b0 0x5564aece6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:40.974 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 4 client.5109 mds_command: new command op to 4914 tid=0 multi_id=0 [{"prefix": "status"}] 2023-11-28T19:32:40.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 -- 172.21.15.28:0/2702940947 --> [v2:172.21.15.28:6832/1057392898,v1:172.21.15.28:6834/1057392898] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5564aeafd9a0 con 0x5564aece65b0 2023-11-28T19:32:40.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa746401640 1 --2- 172.21.15.28:0/2702940947 >> [v2:172.21.15.28:6832/1057392898,v1:172.21.15.28:6834/1057392898] conn(0x5564aece65b0 0x5564aece6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:40.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa7217fa640 10 client.5109 ms_handle_connect on v2:172.21.15.28:6832/1057392898 2023-11-28T19:32:40.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa746401640 1 --2- 172.21.15.28:0/2702940947 >> [v2:172.21.15.28:6832/1057392898,v1:172.21.15.28:6834/1057392898] conn(0x5564aece65b0 0x5564aece6990 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d084895218be856 server_cookie=21b038026999dc6e in_seq=0 out_seq=0 2023-11-28T19:32:40.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa7217fa640 1 -- 172.21.15.28:0/2702940947 <== mds.0 v2:172.21.15.28:6832/1057392898 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5564aeafd9a0 con 0x5564aece65b0 2023-11-28T19:32:40.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa7217fa640 10 client.5109 handle_command_reply: tid=0 2023-11-28T19:32:40.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 client.5109 shutdown 2023-11-28T19:32:40.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 -- 172.21.15.28:0/2702940947 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 msgr2=0x5564aece6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 --2- 172.21.15.28:0/2702940947 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aece6070 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa738007600 tx=0x7fa738001260 comp rx=0 tx=0).stop 2023-11-28T19:32:40.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 -- 172.21.15.28:0/2702940947 shutdown_connections 2023-11-28T19:32:40.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 --2- 172.21.15.28:0/2702940947 >> [v2:172.21.15.28:6832/1057392898,v1:172.21.15.28:6834/1057392898] conn(0x5564aece65b0 0x5564aece6990 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.975 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 --2- 172.21.15.28:0/2702940947 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x5564aecb8c70 0x5564aece6070 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 --2- 172.21.15.28:0/2702940947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x5564aecb8350 0x5564aece5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa7217fa640 0 client.5109 ms_handle_reset on v2:172.21.15.28:6832/1057392898 2023-11-28T19:32:40.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 --2- 172.21.15.28:0/2702940947 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x5564aecb3630 0x5564aece55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 -- 172.21.15.28:0/2702940947 >> 172.21.15.28:0/2702940947 conn(0x5564aecaeea0 msgr2=0x5564aec83b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:40.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 -- 172.21.15.28:0/2702940947 shutdown_connections 2023-11-28T19:32:40.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 1 -- 172.21.15.28:0/2702940947 wait complete. 2023-11-28T19:32:40.976 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa74b798000 20 client.5109 trim_cache size 0 max 16384 2023-11-28T19:32:40.976 INFO:teuthology.orchestra.run.smithi028.stdout:{ 2023-11-28T19:32:40.976 INFO:teuthology.orchestra.run.smithi028.stdout: "cluster_fsid": "ae116b99-23bb-451b-9ddc-fdb049a33145", 2023-11-28T19:32:40.977 INFO:teuthology.orchestra.run.smithi028.stdout: "whoami": 0, 2023-11-28T19:32:40.977 INFO:teuthology.orchestra.run.smithi028.stdout: "id": 4914, 2023-11-28T19:32:40.977 INFO:teuthology.orchestra.run.smithi028.stdout: "want_state": "up:active", 2023-11-28T19:32:40.977 INFO:teuthology.orchestra.run.smithi028.stdout: "state": "up:active", 2023-11-28T19:32:40.977 INFO:teuthology.orchestra.run.smithi028.stdout: "fs_name": "cephfs", 2023-11-28T19:32:40.977 INFO:teuthology.orchestra.run.smithi028.stdout: "rank_uptime": 17.415511625000001, 2023-11-28T19:32:40.977 INFO:teuthology.orchestra.run.smithi028.stdout: "mdsmap_epoch": 16, 2023-11-28T19:32:40.977 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch": 32, 2023-11-28T19:32:40.977 INFO:teuthology.orchestra.run.smithi028.stdout: "osdmap_epoch_barrier": 32, 2023-11-28T19:32:40.977 INFO:teuthology.orchestra.run.smithi028.stdout: "uptime": 25.365219309 2023-11-28T19:32:40.977 INFO:teuthology.orchestra.run.smithi028.stdout:} 2023-11-28T19:32:40.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa748665640 1 -- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa7240664a0 msgr2=0x7fa724068960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa748665640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa7240664a0 0x7fa724068960 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fa7300af000 tx=0x7fa7300a7000 comp rx=0 tx=0).stop 2023-11-28T19:32:40.978 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa748665640 1 -- 172.21.15.28:0/71973329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74006ab60 msgr2=0x7fa7401e41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:40.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa748665640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74006ab60 0x7fa7401e41c0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa73c00ec10 tx=0x7fa73c00c520 comp rx=0 tx=0).stop 2023-11-28T19:32:40.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa748665640 1 -- 172.21.15.28:0/71973329 shutdown_connections 2023-11-28T19:32:40.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa748665640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fa7240664a0 0x7fa724068960 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa748665640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa7400bbad0 0x7fa7401499f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa748665640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fa74006af40 0x7fa74014b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa748665640 1 --2- 172.21.15.28:0/71973329 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fa74006ab60 0x7fa7401e41c0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:40.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa748665640 1 -- 172.21.15.28:0/71973329 >> 172.21.15.28:0/71973329 conn(0x7fa7400c0c90 msgr2=0x7fa7400a07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:40.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa748665640 1 -- 172.21.15.28:0/71973329 shutdown_connections 2023-11-28T19:32:40.979 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:40.965+0000 7fa748665640 1 -- 172.21.15.28:0/71973329 wait complete. 2023-11-28T19:32:40.985 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-11-28T19:32:41.097 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.093+0000 7fb234361640 1 Processor -- start 2023-11-28T19:32:41.098 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.093+0000 7fb234361640 1 -- start start 2023-11-28T19:32:41.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb234361640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb22c142560 0x7fb22c0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:41.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb234361640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb22c0b4610 0x7fb22c0b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:41.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb234361640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb22c0b4aa0 con 0x7fb22c0b5dd0 2023-11-28T19:32:41.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb234361640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb22c06f950 con 0x7fb22c142560 2023-11-28T19:32:41.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb234361640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c0b70c0 con 0x7fb22c0b4610 2023-11-28T19:32:41.100 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2318fc640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7fb22c0b5dd0 0x7fb22c0b6470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:48484/0 (socket says 172.21.15.28:48484) 2023-11-28T19:32:41.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2318fc640 1 -- 172.21.15.28:0/1601939368 learned_addr learned my addr 172.21.15.28:0/1601939368 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:32:41.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2320fd640 1 --2- 172.21.15.28:0/1601939368 >> v2:172.21.15.131:3300/0 conn(0x7fb22c142560 0x7fb22c0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:41.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2328fe640 1 --2- 172.21.15.28:0/1601939368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb22c0b4610 0x7fb22c0b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:41.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 -- 172.21.15.28:0/1601939368 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138823555 0 0) 0x7fb22c0b4aa0 con 0x7fb22c0b5dd0 2023-11-28T19:32:41.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 -- 172.21.15.28:0/1601939368 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb214003530 con 0x7fb22c0b5dd0 2023-11-28T19:32:41.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 -- 172.21.15.28:0/1601939368 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1792566524 0 0) 0x7fb214003530 con 0x7fb22c0b5dd0 2023-11-28T19:32:41.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 -- 172.21.15.28:0/1601939368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb22c0b4610 msgr2=0x7fb22c0b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:41.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 --2- 172.21.15.28:0/1601939368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb22c0b4610 0x7fb22c0b6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:41.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 -- 172.21.15.28:0/1601939368 >> v2:172.21.15.131:3300/0 conn(0x7fb22c142560 msgr2=0x7fb22c0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:41.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 --2- 172.21.15.28:0/1601939368 >> v2:172.21.15.131:3300/0 conn(0x7fb22c142560 0x7fb22c0b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:41.101 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 -- 172.21.15.28:0/1601939368 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c142940 con 0x7fb22c0b5dd0 2023-11-28T19:32:41.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 -- 172.21.15.28:0/1601939368 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7fb220001680 con 0x7fb22c0b5dd0 2023-11-28T19:32:41.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 -- 172.21.15.28:0/1601939368 >> v1:172.21.15.28:6789/0 conn(0x7fb22c0b5dd0 legacy=0x7fb22c0b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:41.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 --2- 172.21.15.28:0/1601939368 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb214003980 0x7fb214003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:41.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 --2- 172.21.15.28:0/1601939368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2140047d0 0x7fb214004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:41.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 --2- 172.21.15.28:0/1601939368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb22c0b4610 0x7fb214005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:41.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 -- 172.21.15.28:0/1601939368 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c06f950 con 0x7fb214003980 2023-11-28T19:32:41.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 -- 172.21.15.28:0/1601939368 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c0b70c0 con 0x7fb2140047d0 2023-11-28T19:32:41.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2310fb640 1 -- 172.21.15.28:0/1601939368 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb21400b990 con 0x7fb22c0b4610 2023-11-28T19:32:41.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2320fd640 1 --2- 172.21.15.28:0/1601939368 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb214003980 0x7fb214003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:41.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2318fc640 1 --2- 172.21.15.28:0/1601939368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2140047d0 0x7fb214004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:41.102 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2320fd640 1 -- 172.21.15.28:0/1601939368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb22c0b4610 msgr2=0x7fb214005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:41.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2320fd640 1 --2- 172.21.15.28:0/1601939368 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb22c0b4610 0x7fb214005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:41.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2320fd640 1 -- 172.21.15.28:0/1601939368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2140047d0 msgr2=0x7fb214004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:32:41.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2320fd640 1 --2- 172.21.15.28:0/1601939368 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb2140047d0 0x7fb214004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:41.103 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.097+0000 7fb2320fd640 1 -- 172.21.15.28:0/1601939368 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb214003530 con 0x7fb214003980 2023-11-28T19:32:41.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2320fd640 1 --2- 172.21.15.28:0/1601939368 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb214003980 0x7fb214003da0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009ae0 tx=0x7fb21c01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9774c25787355ab1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:41.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2310fb640 1 -- 172.21.15.28:0/1601939368 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0a55a0 con 0x7fb214003980 2023-11-28T19:32:41.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2310fb640 1 -- 172.21.15.28:0/1601939368 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c0a5700 con 0x7fb214003980 2023-11-28T19:32:41.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2310fb640 1 -- 172.21.15.28:0/1601939368 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0a58b0 con 0x7fb214003980 2023-11-28T19:32:41.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 -- 172.21.15.28:0/1601939368 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb214003980 msgr2=0x7fb214003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:41.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 --2- 172.21.15.28:0/1601939368 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb214003980 0x7fb214003da0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009ae0 tx=0x7fb21c01ca90 comp rx=0 tx=0).stop 2023-11-28T19:32:41.104 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2328fe640 1 -- 172.21.15.28:0/1601939368 reap_dead start 2023-11-28T19:32:41.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 -- 172.21.15.28:0/1601939368 shutdown_connections 2023-11-28T19:32:41.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 -- 172.21.15.28:0/1601939368 >> 172.21.15.28:0/1601939368 conn(0x7fb22c0bcb40 msgr2=0x7fb22c0bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:41.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 -- 172.21.15.28:0/1601939368 shutdown_connections 2023-11-28T19:32:41.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 -- 172.21.15.28:0/1601939368 wait complete. 2023-11-28T19:32:41.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 Processor -- start 2023-11-28T19:32:41.105 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 -- start start 2023-11-28T19:32:41.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb214003980 0x7fb22c139f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:41.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb22c1e2120 0x7fb22c149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:41.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb22c0b7dd0 0x7fb22c0b8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:41.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c14a080 con 0x7fb214003980 2023-11-28T19:32:41.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c14afd0 con 0x7fb22c0b7dd0 2023-11-28T19:32:41.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22c142d00 con 0x7fb22c1e2120 2023-11-28T19:32:41.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2320fd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb214003980 0x7fb22c139f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:41.107 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2320fd640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb214003980 0x7fb22c139f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:53180/0 (socket says 172.21.15.28:53180) 2023-11-28T19:32:41.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2320fd640 1 -- 172.21.15.28:0/3829687602 learned_addr learned my addr 172.21.15.28:0/3829687602 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:32:41.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2328fe640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb22c0b7dd0 0x7fb22c0b8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:41.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2318fc640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb22c1e2120 0x7fb22c149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:41.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2320fd640 1 -- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb22c1e2120 msgr2=0x7fb22c149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:41.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2320fd640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb22c1e2120 0x7fb22c149b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:41.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2320fd640 1 -- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb22c0b7dd0 msgr2=0x7fb22c0b8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:41.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2320fd640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb22c0b7dd0 0x7fb22c0b8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:41.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2320fd640 1 -- 172.21.15.28:0/3829687602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22c1440c0 con 0x7fb214003980 2023-11-28T19:32:41.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2328fe640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb22c0b7dd0 0x7fb22c0b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:32:41.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb2320fd640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb214003980 0x7fb22c139f30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009ae0 tx=0x7fb214005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:41.108 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb22affd640 1 -- 172.21.15.28:0/3829687602 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c0be070 con 0x7fb214003980 2023-11-28T19:32:41.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb22affd640 1 -- 172.21.15.28:0/3829687602 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c0a5e70 con 0x7fb214003980 2023-11-28T19:32:41.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 -- 172.21.15.28:0/3829687602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22c14aac0 con 0x7fb214003980 2023-11-28T19:32:41.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb22affd640 1 -- 172.21.15.28:0/3829687602 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c004220 con 0x7fb214003980 2023-11-28T19:32:41.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.101+0000 7fb234361640 1 -- 172.21.15.28:0/3829687602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22c149370 con 0x7fb214003980 2023-11-28T19:32:41.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.105+0000 7fb234361640 1 -- 172.21.15.28:0/3829687602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22c13a470 con 0x7fb214003980 2023-11-28T19:32:41.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.105+0000 7fb22affd640 1 -- 172.21.15.28:0/3829687602 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7fb21c0b4040 con 0x7fb214003980 2023-11-28T19:32:41.109 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.105+0000 7fb22affd640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb218066470 0x7fb218068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:32:41.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.105+0000 7fb22affd640 1 -- 172.21.15.28:0/3829687602 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb21c11d850 con 0x7fb214003980 2023-11-28T19:32:41.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.105+0000 7fb2318fc640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb218066470 0x7fb218068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:32:41.110 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.105+0000 7fb2318fc640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb218066470 0x7fb218068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb2200017b0 tx=0x7fb220001860 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:32:41.112 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.109+0000 7fb22affd640 1 -- 172.21.15.28:0/3829687602 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7fb21c0ead60 con 0x7fb214003980 2023-11-28T19:32:41.301 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.297+0000 7fb234361640 1 -- 172.21.15.28:0/3829687602 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb22c142e90 con 0x7fb214003980 2023-11-28T19:32:41.302 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.301+0000 7fb22affd640 1 -- 172.21.15.28:0/3829687602 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb21c0ee380 con 0x7fb214003980 2023-11-28T19:32:41.302 INFO:teuthology.orchestra.run.smithi028.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-11-28T19:32:41.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.301+0000 7fb234361640 1 -- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb218066470 msgr2=0x7fb218068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:41.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.301+0000 7fb234361640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb218066470 0x7fb218068930 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb2200017b0 tx=0x7fb220001860 comp rx=0 tx=0).stop 2023-11-28T19:32:41.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.301+0000 7fb234361640 1 -- 172.21.15.28:0/3829687602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb214003980 msgr2=0x7fb22c139f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:32:41.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.301+0000 7fb234361640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb214003980 0x7fb22c139f30 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fb21c009ae0 tx=0x7fb214005800 comp rx=0 tx=0).stop 2023-11-28T19:32:41.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.301+0000 7fb234361640 1 -- 172.21.15.28:0/3829687602 shutdown_connections 2023-11-28T19:32:41.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.301+0000 7fb234361640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7fb218066470 0x7fb218068930 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:41.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.301+0000 7fb234361640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb22c0b7dd0 0x7fb22c0b8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:41.305 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.301+0000 7fb234361640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7fb22c1e2120 0x7fb22c149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:41.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.301+0000 7fb234361640 1 --2- 172.21.15.28:0/3829687602 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7fb214003980 0x7fb22c139f30 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:32:41.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.301+0000 7fb234361640 1 -- 172.21.15.28:0/3829687602 >> 172.21.15.28:0/3829687602 conn(0x7fb22c0bcb40 msgr2=0x7fb22c13ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:32:41.306 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.301+0000 7fb234361640 1 -- 172.21.15.28:0/3829687602 shutdown_connections 2023-11-28T19:32:41.307 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:32:41.301+0000 7fb234361640 1 -- 172.21.15.28:0/3829687602 wait complete. 2023-11-28T19:32:41.319 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-11-28T19:32:41.320 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-11-28T19:32:41.320 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi203.front.sepia.ceph.com 2023-11-28T19:32:41.320 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-11-28T19:32:41.320 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-11-28T19:32:41.320 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-11-28T19:32:41.320 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-11-28T19:32:41.321 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-11-28T19:32:41.321 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T19:32:41.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:41.321 DEBUG:teuthology.orchestra.run.smithi203:> ip addr 2023-11-28T19:32:41.333 INFO:teuthology.orchestra.run.smithi203.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-11-28T19:32:41.334 INFO:teuthology.orchestra.run.smithi203.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-11-28T19:32:41.334 INFO:teuthology.orchestra.run.smithi203.stdout: inet 127.0.0.1/8 scope host lo 2023-11-28T19:32:41.334 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:32:41.334 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 ::1/128 scope host 2023-11-28T19:32:41.334 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:32:41.335 INFO:teuthology.orchestra.run.smithi203.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:32:41.335 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:44 brd ff:ff:ff:ff:ff:ff 2023-11-28T19:32:41.335 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f0 2023-11-28T19:32:41.335 INFO:teuthology.orchestra.run.smithi203.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:32:41.336 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:d9:19:45 brd ff:ff:ff:ff:ff:ff 2023-11-28T19:32:41.336 INFO:teuthology.orchestra.run.smithi203.stdout: altname enp7s0f1 2023-11-28T19:32:41.336 INFO:teuthology.orchestra.run.smithi203.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-11-28T19:32:41.336 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:22 brd ff:ff:ff:ff:ff:ff 2023-11-28T19:32:41.336 INFO:teuthology.orchestra.run.smithi203.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-11-28T19:32:41.336 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0c:c4:7a:8f:4a:23 brd ff:ff:ff:ff:ff:ff 2023-11-28T19:32:41.337 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.21.15.203/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-11-28T19:32:41.337 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft 42320sec preferred_lft 42320sec 2023-11-28T19:32:41.337 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::ec4:7aff:fe8f:4a23/64 scope link 2023-11-28T19:32:41.337 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:32:41.337 INFO:teuthology.orchestra.run.smithi203.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-11-28T19:32:41.337 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 02:42:af:f6:0d:0f brd ff:ff:ff:ff:ff:ff 2023-11-28T19:32:41.337 INFO:teuthology.orchestra.run.smithi203.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-11-28T19:32:41.337 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:32:41.337 INFO:teuthology.orchestra.run.smithi203.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-11-28T19:32:41.337 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-11-28T19:32:41.337 INFO:teuthology.orchestra.run.smithi203.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-11-28T19:32:41.337 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:32:41.338 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-11-28T19:32:41.338 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:32:41.338 INFO:teuthology.orchestra.run.smithi203.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-11-28T19:32:41.338 INFO:teuthology.orchestra.run.smithi203.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-11-28T19:32:41.338 INFO:teuthology.orchestra.run.smithi203.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-11-28T19:32:41.338 INFO:teuthology.orchestra.run.smithi203.stdout: valid_lft forever preferred_lft forever 2023-11-28T19:32:41.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:41.339 DEBUG:teuthology.orchestra.run.smithi203:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-11-28T19:32:41.396 INFO:teuthology.orchestra.run.smithi203.stdout:1 2023-11-28T19:32:41.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:41.399 DEBUG:teuthology.orchestra.run.smithi203:> route 2023-11-28T19:32:41.451 INFO:teuthology.orchestra.run.smithi203.stdout:Kernel IP routing table 2023-11-28T19:32:41.451 INFO:teuthology.orchestra.run.smithi203.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-11-28T19:32:41.451 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-11-28T19:32:41.451 INFO:teuthology.orchestra.run.smithi203.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-11-28T19:32:41.451 INFO:teuthology.orchestra.run.smithi203.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-11-28T19:32:41.451 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-11-28T19:32:41.451 INFO:teuthology.orchestra.run.smithi203.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:32:41.451 INFO:teuthology.orchestra.run.smithi203.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:32:41.452 INFO:teuthology.orchestra.run.smithi203.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-11-28T19:32:41.452 INFO:teuthology.orchestra.run.smithi203.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-11-28T19:32:41.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:41.452 DEBUG:teuthology.orchestra.run.smithi203:> (cd / && exec bash -c ' 2023-11-28T19:32:41.452 DEBUG:teuthology.orchestra.run.smithi203:> set -e 2023-11-28T19:32:41.452 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-11-28T19:32:41.452 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-11-28T19:32:41.452 DEBUG:teuthology.orchestra.run.smithi203:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-11-28T19:32:41.452 DEBUG:teuthology.orchestra.run.smithi203:> ') 2023-11-28T19:32:41.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:41.547 DEBUG:teuthology.orchestra.run.smithi203:> ip netns list 2023-11-28T19:32:41.557 INFO:teuthology.orchestra.run.smithi203.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-11-28T19:32:41.557 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-11-28T19:32:41.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:41.557 DEBUG:teuthology.orchestra.run.smithi203:> sudo ip link set brx.0 up 2023-11-28T19:32:41.621 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T19:32:41.621 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-11-28T19:32:41.673 INFO:teuthology.orchestra.run.smithi203.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-11-28T19:32:41.673 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-11-28T19:32:41.674 DEBUG:teuthology.orchestra.run.smithi203:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-11-28T19:32:41.723 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-11-28T19:32:41.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:41.724 DEBUG:teuthology.orchestra.run.smithi203:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T19:32:41.817 INFO:teuthology.orchestra.run.smithi203.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T19:32:41.817 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T19:32:41.835 INFO:teuthology.orchestra.run.smithi203.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-11-28T19:32:41.836 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-11-28T19:32:41.836 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: resolved to: "172.21.15.28:3300,172.21.15.131:3300,172.21.15.131:3301" 2023-11-28T19:32:41.836 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: trying mount with new device syntax: 0@ae116b99-23bb-451b-9ddc-fdb049a33145.cephfs=/ 2023-11-28T19:32:41.836 INFO:teuthology.orchestra.run.smithi203.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.28:3300/172.21.15.131:3300/172.21.15.131:3301" will pass to kernel 2023-11-28T19:32:41.839 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-11-28T19:32:41.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:41.840 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-11-28T19:32:41.861 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:41.861 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-11-28T19:32:41.929 INFO:teuthology.orchestra.run.smithi203.stdout:client4813 2023-11-28T19:32:41.929 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:32:41.930 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/proc/self/mounts of=/dev/stdout 2023-11-28T19:32:41.980 DEBUG:teuthology.orchestra.run.smithi203:> mktemp -d --suffix=xfstests-dev 2023-11-28T19:32:42.031 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.N8wkfFNIvbxfstests-dev 2023-11-28T19:32:42.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:42.032 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.N8wkfFNIvbxfstests-dev) 2023-11-28T19:32:42.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:42.102 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.N8wkfFNIvbxfstests-dev) 2023-11-28T19:32:42.168 INFO:teuthology.orchestra.run.smithi203.stderr:Cloning into '/tmp/tmp.N8wkfFNIvbxfstests-dev'... 2023-11-28T19:32:43.022 DEBUG:teuthology.orchestra.run.smithi203:> mktemp -d --suffix=xfsprogs-dev 2023-11-28T19:32:43.076 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.eVcldRLPeyxfsprogs-dev 2023-11-28T19:32:43.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:43.076 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.eVcldRLPeyxfsprogs-dev) 2023-11-28T19:32:43.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:43.144 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.eVcldRLPeyxfsprogs-dev) 2023-11-28T19:32:43.211 INFO:teuthology.orchestra.run.smithi203.stderr:Cloning into '/tmp/tmp.eVcldRLPeyxfsprogs-dev'... 2023-11-28T19:32:43.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:43.745 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-11-28T19:32:43.814 DEBUG:teuthology.orchestra.run.smithi203:> mktemp -d --suffix=test 2023-11-28T19:32:43.867 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.T5Ht4oNXxhtest 2023-11-28T19:32:43.868 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-11-28T19:32:43.868 DEBUG:teuthology.orchestra.run.smithi203:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-11-28T19:32:43.924 DEBUG:teuthology.orchestra.run.smithi203:> mktemp -d --suffix=scratch 2023-11-28T19:32:43.979 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.KZg81Ahl5Nscratch 2023-11-28T19:32:43.979 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2023-11-28T19:32:43.979 DEBUG:teuthology.orchestra.run.smithi203:> sudo apt-get install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc git indent libacl1-dev libaio-dev libcap-dev libgdbm-dev libtool libtool-bin liburing-dev libuuid1 lvm2 make psmisc python3 quota sed uuid-dev uuid-runtime xfsprogs sqlite3 exfatprogs f2fs-tools ocfs2-tools udftools xfsdump xfslibs-dev libinih-dev liburcu-dev libblkid-dev gettext libedit-dev libattr1-dev libdevmapper-dev libicu-dev pkg-config 2023-11-28T19:32:44.094 INFO:teuthology.orchestra.run.smithi203.stdout:Reading package lists... 2023-11-28T19:32:44.267 INFO:teuthology.orchestra.run.smithi203.stdout:Building dependency tree... 2023-11-28T19:32:44.268 INFO:teuthology.orchestra.run.smithi203.stdout:Reading state information... 2023-11-28T19:32:44.423 INFO:teuthology.orchestra.run.smithi203.stdout:acl is already the newest version (2.3.1-1). 2023-11-28T19:32:44.423 INFO:teuthology.orchestra.run.smithi203.stdout:acl set to manually installed. 2023-11-28T19:32:44.424 INFO:teuthology.orchestra.run.smithi203.stdout:attr is already the newest version (1:2.5.1-1build1). 2023-11-28T19:32:44.424 INFO:teuthology.orchestra.run.smithi203.stdout:automake is already the newest version (1:1.16.5-1.3). 2023-11-28T19:32:44.424 INFO:teuthology.orchestra.run.smithi203.stdout:bc is already the newest version (1.07.1-3build1). 2023-11-28T19:32:44.424 INFO:teuthology.orchestra.run.smithi203.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2023-11-28T19:32:44.424 INFO:teuthology.orchestra.run.smithi203.stdout:gcc set to manually installed. 2023-11-28T19:32:44.424 INFO:teuthology.orchestra.run.smithi203.stdout:gettext is already the newest version (0.21-4ubuntu4). 2023-11-28T19:32:44.424 INFO:teuthology.orchestra.run.smithi203.stdout:libacl1-dev is already the newest version (2.3.1-1). 2023-11-28T19:32:44.424 INFO:teuthology.orchestra.run.smithi203.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2023-11-28T19:32:44.424 INFO:teuthology.orchestra.run.smithi203.stdout:libattr1-dev is already the newest version (1:2.5.1-1build1). 2023-11-28T19:32:44.424 INFO:teuthology.orchestra.run.smithi203.stdout:libtool is already the newest version (2.4.6-15build2). 2023-11-28T19:32:44.424 INFO:teuthology.orchestra.run.smithi203.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-11-28T19:32:44.425 INFO:teuthology.orchestra.run.smithi203.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2023-11-28T19:32:44.425 INFO:teuthology.orchestra.run.smithi203.stdout:lvm2 is already the newest version (2.03.11-2.1ubuntu4). 2023-11-28T19:32:44.425 INFO:teuthology.orchestra.run.smithi203.stdout:make is already the newest version (4.3-4.1build1). 2023-11-28T19:32:44.425 INFO:teuthology.orchestra.run.smithi203.stdout:make set to manually installed. 2023-11-28T19:32:44.425 INFO:teuthology.orchestra.run.smithi203.stdout:pkg-config is already the newest version (0.29.2-1ubuntu3). 2023-11-28T19:32:44.425 INFO:teuthology.orchestra.run.smithi203.stdout:pkg-config set to manually installed. 2023-11-28T19:32:44.425 INFO:teuthology.orchestra.run.smithi203.stdout:psmisc is already the newest version (23.4-2build3). 2023-11-28T19:32:44.425 INFO:teuthology.orchestra.run.smithi203.stdout:quota is already the newest version (4.06-1build2). 2023-11-28T19:32:44.425 INFO:teuthology.orchestra.run.smithi203.stdout:sed is already the newest version (4.8-1ubuntu2). 2023-11-28T19:32:44.425 INFO:teuthology.orchestra.run.smithi203.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-11-28T19:32:44.425 INFO:teuthology.orchestra.run.smithi203.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2023-11-28T19:32:44.425 INFO:teuthology.orchestra.run.smithi203.stdout:xfsdump is already the newest version (3.1.9+0+nmu2). 2023-11-28T19:32:44.425 INFO:teuthology.orchestra.run.smithi203.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-11-28T19:32:44.426 INFO:teuthology.orchestra.run.smithi203.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2023-11-28T19:32:44.426 INFO:teuthology.orchestra.run.smithi203.stdout:dbench is already the newest version (4.0-2build1). 2023-11-28T19:32:44.426 INFO:teuthology.orchestra.run.smithi203.stdout:dump is already the newest version (0.4b47-3). 2023-11-28T19:32:44.426 INFO:teuthology.orchestra.run.smithi203.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2023-11-28T19:32:44.426 INFO:teuthology.orchestra.run.smithi203.stdout:git is already the newest version (1:2.34.1-1ubuntu1.10). 2023-11-28T19:32:44.426 INFO:teuthology.orchestra.run.smithi203.stdout:indent is already the newest version (2.2.12-1ubuntu0.22.04.1). 2023-11-28T19:32:44.426 INFO:teuthology.orchestra.run.smithi203.stdout:python3 is already the newest version (3.10.6-1~22.04). 2023-11-28T19:32:44.426 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages were automatically installed and are no longer required: 2023-11-28T19:32:44.426 INFO:teuthology.orchestra.run.smithi203.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-11-28T19:32:44.426 INFO:teuthology.orchestra.run.smithi203.stdout: libpython2-dev libpython2-stdlib libpython2.7 libpython2.7-dev 2023-11-28T19:32:44.426 INFO:teuthology.orchestra.run.smithi203.stdout: libpython2.7-minimal libpython2.7-stdlib linux-image-5.4.0-135-generic 2023-11-28T19:32:44.427 INFO:teuthology.orchestra.run.smithi203.stdout: linux-modules-5.4.0-135-generic python2 python2-dev python2-minimal 2023-11-28T19:32:44.428 INFO:teuthology.orchestra.run.smithi203.stdout: python2.7 python2.7-dev python2.7-minimal 2023-11-28T19:32:44.428 INFO:teuthology.orchestra.run.smithi203.stdout:Use 'sudo apt autoremove' to remove them. 2023-11-28T19:32:44.428 INFO:teuthology.orchestra.run.smithi203.stdout:The following additional packages will be installed: 2023-11-28T19:32:44.428 INFO:teuthology.orchestra.run.smithi203.stdout: icu-devtools libbsd-dev libcap2 libcmap4 libcorosync-common4 libdlm3 2023-11-28T19:32:44.428 INFO:teuthology.orchestra.run.smithi203.stdout: libinireader0 libmd-dev libnss-systemd libpam-systemd libpcre2-32-0 2023-11-28T19:32:44.428 INFO:teuthology.orchestra.run.smithi203.stdout: libpcre2-dev libpcre2-posix3 libpmemblk1 libqb100 libselinux1-dev 2023-11-28T19:32:44.428 INFO:teuthology.orchestra.run.smithi203.stdout: libsepol-dev libsystemd0 libudev-dev libudev1 systemd systemd-sysv udev 2023-11-28T19:32:44.428 INFO:teuthology.orchestra.run.smithi203.stdout:Suggested packages: 2023-11-28T19:32:44.428 INFO:teuthology.orchestra.run.smithi203.stdout: gnuplot gfio python-scipy gawk-doc icu-doc sqlite3-doc systemd-container 2023-11-28T19:32:44.428 INFO:teuthology.orchestra.run.smithi203.stdout: libtss2-esys-3.0.2-0 libtss2-mu0 libtss2-rc0 dvd+rw-tools udfclient 2023-11-28T19:32:44.478 INFO:teuthology.orchestra.run.smithi203.stdout:The following NEW packages will be installed: 2023-11-28T19:32:44.478 INFO:teuthology.orchestra.run.smithi203.stdout: exfatprogs f2fs-tools fio icu-devtools libblkid-dev libbsd-dev libcap-dev 2023-11-28T19:32:44.478 INFO:teuthology.orchestra.run.smithi203.stdout: libcmap4 libcorosync-common4 libdevmapper-dev libdlm3 libedit-dev 2023-11-28T19:32:44.479 INFO:teuthology.orchestra.run.smithi203.stdout: libgdbm-dev libicu-dev libinih-dev libinireader0 libmd-dev libpcre2-32-0 2023-11-28T19:32:44.479 INFO:teuthology.orchestra.run.smithi203.stdout: libpcre2-dev libpcre2-posix3 libpmemblk1 libqb100 libselinux1-dev 2023-11-28T19:32:44.479 INFO:teuthology.orchestra.run.smithi203.stdout: libsepol-dev libudev-dev liburcu-dev liburing-dev ocfs2-tools sqlite3 2023-11-28T19:32:44.479 INFO:teuthology.orchestra.run.smithi203.stdout: udftools 2023-11-28T19:32:44.479 INFO:teuthology.orchestra.run.smithi203.stdout:The following packages will be upgraded: 2023-11-28T19:32:44.481 INFO:teuthology.orchestra.run.smithi203.stdout: gawk libcap2 libnss-systemd libpam-systemd libsystemd0 libudev1 systemd 2023-11-28T19:32:44.481 INFO:teuthology.orchestra.run.smithi203.stdout: systemd-sysv udev 2023-11-28T19:32:44.665 INFO:teuthology.orchestra.run.smithi203.stdout:9 upgraded, 30 newly installed, 0 to remove and 254 not upgraded. 2023-11-28T19:32:44.665 INFO:teuthology.orchestra.run.smithi203.stdout:Need to get 27.5 MB of archives. 2023-11-28T19:32:44.665 INFO:teuthology.orchestra.run.smithi203.stdout:After this operation, 71.6 MB of additional disk space will be used. 2023-11-28T19:32:44.666 INFO:teuthology.orchestra.run.smithi203.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsystemd0 amd64 249.11-0ubuntu3.11 [318 kB] 2023-11-28T19:32:45.170 INFO:teuthology.orchestra.run.smithi203.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd-sysv amd64 249.11-0ubuntu3.11 [10.5 kB] 2023-11-28T19:32:45.172 INFO:teuthology.orchestra.run.smithi203.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnss-systemd amd64 249.11-0ubuntu3.11 [133 kB] 2023-11-28T19:32:45.197 INFO:teuthology.orchestra.run.smithi203.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpam-systemd amd64 249.11-0ubuntu3.11 [203 kB] 2023-11-28T19:32:45.254 INFO:teuthology.orchestra.run.smithi203.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd amd64 249.11-0ubuntu3.11 [4,581 kB] 2023-11-28T19:32:45.529 INFO:teuthology.orchestra.run.smithi203.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 udev amd64 249.11-0ubuntu3.11 [1,557 kB] 2023-11-28T19:32:45.560 INFO:teuthology.orchestra.run.smithi203.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libudev1 amd64 249.11-0ubuntu3.11 [78.0 kB] 2023-11-28T19:32:45.578 INFO:teuthology.orchestra.run.smithi203.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap2 amd64 1:2.44-1ubuntu0.22.04.1 [18.3 kB] 2023-11-28T19:32:45.578 INFO:teuthology.orchestra.run.smithi203.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 gawk amd64 1:5.1.0-1ubuntu0.1 [447 kB] 2023-11-28T19:32:45.584 INFO:teuthology.orchestra.run.smithi203.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcorosync-common4 amd64 3.1.6-1ubuntu1 [7,322 B] 2023-11-28T19:32:45.584 INFO:teuthology.orchestra.run.smithi203.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqb100 amd64 2.0.4-1ubuntu0.2 [74.2 kB] 2023-11-28T19:32:45.749 INFO:teuthology.orchestra.run.smithi203.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libcmap4 amd64 3.1.6-1ubuntu1 [10.4 kB] 2023-11-28T19:32:45.832 INFO:teuthology.orchestra.run.smithi203.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdlm3 amd64 4.1.1-1build1 [14.4 kB] 2023-11-28T19:32:45.863 INFO:teuthology.orchestra.run.smithi203.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 ocfs2-tools amd64 1.8.7-1build1 [646 kB] 2023-11-28T19:32:46.265 INFO:teuthology.orchestra.run.smithi203.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 exfatprogs amd64 1.1.3-1 [40.3 kB] 2023-11-28T19:32:46.272 INFO:teuthology.orchestra.run.smithi203.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 f2fs-tools amd64 1.14.0-2build1 [169 kB] 2023-11-28T19:32:46.297 INFO:teuthology.orchestra.run.smithi203.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-11-28T19:32:46.304 INFO:teuthology.orchestra.run.smithi203.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-11-28T19:32:46.501 INFO:teuthology.orchestra.run.smithi203.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 icu-devtools amd64 70.1-2 [197 kB] 2023-11-28T19:32:46.504 INFO:teuthology.orchestra.run.smithi203.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libmd-dev amd64 1.0.4-1build1 [40.0 kB] 2023-11-28T19:32:46.505 INFO:teuthology.orchestra.run.smithi203.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbsd-dev amd64 0.11.5-1 [168 kB] 2023-11-28T19:32:46.510 INFO:teuthology.orchestra.run.smithi203.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libcap-dev amd64 1:2.44-1ubuntu0.22.04.1 [39.4 kB] 2023-11-28T19:32:46.675 INFO:teuthology.orchestra.run.smithi203.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libudev-dev amd64 249.11-0ubuntu3.11 [20.7 kB] 2023-11-28T19:32:46.847 INFO:teuthology.orchestra.run.smithi203.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libsepol-dev amd64 3.3-1build1 [378 kB] 2023-11-28T19:32:47.207 INFO:teuthology.orchestra.run.smithi203.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-32-0 amd64 10.39-3ubuntu0.1 [194 kB] 2023-11-28T19:32:47.258 INFO:teuthology.orchestra.run.smithi203.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-posix3 amd64 10.39-3ubuntu0.1 [6,130 B] 2023-11-28T19:32:47.259 INFO:teuthology.orchestra.run.smithi203.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-dev amd64 10.39-3ubuntu0.1 [730 kB] 2023-11-28T19:32:47.355 INFO:teuthology.orchestra.run.smithi203.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 libselinux1-dev amd64 3.3-1build2 [158 kB] 2023-11-28T19:32:47.368 INFO:teuthology.orchestra.run.smithi203.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdevmapper-dev amd64 2:1.02.175-2.1ubuntu4 [36.6 kB] 2023-11-28T19:32:47.371 INFO:teuthology.orchestra.run.smithi203.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 libedit-dev amd64 3.1-20210910-1build1 [118 kB] 2023-11-28T19:32:47.381 INFO:teuthology.orchestra.run.smithi203.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2023-11-28T19:32:47.389 INFO:teuthology.orchestra.run.smithi203.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 libicu-dev amd64 70.1-2 [11.6 MB] 2023-11-28T19:32:47.750 INFO:teuthology.orchestra.run.smithi203.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 libinireader0 amd64 53-1ubuntu3 [9,636 B] 2023-11-28T19:32:47.914 INFO:teuthology.orchestra.run.smithi203.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 libinih-dev amd64 53-1ubuntu3 [20.6 kB] 2023-11-28T19:32:48.087 INFO:teuthology.orchestra.run.smithi203.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburing-dev amd64 2.1-2build1 [51.8 kB] 2023-11-28T19:32:48.200 INFO:teuthology.orchestra.run.smithi203.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.1 [768 kB] 2023-11-28T19:32:48.534 INFO:teuthology.orchestra.run.smithi203.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 libblkid-dev amd64 2.37.2-4ubuntu3 [185 kB] 2023-11-28T19:32:48.557 INFO:teuthology.orchestra.run.smithi203.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburcu-dev amd64 0.13.1-1 [125 kB] 2023-11-28T19:32:48.571 INFO:teuthology.orchestra.run.smithi203.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/universe amd64 udftools amd64 2.3-1 [125 kB] 2023-11-28T19:32:48.845 INFO:teuthology.orchestra.run.smithi203.stderr:debconf: unable to initialize frontend: Dialog 2023-11-28T19:32:48.846 INFO:teuthology.orchestra.run.smithi203.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-11-28T19:32:48.846 INFO:teuthology.orchestra.run.smithi203.stderr:debconf: falling back to frontend: Readline 2023-11-28T19:32:48.867 INFO:teuthology.orchestra.run.smithi203.stderr:debconf: unable to initialize frontend: Readline 2023-11-28T19:32:48.867 INFO:teuthology.orchestra.run.smithi203.stderr:debconf: (This frontend requires a controlling tty.) 2023-11-28T19:32:48.867 INFO:teuthology.orchestra.run.smithi203.stderr:debconf: falling back to frontend: Teletype 2023-11-28T19:32:48.874 INFO:teuthology.orchestra.run.smithi203.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-11-28T19:32:48.912 INFO:teuthology.orchestra.run.smithi203.stdout:Fetched 27.5 MB in 4s (6,719 kB/s) 2023-11-28T19:32:49.149 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143366 files and directories currently installed.) 2023-11-28T19:32:49.153 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../libsystemd0_249.11-0ubuntu3.11_amd64.deb ... 2023-11-28T19:32:49.366 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libsystemd0:amd64 (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-28T19:32:49.713 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libsystemd0:amd64 (249.11-0ubuntu3.11) ... 2023-11-28T19:32:50.142 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143366 files and directories currently installed.) 2023-11-28T19:32:50.146 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../0-systemd-sysv_249.11-0ubuntu3.11_amd64.deb ... 2023-11-28T19:32:50.317 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking systemd-sysv (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-28T19:32:50.779 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../1-libnss-systemd_249.11-0ubuntu3.11_amd64.deb ... 2023-11-28T19:32:50.907 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libnss-systemd:amd64 (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-28T19:32:51.328 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../2-libpam-systemd_249.11-0ubuntu3.11_amd64.deb ... 2023-11-28T19:32:51.453 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libpam-systemd:amd64 (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-28T19:32:51.950 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../3-systemd_249.11-0ubuntu3.11_amd64.deb ... 2023-11-28T19:32:52.149 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking systemd (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-28T19:32:53.267 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../4-udev_249.11-0ubuntu3.11_amd64.deb ... 2023-11-28T19:32:53.436 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking udev (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-28T19:32:54.087 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../5-libudev1_249.11-0ubuntu3.11_amd64.deb ... 2023-11-28T19:32:54.265 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libudev1:amd64 (249.11-0ubuntu3.11) over (249.11-0ubuntu3.6) ... 2023-11-28T19:32:54.594 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libudev1:amd64 (249.11-0ubuntu3.11) ... 2023-11-28T19:32:55.030 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143366 files and directories currently installed.) 2023-11-28T19:32:55.034 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../libcap2_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:32:55.182 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) over (1:2.44-1build3) ... 2023-11-28T19:32:55.507 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcap2:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-28T19:32:55.953 INFO:teuthology.orchestra.run.smithi203.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 143366 files and directories currently installed.) 2023-11-28T19:32:55.957 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../00-gawk_1%3a5.1.0-1ubuntu0.1_amd64.deb ... 2023-11-28T19:32:56.107 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking gawk (1:5.1.0-1ubuntu0.1) over (1:5.1.0-1build3) ... 2023-11-28T19:32:56.637 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcorosync-common4:amd64. 2023-11-28T19:32:56.652 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../01-libcorosync-common4_3.1.6-1ubuntu1_amd64.deb ... 2023-11-28T19:32:56.694 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2023-11-28T19:32:57.049 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libqb100:amd64. 2023-11-28T19:32:57.063 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../02-libqb100_2.0.4-1ubuntu0.2_amd64.deb ... 2023-11-28T19:32:57.105 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2023-11-28T19:32:57.384 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcmap4:amd64. 2023-11-28T19:32:57.400 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../03-libcmap4_3.1.6-1ubuntu1_amd64.deb ... 2023-11-28T19:32:57.434 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcmap4:amd64 (3.1.6-1ubuntu1) ... 2023-11-28T19:32:57.845 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libdlm3:amd64. 2023-11-28T19:32:57.861 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../04-libdlm3_4.1.1-1build1_amd64.deb ... 2023-11-28T19:32:57.904 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libdlm3:amd64 (4.1.1-1build1) ... 2023-11-28T19:32:58.341 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package ocfs2-tools. 2023-11-28T19:32:58.358 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../05-ocfs2-tools_1.8.7-1build1_amd64.deb ... 2023-11-28T19:32:58.400 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking ocfs2-tools (1.8.7-1build1) ... 2023-11-28T19:32:58.738 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package exfatprogs. 2023-11-28T19:32:58.754 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../06-exfatprogs_1.1.3-1_amd64.deb ... 2023-11-28T19:32:58.797 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking exfatprogs (1.1.3-1) ... 2023-11-28T19:32:59.093 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package f2fs-tools. 2023-11-28T19:32:59.108 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../07-f2fs-tools_1.14.0-2build1_amd64.deb ... 2023-11-28T19:32:59.150 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking f2fs-tools (1.14.0-2build1) ... 2023-11-28T19:32:59.538 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-11-28T19:32:59.554 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../08-libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-11-28T19:32:59.587 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-11-28T19:32:59.932 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package fio. 2023-11-28T19:32:59.949 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../09-fio_3.28-1_amd64.deb ... 2023-11-28T19:32:59.991 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking fio (3.28-1) ... 2023-11-28T19:33:00.453 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package icu-devtools. 2023-11-28T19:33:00.468 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../10-icu-devtools_70.1-2_amd64.deb ... 2023-11-28T19:33:00.511 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking icu-devtools (70.1-2) ... 2023-11-28T19:33:00.791 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libmd-dev:amd64. 2023-11-28T19:33:00.807 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../11-libmd-dev_1.0.4-1build1_amd64.deb ... 2023-11-28T19:33:00.875 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libmd-dev:amd64 (1.0.4-1build1) ... 2023-11-28T19:33:01.130 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libbsd-dev:amd64. 2023-11-28T19:33:01.145 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../12-libbsd-dev_0.11.5-1_amd64.deb ... 2023-11-28T19:33:01.188 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libbsd-dev:amd64 (0.11.5-1) ... 2023-11-28T19:33:01.504 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libcap-dev:amd64. 2023-11-28T19:33:01.518 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../13-libcap-dev_1%3a2.44-1ubuntu0.22.04.1_amd64.deb ... 2023-11-28T19:33:01.562 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-28T19:33:01.867 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libudev-dev:amd64. 2023-11-28T19:33:01.882 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../14-libudev-dev_249.11-0ubuntu3.11_amd64.deb ... 2023-11-28T19:33:01.926 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libudev-dev:amd64 (249.11-0ubuntu3.11) ... 2023-11-28T19:33:02.214 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libsepol-dev:amd64. 2023-11-28T19:33:02.229 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../15-libsepol-dev_3.3-1build1_amd64.deb ... 2023-11-28T19:33:02.314 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libsepol-dev:amd64 (3.3-1build1) ... 2023-11-28T19:33:02.677 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libpcre2-32-0:amd64. 2023-11-28T19:33:02.691 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../16-libpcre2-32-0_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T19:33:02.760 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libpcre2-32-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:33:03.055 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libpcre2-posix3:amd64. 2023-11-28T19:33:03.069 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../17-libpcre2-posix3_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T19:33:03.105 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libpcre2-posix3:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:33:03.391 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libpcre2-dev:amd64. 2023-11-28T19:33:03.407 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../18-libpcre2-dev_10.39-3ubuntu0.1_amd64.deb ... 2023-11-28T19:33:03.450 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libpcre2-dev:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:33:03.806 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libselinux1-dev:amd64. 2023-11-28T19:33:03.821 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../19-libselinux1-dev_3.3-1build2_amd64.deb ... 2023-11-28T19:33:03.864 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libselinux1-dev:amd64 (3.3-1build2) ... 2023-11-28T19:33:04.221 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libdevmapper-dev:amd64. 2023-11-28T19:33:04.236 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../20-libdevmapper-dev_2%3a1.02.175-2.1ubuntu4_amd64.deb ... 2023-11-28T19:33:04.279 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libdevmapper-dev:amd64 (2:1.02.175-2.1ubuntu4) ... 2023-11-28T19:33:04.590 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libedit-dev:amd64. 2023-11-28T19:33:04.606 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../21-libedit-dev_3.1-20210910-1build1_amd64.deb ... 2023-11-28T19:33:04.695 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libedit-dev:amd64 (3.1-20210910-1build1) ... 2023-11-28T19:33:04.971 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-11-28T19:33:04.987 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../22-libgdbm-dev_1.23-1_amd64.deb ... 2023-11-28T19:33:05.029 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2023-11-28T19:33:05.366 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libicu-dev:amd64. 2023-11-28T19:33:05.382 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../23-libicu-dev_70.1-2_amd64.deb ... 2023-11-28T19:33:05.424 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libicu-dev:amd64 (70.1-2) ... 2023-11-28T19:33:05.716 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:33:05.719 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:33:05.722 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:33:06.246 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libinireader0:amd64. 2023-11-28T19:33:06.261 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../24-libinireader0_53-1ubuntu3_amd64.deb ... 2023-11-28T19:33:06.304 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libinireader0:amd64 (53-1ubuntu3) ... 2023-11-28T19:33:06.523 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libinih-dev:amd64. 2023-11-28T19:33:06.538 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../25-libinih-dev_53-1ubuntu3_amd64.deb ... 2023-11-28T19:33:06.615 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libinih-dev:amd64 (53-1ubuntu3) ... 2023-11-28T19:33:06.868 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liburing-dev:amd64. 2023-11-28T19:33:06.883 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../26-liburing-dev_2.1-2build1_amd64.deb ... 2023-11-28T19:33:06.927 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liburing-dev:amd64 (2.1-2build1) ... 2023-11-28T19:33:07.222 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package sqlite3. 2023-11-28T19:33:07.237 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../27-sqlite3_3.37.2-2ubuntu0.1_amd64.deb ... 2023-11-28T19:33:07.280 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.1) ... 2023-11-28T19:33:07.525 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package libblkid-dev:amd64. 2023-11-28T19:33:07.540 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../28-libblkid-dev_2.37.2-4ubuntu3_amd64.deb ... 2023-11-28T19:33:07.608 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking libblkid-dev:amd64 (2.37.2-4ubuntu3) ... 2023-11-28T19:33:07.869 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package liburcu-dev:amd64. 2023-11-28T19:33:07.884 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../29-liburcu-dev_0.13.1-1_amd64.deb ... 2023-11-28T19:33:07.928 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking liburcu-dev:amd64 (0.13.1-1) ... 2023-11-28T19:33:08.358 INFO:teuthology.orchestra.run.smithi203.stdout:Selecting previously unselected package udftools. 2023-11-28T19:33:08.373 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing to unpack .../30-udftools_2.3-1_amd64.deb ... 2023-11-28T19:33:08.429 INFO:teuthology.orchestra.run.smithi203.stdout:Unpacking udftools (2.3-1) ... 2023-11-28T19:33:08.776 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liburcu-dev:amd64 (0.13.1-1) ... 2023-11-28T19:33:08.906 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libblkid-dev:amd64 (2.37.2-4ubuntu3) ... 2023-11-28T19:33:09.048 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libinireader0:amd64 (53-1ubuntu3) ... 2023-11-28T19:33:09.166 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up exfatprogs (1.1.3-1) ... 2023-11-28T19:33:09.284 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up gawk (1:5.1.0-1ubuntu0.1) ... 2023-11-28T19:33:09.570 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up f2fs-tools (1.14.0-2build1) ... 2023-11-28T19:33:09.696 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libqb100:amd64 (2.0.4-1ubuntu0.2) ... 2023-11-28T19:33:09.823 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcorosync-common4:amd64 (3.1.6-1ubuntu1) ... 2023-11-28T19:33:09.991 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up systemd (249.11-0ubuntu3.11) ... 2023-11-28T19:33:11.523 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libpcre2-32-0:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:33:12.060 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up udev (249.11-0ubuntu3.11) ... 2023-11-28T19:33:13.528 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up icu-devtools (70.1-2) ... 2023-11-28T19:33:13.654 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libudev-dev:amd64 (249.11-0ubuntu3.11) ... 2023-11-28T19:33:13.780 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libsepol-dev:amd64 (3.3-1build1) ... 2023-11-28T19:33:13.939 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-11-28T19:33:14.065 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libinih-dev:amd64 (53-1ubuntu3) ... 2023-11-28T19:33:14.184 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libpcre2-posix3:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:33:14.285 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libmd-dev:amd64 (1.0.4-1build1) ... 2023-11-28T19:33:14.428 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up udftools (2.3-1) ... 2023-11-28T19:33:14.579 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libdlm3:amd64 (4.1.1-1build1) ... 2023-11-28T19:33:14.705 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2023-11-28T19:33:14.831 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcap-dev:amd64 (1:2.44-1ubuntu0.22.04.1) ... 2023-11-28T19:33:14.982 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libicu-dev:amd64 (70.1-2) ... 2023-11-28T19:33:15.108 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libbsd-dev:amd64 (0.11.5-1) ... 2023-11-28T19:33:15.226 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.1) ... 2023-11-28T19:33:15.328 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up liburing-dev:amd64 (2.1-2build1) ... 2023-11-28T19:33:15.478 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up systemd-sysv (249.11-0ubuntu3.11) ... 2023-11-28T19:33:15.604 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libpcre2-dev:amd64 (10.39-3ubuntu0.1) ... 2023-11-28T19:33:15.730 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libcmap4:amd64 (3.1.6-1ubuntu1) ... 2023-11-28T19:33:15.906 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libselinux1-dev:amd64 (3.3-1build2) ... 2023-11-28T19:33:16.032 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libnss-systemd:amd64 (249.11-0ubuntu3.11) ... 2023-11-28T19:33:16.167 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up fio (3.28-1) ... 2023-11-28T19:33:16.711 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libedit-dev:amd64 (3.1-20210910-1build1) ... 2023-11-28T19:33:16.862 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libdevmapper-dev:amd64 (2:1.02.175-2.1ubuntu4) ... 2023-11-28T19:33:16.988 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up ocfs2-tools (1.8.7-1build1) ... 2023-11-28T19:33:17.572 INFO:teuthology.orchestra.run.smithi203.stdout:debconf: unable to initialize frontend: Dialog 2023-11-28T19:33:17.572 INFO:teuthology.orchestra.run.smithi203.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-11-28T19:33:17.572 INFO:teuthology.orchestra.run.smithi203.stdout:debconf: falling back to frontend: Readline 2023-11-28T19:33:18.579 INFO:teuthology.orchestra.run.smithi203.stdout:Setting up libpam-systemd:amd64 (249.11-0ubuntu3.11) ... 2023-11-28T19:33:18.793 INFO:teuthology.orchestra.run.smithi203.stdout:debconf: unable to initialize frontend: Dialog 2023-11-28T19:33:18.793 INFO:teuthology.orchestra.run.smithi203.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-11-28T19:33:18.793 INFO:teuthology.orchestra.run.smithi203.stdout:debconf: falling back to frontend: Readline 2023-11-28T19:33:19.057 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2023-11-28T19:33:19.157 INFO:teuthology.orchestra.run.smithi203.stdout:update-initramfs: Generating /boot/initrd.img-6.6.0-g8247bbb5b470 2023-11-28T19:33:33.450 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-11-28T19:33:33.627 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-11-28T19:33:35.132 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-11-28T19:33:35.224 INFO:teuthology.orchestra.run.smithi203.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-11-28T19:33:35.811 DEBUG:teuthology.orchestra.run.smithi203:> sudo useradd -m fsgqa 2023-11-28T19:33:35.830 INFO:teuthology.orchestra.run.smithi203.stderr:useradd: user 'fsgqa' already exists 2023-11-28T19:33:35.832 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-28T19:33:35.832 DEBUG:teuthology.orchestra.run.smithi203:> sudo groupadd fsgqa 2023-11-28T19:33:35.894 INFO:teuthology.orchestra.run.smithi203.stderr:groupadd: group 'fsgqa' already exists 2023-11-28T19:33:35.895 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-11-28T19:33:35.896 DEBUG:teuthology.orchestra.run.smithi203:> sudo useradd fsgqa2 2023-11-28T19:33:35.912 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:33:35.915 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:33:35.918 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:33:36.325 DEBUG:teuthology.orchestra.run.smithi203:> sudo useradd 123456-fsgqa 2023-11-28T19:33:36.746 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-11-28T19:33:36.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.875+0000 7f550cdfb640 1 Processor -- start 2023-11-28T19:33:36.881 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.875+0000 7f550cdfb640 1 -- start start 2023-11-28T19:33:36.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550cdfb640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5508072490 0x7f55080b44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:33:36.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550cdfb640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5508072870 0x7f550814b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:33:36.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550cdfb640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55080b6a30 con 0x7f550814bec0 2023-11-28T19:33:36.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550cdfb640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55080b50a0 con 0x7f5508072490 2023-11-28T19:33:36.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550cdfb640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f550814c350 con 0x7f5508072870 2023-11-28T19:33:36.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5508072490 0x7f55080b44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:33:36.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550659c640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f5508072490 0x7f55080b44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60748/0 (socket says 172.21.15.28:60748) 2023-11-28T19:33:36.883 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550659c640 1 -- 172.21.15.28:0/2366089850 learned_addr learned my addr 172.21.15.28:0/2366089850 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:33:36.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f5505d9b640 1 --2- 172.21.15.28:0/2366089850 >> v2:172.21.15.131:3300/0 conn(0x7f5508072870 0x7f550814b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:33:36.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550659c640 1 -- 172.21.15.28:0/2366089850 >> v2:172.21.15.131:3300/0 conn(0x7f5508072870 msgr2=0x7f550814b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:33:36.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550659c640 1 --2- 172.21.15.28:0/2366089850 >> v2:172.21.15.131:3300/0 conn(0x7f5508072870 0x7f550814b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:36.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550659c640 1 -- 172.21.15.28:0/2366089850 >> v1:172.21.15.131:6789/0 conn(0x7f550814bec0 legacy=0x7f550814eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:33:36.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550659c640 1 -- 172.21.15.28:0/2366089850 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55080b5840 con 0x7f5508072490 2023-11-28T19:33:36.884 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f5505d9b640 1 --2- 172.21.15.28:0/2366089850 >> v2:172.21.15.131:3300/0 conn(0x7f5508072870 0x7f550814b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:33:36.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550659c640 1 --2- 172.21.15.28:0/2366089850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5508072490 0x7f55080b44f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f55080b7200 tx=0x7f54f801c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6177f4388ea72e0e server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:33:36.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550559a640 1 -- 172.21.15.28:0/2366089850 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f80ab600 con 0x7f5508072490 2023-11-28T19:33:36.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550559a640 1 -- 172.21.15.28:0/2366089850 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54f80a7050 con 0x7f5508072490 2023-11-28T19:33:36.885 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.879+0000 7f550559a640 1 -- 172.21.15.28:0/2366089850 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54f80ab980 con 0x7f5508072490 2023-11-28T19:33:36.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 -- 172.21.15.28:0/2366089850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5508072490 msgr2=0x7f55080b44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:33:36.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 --2- 172.21.15.28:0/2366089850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5508072490 0x7f55080b44f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f55080b7200 tx=0x7f54f801c4c0 comp rx=0 tx=0).stop 2023-11-28T19:33:36.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 -- 172.21.15.28:0/2366089850 shutdown_connections 2023-11-28T19:33:36.886 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 --2- 172.21.15.28:0/2366089850 >> v2:172.21.15.131:3300/0 conn(0x7f5508072870 0x7f550814b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:36.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 --2- 172.21.15.28:0/2366089850 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f5508072490 0x7f55080b44f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:36.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 -- 172.21.15.28:0/2366089850 >> 172.21.15.28:0/2366089850 conn(0x7f55080bcb40 msgr2=0x7f55080bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:33:36.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 -- 172.21.15.28:0/2366089850 shutdown_connections 2023-11-28T19:33:36.887 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 -- 172.21.15.28:0/2366089850 wait complete. 2023-11-28T19:33:36.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 Processor -- start 2023-11-28T19:33:36.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 -- start start 2023-11-28T19:33:36.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5508072490 0x7f550813f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:33:36.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5508072870 0x7f55081e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:33:36.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f550814bec0 0x7f550813be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:33:36.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550814e850 con 0x7f550814bec0 2023-11-28T19:33:36.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f550813f5d0 con 0x7f5508072870 2023-11-28T19:33:36.889 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55081e8190 con 0x7f5508072490 2023-11-28T19:33:36.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f5506d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f550814bec0 0x7f550813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:33:36.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f5506d9d640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f550814bec0 0x7f550813be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60752/0 (socket says 172.21.15.28:60752) 2023-11-28T19:33:36.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f5506d9d640 1 -- 172.21.15.28:0/1129150101 learned_addr learned my addr 172.21.15.28:0/1129150101 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:33:36.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550659c640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5508072490 0x7f550813f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:33:36.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f5505d9b640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5508072870 0x7f55081e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:33:36.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f5506d9d640 1 -- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5508072490 msgr2=0x7f550813f090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:33:36.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f5506d9d640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5508072490 0x7f550813f090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:36.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f5506d9d640 1 -- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5508072870 msgr2=0x7f55081e7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:33:36.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f5506d9d640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5508072870 0x7f55081e7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:36.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f5506d9d640 1 -- 172.21.15.28:0/1129150101 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54f80094d0 con 0x7f550814bec0 2023-11-28T19:33:36.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550659c640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5508072490 0x7f550813f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:33:36.890 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f5505d9b640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5508072870 0x7f55081e7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:33:36.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f5506d9d640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f550814bec0 0x7f550813be80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f550000c7b0 tx=0x7f550000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:33:36.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f54f6ffd640 1 -- 172.21.15.28:0/1129150101 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500003d90 con 0x7f550814bec0 2023-11-28T19:33:36.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f54f6ffd640 1 -- 172.21.15.28:0/1129150101 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5500005070 con 0x7f550814bec0 2023-11-28T19:33:36.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 -- 172.21.15.28:0/1129150101 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f550814e570 con 0x7f550814bec0 2023-11-28T19:33:36.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f54f6ffd640 1 -- 172.21.15.28:0/1129150101 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5500005420 con 0x7f550814bec0 2023-11-28T19:33:36.891 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 -- 172.21.15.28:0/1129150101 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5508149100 con 0x7f550814bec0 2023-11-28T19:33:36.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.883+0000 7f550cdfb640 1 -- 172.21.15.28:0/1129150101 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55081e7970 con 0x7f550814bec0 2023-11-28T19:33:36.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.887+0000 7f54f6ffd640 1 -- 172.21.15.28:0/1129150101 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f5500005580 con 0x7f550814bec0 2023-11-28T19:33:36.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.887+0000 7f54f6ffd640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f54e8066470 0x7f54e8068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:33:36.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.887+0000 7f54f6ffd640 1 -- 172.21.15.28:0/1129150101 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5500083140 con 0x7f550814bec0 2023-11-28T19:33:36.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.887+0000 7f550659c640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f54e8066470 0x7f54e8068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:33:36.892 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.887+0000 7f550659c640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f54e8066470 0x7f54e8068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f54f80ad000 tx=0x7f54f8008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:33:36.895 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:36.891+0000 7f54f6ffd640 1 -- 172.21.15.28:0/1129150101 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f5500050730 con 0x7f550814bec0 2023-11-28T19:33:37.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.107+0000 7f550cdfb640 1 -- 172.21.15.28:0/1129150101 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f55081e7970 con 0x7f550814bec0 2023-11-28T19:33:37.111 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.107+0000 7f54f6ffd640 1 -- 172.21.15.28:0/1129150101 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f5500017510 con 0x7f550814bec0 2023-11-28T19:33:37.112 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:33:37.112 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":1,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","modified":"2023-11-28T19:30:37.694716Z","created":"2023-11-28T19:30:37.694716Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:3300","nonce":0},{"type":"v1","addr":"172.21.15.131:6789","nonce":0}]},"addr":"172.21.15.131:6789/0","public_addr":"172.21.15.131:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:3301","nonce":0},{"type":"v1","addr":"172.21.15.131:6790","nonce":0}]},"addr":"172.21.15.131:6790/0","public_addr":"172.21.15.131:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-11-28T19:33:37.112 INFO:teuthology.orchestra.run.smithi028.stderr:dumped monmap epoch 1 2023-11-28T19:33:37.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.107+0000 7f550cdfb640 1 -- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f54e8066470 msgr2=0x7f54e8068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:33:37.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.107+0000 7f550cdfb640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f54e8066470 0x7f54e8068930 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f54f80ad000 tx=0x7f54f8008040 comp rx=0 tx=0).stop 2023-11-28T19:33:37.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.107+0000 7f550cdfb640 1 -- 172.21.15.28:0/1129150101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f550814bec0 msgr2=0x7f550813be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:33:37.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.107+0000 7f550cdfb640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f550814bec0 0x7f550813be80 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f550000c7b0 tx=0x7f550000cc70 comp rx=0 tx=0).stop 2023-11-28T19:33:37.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.107+0000 7f550cdfb640 1 -- 172.21.15.28:0/1129150101 shutdown_connections 2023-11-28T19:33:37.114 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.107+0000 7f550cdfb640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f54e8066470 0x7f54e8068930 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:37.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.107+0000 7f550cdfb640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f550814bec0 0x7f550813be80 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:37.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.107+0000 7f550cdfb640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5508072870 0x7f55081e7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:37.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.107+0000 7f550cdfb640 1 --2- 172.21.15.28:0/1129150101 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f5508072490 0x7f550813f090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:37.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.107+0000 7f550cdfb640 1 -- 172.21.15.28:0/1129150101 >> 172.21.15.28:0/1129150101 conn(0x7f55080bcb40 msgr2=0x7f55080bcf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:33:37.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.111+0000 7f550cdfb640 1 -- 172.21.15.28:0/1129150101 shutdown_connections 2023-11-28T19:33:37.115 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.111+0000 7f550cdfb640 1 -- 172.21.15.28:0/1129150101 wait complete. 2023-11-28T19:33:37.132 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-11-28T19:33:37.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374bd03640 1 Processor -- start 2023-11-28T19:33:37.259 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374bd03640 1 -- start start 2023-11-28T19:33:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374bd03640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f37440b8c40 0x7f37440b7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:33:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374bd03640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f37441418f0 0x7f3744148140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:33:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374bd03640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37440b64e0 con 0x7f37440b5ee0 2023-11-28T19:33:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374bd03640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37440b6d90 con 0x7f37440b8c40 2023-11-28T19:33:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374bd03640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37440b62c0 con 0x7f37441418f0 2023-11-28T19:33:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374929e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f37440b8c40 0x7f37440b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:33:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374929e640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f37440b8c40 0x7f37440b7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60760/0 (socket says 172.21.15.28:60760) 2023-11-28T19:33:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374929e640 1 -- 172.21.15.28:0/1767446396 learned_addr learned my addr 172.21.15.28:0/1767446396 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:33:37.260 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374a2a0640 1 --2- 172.21.15.28:0/1767446396 >> v2:172.21.15.131:3300/0 conn(0x7f37441418f0 0x7f3744148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:33:37.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374929e640 1 -- 172.21.15.28:0/1767446396 >> v2:172.21.15.131:3300/0 conn(0x7f37441418f0 msgr2=0x7f3744148140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:33:37.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374929e640 1 --2- 172.21.15.28:0/1767446396 >> v2:172.21.15.131:3300/0 conn(0x7f37441418f0 0x7f3744148140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:37.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374929e640 1 -- 172.21.15.28:0/1767446396 >> v1:172.21.15.131:6789/0 conn(0x7f37440b5ee0 legacy=0x7f37440b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:33:37.261 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.255+0000 7f374929e640 1 -- 172.21.15.28:0/1767446396 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37440b67c0 con 0x7f37440b8c40 2023-11-28T19:33:37.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374929e640 1 --2- 172.21.15.28:0/1767446396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37440b8c40 0x7f37440b7540 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f374406cd90 tx=0x7f373401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65f4d23fc05cf5ae server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:33:37.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f3748a9d640 1 -- 172.21.15.28:0/1767446396 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37340a89b0 con 0x7f37440b8c40 2023-11-28T19:33:37.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f3748a9d640 1 -- 172.21.15.28:0/1767446396 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37340a8b10 con 0x7f37440b8c40 2023-11-28T19:33:37.262 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f3748a9d640 1 -- 172.21.15.28:0/1767446396 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37340a8ea0 con 0x7f37440b8c40 2023-11-28T19:33:37.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 -- 172.21.15.28:0/1767446396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37440b8c40 msgr2=0x7f37440b7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:33:37.263 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 --2- 172.21.15.28:0/1767446396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37440b8c40 0x7f37440b7540 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f374406cd90 tx=0x7f373401ecb0 comp rx=0 tx=0).stop 2023-11-28T19:33:37.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 -- 172.21.15.28:0/1767446396 shutdown_connections 2023-11-28T19:33:37.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 --2- 172.21.15.28:0/1767446396 >> v2:172.21.15.131:3300/0 conn(0x7f37441418f0 0x7f3744148140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:37.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 --2- 172.21.15.28:0/1767446396 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37440b8c40 0x7f37440b7540 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:37.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 -- 172.21.15.28:0/1767446396 >> 172.21.15.28:0/1767446396 conn(0x7f37440bcb40 msgr2=0x7f37440bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:33:37.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 -- 172.21.15.28:0/1767446396 shutdown_connections 2023-11-28T19:33:37.264 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 -- 172.21.15.28:0/1767446396 wait complete. 2023-11-28T19:33:37.266 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 Processor -- start 2023-11-28T19:33:37.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 -- start start 2023-11-28T19:33:37.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37440b5ee0 0x7f3744149b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:33:37.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37440b8c40 0x7f374413fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:33:37.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37441418f0 0x7f374414a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:33:37.267 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374414be80 con 0x7f37440b5ee0 2023-11-28T19:33:37.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3744140430 con 0x7f37441418f0 2023-11-28T19:33:37.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374bd03640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f374414bba0 con 0x7f37440b8c40 2023-11-28T19:33:37.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f3749a9f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37440b5ee0 0x7f3744149b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:33:37.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f3749a9f640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37440b5ee0 0x7f3744149b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:60768/0 (socket says 172.21.15.28:60768) 2023-11-28T19:33:37.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f3749a9f640 1 -- 172.21.15.28:0/2577778697 learned_addr learned my addr 172.21.15.28:0/2577778697 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:33:37.268 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374929e640 1 --2- 172.21.15.28:0/2577778697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37440b8c40 0x7f374413fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:33:37.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f374a2a0640 1 --2- 172.21.15.28:0/2577778697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37441418f0 0x7f374414a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:33:37.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f3749a9f640 1 -- 172.21.15.28:0/2577778697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37440b8c40 msgr2=0x7f374413fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:33:37.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f3749a9f640 1 --2- 172.21.15.28:0/2577778697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37440b8c40 0x7f374413fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:37.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f3749a9f640 1 -- 172.21.15.28:0/2577778697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37441418f0 msgr2=0x7f374414a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:33:37.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f3749a9f640 1 --2- 172.21.15.28:0/2577778697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37441418f0 0x7f374414a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:37.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.259+0000 7f3749a9f640 1 -- 172.21.15.28:0/2577778697 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37340094d0 con 0x7f37440b5ee0 2023-11-28T19:33:37.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.263+0000 7f3749a9f640 1 --2- 172.21.15.28:0/2577778697 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37440b5ee0 0x7f3744149b70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f373c00c7c0 tx=0x7f373c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:33:37.269 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.263+0000 7f373a7fc640 1 -- 172.21.15.28:0/2577778697 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c00aa50 con 0x7f37440b5ee0 2023-11-28T19:33:37.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.263+0000 7f373a7fc640 1 -- 172.21.15.28:0/2577778697 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c00abb0 con 0x7f37440b5ee0 2023-11-28T19:33:37.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.263+0000 7f373a7fc640 1 -- 172.21.15.28:0/2577778697 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c012420 con 0x7f37440b5ee0 2023-11-28T19:33:37.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.263+0000 7f374bd03640 1 -- 172.21.15.28:0/2577778697 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3744148c30 con 0x7f37440b5ee0 2023-11-28T19:33:37.270 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.263+0000 7f374bd03640 1 -- 172.21.15.28:0/2577778697 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3744145120 con 0x7f37440b5ee0 2023-11-28T19:33:37.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.263+0000 7f374bd03640 1 -- 172.21.15.28:0/2577778697 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3744148a90 con 0x7f37440b5ee0 2023-11-28T19:33:37.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.263+0000 7f373a7fc640 1 -- 172.21.15.28:0/2577778697 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f373c012580 con 0x7f37440b5ee0 2023-11-28T19:33:37.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.263+0000 7f373a7fc640 1 --2- 172.21.15.28:0/2577778697 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3728066470 0x7f3728068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:33:37.271 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.263+0000 7f373a7fc640 1 -- 172.21.15.28:0/2577778697 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f373c0840e0 con 0x7f37440b5ee0 2023-11-28T19:33:37.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.263+0000 7f374929e640 1 --2- 172.21.15.28:0/2577778697 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3728066470 0x7f3728068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:33:37.272 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.267+0000 7f374929e640 1 --2- 172.21.15.28:0/2577778697 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3728066470 0x7f3728068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f37340b2000 tx=0x7f3734008040 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:33:37.273 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.267+0000 7f373a7fc640 1 -- 172.21.15.28:0/2577778697 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f3744148a90 con 0x7f37440b5ee0 2023-11-28T19:33:37.491 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.487+0000 7f374bd03640 1 -- 172.21.15.28:0/2577778697 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f3744145370 con 0x7f37440b5ee0 2023-11-28T19:33:37.492 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.487+0000 7f373a7fc640 1 -- 172.21.15.28:0/2577778697 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f3744145370 con 0x7f37440b5ee0 2023-11-28T19:33:37.492 INFO:teuthology.orchestra.run.smithi028.stdout:[client.admin] 2023-11-28T19:33:37.492 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDdP2ZlbxBENBAAPWOr8aN2mLMM5rsjI2r/lA== 2023-11-28T19:33:37.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.491+0000 7f374bd03640 1 -- 172.21.15.28:0/2577778697 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3728066470 msgr2=0x7f3728068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:33:37.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.491+0000 7f374bd03640 1 --2- 172.21.15.28:0/2577778697 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3728066470 0x7f3728068930 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f37340b2000 tx=0x7f3734008040 comp rx=0 tx=0).stop 2023-11-28T19:33:37.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.491+0000 7f374bd03640 1 -- 172.21.15.28:0/2577778697 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37440b5ee0 msgr2=0x7f3744149b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:33:37.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.491+0000 7f374bd03640 1 --2- 172.21.15.28:0/2577778697 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37440b5ee0 0x7f3744149b70 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f373c00c7c0 tx=0x7f373c00cc80 comp rx=0 tx=0).stop 2023-11-28T19:33:37.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.491+0000 7f374bd03640 1 -- 172.21.15.28:0/2577778697 shutdown_connections 2023-11-28T19:33:37.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.491+0000 7f374bd03640 1 --2- 172.21.15.28:0/2577778697 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f3728066470 0x7f3728068930 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:37.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.491+0000 7f374bd03640 1 --2- 172.21.15.28:0/2577778697 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37441418f0 0x7f374414a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:37.495 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.491+0000 7f374bd03640 1 --2- 172.21.15.28:0/2577778697 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f37440b8c40 0x7f374413fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:37.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.491+0000 7f374bd03640 1 --2- 172.21.15.28:0/2577778697 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f37440b5ee0 0x7f3744149b70 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:33:37.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.491+0000 7f374bd03640 1 -- 172.21.15.28:0/2577778697 >> 172.21.15.28:0/2577778697 conn(0x7f37440bcb40 msgr2=0x7f37441470f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:33:37.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.491+0000 7f374bd03640 1 -- 172.21.15.28:0/2577778697 shutdown_connections 2023-11-28T19:33:37.496 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:33:37.491+0000 7f374bd03640 1 -- 172.21.15.28:0/2577778697 wait complete. 2023-11-28T19:33:37.510 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:33:37.510 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/tmp/tmp.N8wkfFNIvbxfstests-dev/local.config 2023-11-28T19:33:37.531 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.28:6789:/test export TEST_DIR=/tmp/tmp.T5Ht4oNXxhtest export SCRATCH_DEV=172.21.15.28:6789:/scratch export SCRATCH_MNT=/tmp/tmp.KZg81Ahl5Nscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQDdP2ZlbxBENBAAPWOr8aN2mLMM5rsjI2r/lA==" 2023-11-28T19:33:37.531 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:33:37.532 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/tmp/tmp.N8wkfFNIvbxfstests-dev/ceph.exclude 2023-11-28T19:33:37.599 DEBUG:teuthology.orchestra.run.smithi203:> (cd /tmp/tmp.N8wkfFNIvbxfstests-dev && exec sudo make) 2023-11-28T19:33:37.663 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize -cfi 2023-11-28T19:33:38.032 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: putting auxiliary files in '.'. 2023-11-28T19:33:38.032 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file './config.guess' 2023-11-28T19:33:38.042 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file './config.sub' 2023-11-28T19:33:38.060 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file './install-sh' 2023-11-28T19:33:38.072 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file './ltmain.sh' 2023-11-28T19:33:38.123 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-11-28T19:33:38.124 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-11-28T19:33:38.143 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-11-28T19:33:38.153 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-11-28T19:33:38.164 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-11-28T19:33:38.175 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-11-28T19:33:38.186 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-11-28T19:33:38.188 INFO:teuthology.orchestra.run.smithi203.stdout:cp include/install-sh . 2023-11-28T19:33:38.190 INFO:teuthology.orchestra.run.smithi203.stdout:aclocal -I m4 2023-11-28T19:33:39.302 INFO:teuthology.orchestra.run.smithi203.stdout:autoheader 2023-11-28T19:33:39.656 INFO:teuthology.orchestra.run.smithi203.stdout:autoconf 2023-11-28T19:33:40.057 INFO:teuthology.orchestra.run.smithi203.stdout:./configure \ 2023-11-28T19:33:40.057 INFO:teuthology.orchestra.run.smithi203.stdout: --libexecdir=/usr/lib \ 2023-11-28T19:33:40.057 INFO:teuthology.orchestra.run.smithi203.stdout: --exec_prefix=/var/lib 2023-11-28T19:33:40.613 INFO:teuthology.orchestra.run.smithi203.stdout:checking build system type... x86_64-pc-linux-gnu 2023-11-28T19:33:40.613 INFO:teuthology.orchestra.run.smithi203.stdout:checking host system type... x86_64-pc-linux-gnu 2023-11-28T19:33:40.671 INFO:teuthology.orchestra.run.smithi203.stdout:checking how to print strings... printf 2023-11-28T19:33:40.671 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc... gcc 2023-11-28T19:33:40.903 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether the C compiler works... yes 2023-11-28T19:33:40.903 INFO:teuthology.orchestra.run.smithi203.stdout:checking for C compiler default output file name... a.out 2023-11-28T19:33:40.945 INFO:teuthology.orchestra.run.smithi203.stdout:checking for suffix of executables... 2023-11-28T19:33:41.039 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether we are cross compiling... no 2023-11-28T19:33:41.066 INFO:teuthology.orchestra.run.smithi203.stdout:checking for suffix of object files... o 2023-11-28T19:33:41.090 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether the compiler supports GNU C... yes 2023-11-28T19:33:41.113 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether gcc accepts -g... yes 2023-11-28T19:33:41.252 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc option to enable C11 features... none needed 2023-11-28T19:33:41.257 INFO:teuthology.orchestra.run.smithi203.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-11-28T19:33:41.262 INFO:teuthology.orchestra.run.smithi203.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-11-28T19:33:41.265 INFO:teuthology.orchestra.run.smithi203.stdout:checking for egrep... /usr/bin/grep -E 2023-11-28T19:33:41.268 INFO:teuthology.orchestra.run.smithi203.stdout:checking for fgrep... /usr/bin/grep -F 2023-11-28T19:33:41.275 INFO:teuthology.orchestra.run.smithi203.stdout:checking for ld used by gcc... /usr/bin/ld 2023-11-28T19:33:41.279 INFO:teuthology.orchestra.run.smithi203.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-11-28T19:33:41.294 INFO:teuthology.orchestra.run.smithi203.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-11-28T19:33:41.326 INFO:teuthology.orchestra.run.smithi203.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-11-28T19:33:41.326 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether ln -s works... yes 2023-11-28T19:33:41.335 INFO:teuthology.orchestra.run.smithi203.stdout:checking the maximum length of command line arguments... 1572864 2023-11-28T19:33:41.341 INFO:teuthology.orchestra.run.smithi203.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-11-28T19:33:41.341 INFO:teuthology.orchestra.run.smithi203.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-11-28T19:33:41.342 INFO:teuthology.orchestra.run.smithi203.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-11-28T19:33:41.342 INFO:teuthology.orchestra.run.smithi203.stdout:checking for objdump... objdump 2023-11-28T19:33:41.342 INFO:teuthology.orchestra.run.smithi203.stdout:checking how to recognize dependent libraries... pass_all 2023-11-28T19:33:41.343 INFO:teuthology.orchestra.run.smithi203.stdout:checking for dlltool... no 2023-11-28T19:33:41.343 INFO:teuthology.orchestra.run.smithi203.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-11-28T19:33:41.343 INFO:teuthology.orchestra.run.smithi203.stdout:checking for ar... ar 2023-11-28T19:33:41.387 INFO:teuthology.orchestra.run.smithi203.stdout:checking for archiver @FILE support... @ 2023-11-28T19:33:41.387 INFO:teuthology.orchestra.run.smithi203.stdout:checking for strip... strip 2023-11-28T19:33:41.388 INFO:teuthology.orchestra.run.smithi203.stdout:checking for ranlib... ranlib 2023-11-28T19:33:41.388 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gawk... gawk 2023-11-28T19:33:41.476 INFO:teuthology.orchestra.run.smithi203.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-11-28T19:33:41.479 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sysroot... no 2023-11-28T19:33:41.487 INFO:teuthology.orchestra.run.smithi203.stdout:checking for a working dd... /usr/bin/dd 2023-11-28T19:33:41.493 INFO:teuthology.orchestra.run.smithi203.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-11-28T19:33:41.513 INFO:teuthology.orchestra.run.smithi203.stdout:checking for mt... mt 2023-11-28T19:33:41.530 INFO:teuthology.orchestra.run.smithi203.stdout:checking if mt is a manifest tool... no 2023-11-28T19:33:41.557 INFO:teuthology.orchestra.run.smithi203.stdout:checking for stdio.h... yes 2023-11-28T19:33:41.601 INFO:teuthology.orchestra.run.smithi203.stdout:checking for stdlib.h... yes 2023-11-28T19:33:41.634 INFO:teuthology.orchestra.run.smithi203.stdout:checking for string.h... yes 2023-11-28T19:33:41.691 INFO:teuthology.orchestra.run.smithi203.stdout:checking for inttypes.h... yes 2023-11-28T19:33:41.724 INFO:teuthology.orchestra.run.smithi203.stdout:checking for stdint.h... yes 2023-11-28T19:33:41.761 INFO:teuthology.orchestra.run.smithi203.stdout:checking for strings.h... yes 2023-11-28T19:33:41.795 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/stat.h... yes 2023-11-28T19:33:41.826 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/types.h... yes 2023-11-28T19:33:41.879 INFO:teuthology.orchestra.run.smithi203.stdout:checking for unistd.h... yes 2023-11-28T19:33:41.916 INFO:teuthology.orchestra.run.smithi203.stdout:checking for dlfcn.h... yes 2023-11-28T19:33:41.922 INFO:teuthology.orchestra.run.smithi203.stdout:checking for objdir... .libs 2023-11-28T19:33:42.033 INFO:teuthology.orchestra.run.smithi203.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-11-28T19:33:42.033 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-11-28T19:33:42.061 INFO:teuthology.orchestra.run.smithi203.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-11-28T19:33:42.305 INFO:teuthology.orchestra.run.smithi203.stdout:checking if gcc static flag -static works... yes 2023-11-28T19:33:42.347 INFO:teuthology.orchestra.run.smithi203.stdout:checking if gcc supports -c -o file.o... yes 2023-11-28T19:33:42.347 INFO:teuthology.orchestra.run.smithi203.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-11-28T19:33:42.361 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-11-28T19:33:42.398 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether -lc should be explicitly linked in... no 2023-11-28T19:33:42.498 INFO:teuthology.orchestra.run.smithi203.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-11-28T19:33:42.498 INFO:teuthology.orchestra.run.smithi203.stdout:checking how to hardcode library paths into programs... immediate 2023-11-28T19:33:42.511 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether stripping libraries is possible... yes 2023-11-28T19:33:42.511 INFO:teuthology.orchestra.run.smithi203.stdout:checking if libtool supports shared libraries... yes 2023-11-28T19:33:42.511 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether to build shared libraries... yes 2023-11-28T19:33:42.512 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether to build static libraries... yes 2023-11-28T19:33:42.526 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc... (cached) gcc 2023-11-28T19:33:42.569 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-28T19:33:42.569 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-28T19:33:42.569 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-28T19:33:42.570 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gmake... /usr/bin/gmake 2023-11-28T19:33:42.570 INFO:teuthology.orchestra.run.smithi203.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2023-11-28T19:33:42.571 INFO:teuthology.orchestra.run.smithi203.stdout:checking for tar... /bin/tar 2023-11-28T19:33:42.571 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gzip... /bin/gzip 2023-11-28T19:33:42.595 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether gcc -MM is supported... yes 2023-11-28T19:33:42.595 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sort... /bin/sort 2023-11-28T19:33:42.595 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether ln -s works... yes 2023-11-28T19:33:42.596 INFO:teuthology.orchestra.run.smithi203.stdout:checking for rpm... no 2023-11-28T19:33:42.634 INFO:teuthology.orchestra.run.smithi203.stdout:checking for assert.h... yes 2023-11-28T19:33:42.675 INFO:teuthology.orchestra.run.smithi203.stdout:checking for bstring.h... no 2023-11-28T19:33:42.713 INFO:teuthology.orchestra.run.smithi203.stdout:checking for libgen.h... yes 2023-11-28T19:33:42.794 INFO:teuthology.orchestra.run.smithi203.stdout:checking for dirent.h... yes 2023-11-28T19:33:42.878 INFO:teuthology.orchestra.run.smithi203.stdout:checking for errno.h... yes 2023-11-28T19:33:42.917 INFO:teuthology.orchestra.run.smithi203.stdout:checking for malloc.h... yes 2023-11-28T19:33:42.958 INFO:teuthology.orchestra.run.smithi203.stdout:checking for uuid.h... no 2023-11-28T19:33:43.015 INFO:teuthology.orchestra.run.smithi203.stdout:checking for uuid/uuid.h... yes 2023-11-28T19:33:43.057 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/uuid.h... no 2023-11-28T19:33:43.097 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/file.h... yes 2023-11-28T19:33:43.136 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/fcntl.h... yes 2023-11-28T19:33:43.177 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/syssgi.h... no 2023-11-28T19:33:43.251 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/param.h... yes 2023-11-28T19:33:43.251 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/stat.h... (cached) yes 2023-11-28T19:33:43.289 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/statvfs.h... yes 2023-11-28T19:33:43.327 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/time.h... yes 2023-11-28T19:33:43.378 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/ioctl.h... yes 2023-11-28T19:33:43.418 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/wait.h... yes 2023-11-28T19:33:43.418 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/types.h... (cached) yes 2023-11-28T19:33:43.418 INFO:teuthology.orchestra.run.smithi203.stdout:checking for strings.h... (cached) yes 2023-11-28T19:33:43.455 INFO:teuthology.orchestra.run.smithi203.stdout:checking for err.h... yes 2023-11-28T19:33:43.493 INFO:teuthology.orchestra.run.smithi203.stdout:checking for linux/falloc.h... yes 2023-11-28T19:33:43.535 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/fs/xfs_fsops.h... no 2023-11-28T19:33:43.576 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/fs/xfs_itable.h... no 2023-11-28T19:33:43.626 INFO:teuthology.orchestra.run.smithi203.stdout:checking for xfs/platform_defs.h... no 2023-11-28T19:33:43.667 INFO:teuthology.orchestra.run.smithi203.stdout:checking for btrfs/ioctl.h... no 2023-11-28T19:33:43.708 INFO:teuthology.orchestra.run.smithi203.stdout:checking for cifs/ioctl.h... no 2023-11-28T19:33:43.748 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/mman.h... yes 2023-11-28T19:33:43.772 INFO:teuthology.orchestra.run.smithi203.stdout:checking for xfs/xfs_log_format.h... no 2023-11-28T19:33:43.830 INFO:teuthology.orchestra.run.smithi203.stdout:checking for uuid_compare... no 2023-11-28T19:33:43.879 INFO:teuthology.orchestra.run.smithi203.stdout:checking for uuid_compare in -luuid... yes 2023-11-28T19:33:44.004 INFO:teuthology.orchestra.run.smithi203.stdout:checking for xfs/xfs.h... yes 2023-11-28T19:33:44.027 INFO:teuthology.orchestra.run.smithi203.stdout:checking for xfs/libxfs.h... no 2023-11-28T19:33:44.076 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-11-28T19:33:44.108 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether xlog_assign_lsn is declared... no 2023-11-28T19:33:44.155 INFO:teuthology.orchestra.run.smithi203.stdout:checking for xfs/xqm.h... yes 2023-11-28T19:33:44.229 INFO:teuthology.orchestra.run.smithi203.stdout:checking xfsctl from xfs/xfs.h... ok 2023-11-28T19:33:44.269 INFO:teuthology.orchestra.run.smithi203.stdout:checking for xfs/handle.h... yes 2023-11-28T19:33:44.318 INFO:teuthology.orchestra.run.smithi203.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-11-28T19:33:44.364 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/acl.h... yes 2023-11-28T19:33:44.406 INFO:teuthology.orchestra.run.smithi203.stdout:checking for acl/libacl.h... yes 2023-11-28T19:33:44.455 INFO:teuthology.orchestra.run.smithi203.stdout:checking for acl_init in -lacl... yes 2023-11-28T19:33:44.496 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gdbm-ndbm.h... no 2023-11-28T19:33:44.537 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gdbm/ndbm.h... no 2023-11-28T19:33:44.578 INFO:teuthology.orchestra.run.smithi203.stdout:checking for ndbm.h... no 2023-11-28T19:33:44.619 INFO:teuthology.orchestra.run.smithi203.stdout:checking for libaio.h... yes 2023-11-28T19:33:44.694 INFO:teuthology.orchestra.run.smithi203.stdout:checking for liburing.h... yes 2023-11-28T19:33:44.742 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/capability.h... yes 2023-11-28T19:33:44.781 INFO:teuthology.orchestra.run.smithi203.stdout:checking for linux/fiemap.h... yes 2023-11-28T19:33:44.832 INFO:teuthology.orchestra.run.smithi203.stdout:checking for fallocate... yes 2023-11-28T19:33:44.885 INFO:teuthology.orchestra.run.smithi203.stdout:checking for open_by_handle_at... yes 2023-11-28T19:33:44.926 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/prctl.h... yes 2023-11-28T19:33:44.965 INFO:teuthology.orchestra.run.smithi203.stdout:checking for linux/fs.h... yes 2023-11-28T19:33:45.007 INFO:teuthology.orchestra.run.smithi203.stdout:checking for btrfsutil.h... no 2023-11-28T19:33:45.065 INFO:teuthology.orchestra.run.smithi203.stdout:checking for copy_file_range... yes 2023-11-28T19:33:45.122 INFO:teuthology.orchestra.run.smithi203.stdout:checking for SEEK_DATA... yes 2023-11-28T19:33:45.198 INFO:teuthology.orchestra.run.smithi203.stdout:checking for BMV_OF_SHARED... yes 2023-11-28T19:33:45.254 INFO:teuthology.orchestra.run.smithi203.stdout:checking for nftw... yes 2023-11-28T19:33:45.307 INFO:teuthology.orchestra.run.smithi203.stdout:checking for RLIMIT_NOFILE... yes 2023-11-28T19:33:45.352 INFO:teuthology.orchestra.run.smithi203.stdout:checking for FIEXCHANGE_RANGE... no 2023-11-28T19:33:45.404 INFO:teuthology.orchestra.run.smithi203.stdout:checking for renameat2... yes 2023-11-28T19:33:45.456 INFO:teuthology.orchestra.run.smithi203.stdout:checking for reallocarray... yes 2023-11-28T19:33:45.507 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct mount_attr... yes 2023-11-28T19:33:45.561 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct btrfs_qgroup_limit... yes 2023-11-28T19:33:45.614 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-11-28T19:33:45.667 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-11-28T19:33:45.720 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-11-28T19:33:45.773 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-11-28T19:33:45.827 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-11-28T19:33:45.880 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-11-28T19:33:45.919 INFO:teuthology.orchestra.run.smithi203.stdout:checking for linux/btrfs.h... yes 2023-11-28T19:33:45.960 INFO:teuthology.orchestra.run.smithi203.stdout:checking for linux/btrfs_tree.h... yes 2023-11-28T19:33:45.988 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-11-28T19:33:46.015 INFO:teuthology.orchestra.run.smithi203.stdout:configure: creating ./config.status 2023-11-28T19:33:46.851 INFO:teuthology.orchestra.run.smithi203.stdout:config.status: creating include/builddefs 2023-11-28T19:33:46.878 INFO:teuthology.orchestra.run.smithi203.stdout:config.status: creating include/config.h 2023-11-28T19:33:46.900 INFO:teuthology.orchestra.run.smithi203.stdout:config.status: executing libtool commands 2023-11-28T19:33:46.969 INFO:teuthology.orchestra.run.smithi203.stdout:Building include 2023-11-28T19:33:46.975 INFO:teuthology.orchestra.run.smithi203.stdout:Building lib 2023-11-28T19:33:46.981 INFO:teuthology.orchestra.run.smithi203.stdout: [LTDEP] 2023-11-28T19:33:47.174 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] dataascii.lo 2023-11-28T19:33:47.321 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] databin.lo 2023-11-28T19:33:47.508 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] datapid.lo 2023-11-28T19:33:47.647 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] file_lock.lo 2023-11-28T19:33:47.837 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] forker.lo 2023-11-28T19:33:48.026 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] pattern.lo 2023-11-28T19:33:48.171 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] open_flags.lo 2023-11-28T19:33:48.348 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] random_range.lo 2023-11-28T19:33:48.606 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] string_to_tokens.lo 2023-11-28T19:33:48.735 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] str_to_bytes.lo 2023-11-28T19:33:48.906 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] tlibio.lo 2023-11-28T19:33:49.191 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] write_log.lo 2023-11-28T19:33:49.278 INFO:teuthology.orchestra.run.smithi203.stderr:write_log.c: In function 'wlog_record_write': 2023-11-28T19:33:49.278 INFO:teuthology.orchestra.run.smithi203.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:33:49.278 INFO:teuthology.orchestra.run.smithi203.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-11-28T19:33:49.278 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:33:49.278 INFO:teuthology.orchestra.run.smithi203.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:33:49.279 INFO:teuthology.orchestra.run.smithi203.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-11-28T19:33:49.279 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:33:49.481 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] random.lo 2023-11-28T19:33:49.610 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] 2023-11-28T19:33:49.734 INFO:teuthology.orchestra.run.smithi203.stdout:Building ltp 2023-11-28T19:33:49.739 INFO:teuthology.orchestra.run.smithi203.stdout: [DEP] 2023-11-28T19:33:49.945 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] doio 2023-11-28T19:33:50.683 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fsstress 2023-11-28T19:33:52.234 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fsx 2023-11-28T19:33:53.063 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] growfiles 2023-11-28T19:33:53.634 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] iogen 2023-11-28T19:33:53.800 INFO:teuthology.orchestra.run.smithi203.stderr:iogen.c: In function 'main': 2023-11-28T19:33:53.800 INFO:teuthology.orchestra.run.smithi203.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:33:53.800 INFO:teuthology.orchestra.run.smithi203.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-11-28T19:33:53.800 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:33:53.802 INFO:teuthology.orchestra.run.smithi203.stderr:iogen.c: In function 'parse_cmdline': 2023-11-28T19:33:53.802 INFO:teuthology.orchestra.run.smithi203.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:33:53.803 INFO:teuthology.orchestra.run.smithi203.stderr: 1535 | getcwd(fptr->f_path, 2023-11-28T19:33:53.803 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:33:53.803 INFO:teuthology.orchestra.run.smithi203.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-11-28T19:33:53.803 INFO:teuthology.orchestra.run.smithi203.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:33:54.083 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-stress 2023-11-28T19:33:54.245 INFO:teuthology.orchestra.run.smithi203.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-11-28T19:33:54.245 INFO:teuthology.orchestra.run.smithi203.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:33:54.245 INFO:teuthology.orchestra.run.smithi203.stderr: 1013 | ftruncate(fd, total_ram); 2023-11-28T19:33:54.245 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:33:54.562 INFO:teuthology.orchestra.run.smithi203.stdout:Building src 2023-11-28T19:33:54.571 INFO:teuthology.orchestra.run.smithi203.stdout: [DEP] 2023-11-28T19:33:57.036 INFO:teuthology.orchestra.run.smithi203.stdout: [DEP] 2023-11-28T19:33:57.083 INFO:teuthology.orchestra.run.smithi203.stdout: [DEP] 2023-11-28T19:33:57.097 INFO:teuthology.orchestra.run.smithi203.stdout: [DEP] 2023-11-28T19:33:57.426 INFO:teuthology.orchestra.run.smithi203.stdout: [DEP] 2023-11-28T19:33:57.462 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] dirstress 2023-11-28T19:33:57.754 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fill 2023-11-28T19:33:57.947 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fill2 2023-11-28T19:33:58.226 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] getpagesize 2023-11-28T19:33:58.401 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] holes 2023-11-28T19:33:58.643 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] lstat64 2023-11-28T19:33:58.870 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] nametest 2023-11-28T19:33:59.034 INFO:teuthology.orchestra.run.smithi203.stderr:nametest.c: In function 'main': 2023-11-28T19:33:59.035 INFO:teuthology.orchestra.run.smithi203.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:33:59.035 INFO:teuthology.orchestra.run.smithi203.stderr: 236 | write(1, "\n", 1); 2023-11-28T19:33:59.035 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T19:33:59.035 INFO:teuthology.orchestra.run.smithi203.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:33:59.035 INFO:teuthology.orchestra.run.smithi203.stderr: 238 | write(1, ".", 1); 2023-11-28T19:33:59.035 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T19:33:59.035 INFO:teuthology.orchestra.run.smithi203.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:33:59.035 INFO:teuthology.orchestra.run.smithi203.stderr: 288 | write(1, ".", 1); 2023-11-28T19:33:59.035 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T19:33:59.158 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] permname 2023-11-28T19:33:59.405 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] randholes 2023-11-28T19:33:59.700 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] runas 2023-11-28T19:33:59.920 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] truncfile 2023-11-28T19:34:00.146 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] usemem 2023-11-28T19:34:00.338 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] mmapcat 2023-11-28T19:34:00.486 INFO:teuthology.orchestra.run.smithi203.stderr:mmapcat.c: In function 'main': 2023-11-28T19:34:00.486 INFO:teuthology.orchestra.run.smithi203.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:00.486 INFO:teuthology.orchestra.run.smithi203.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-11-28T19:34:00.486 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:00.529 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] append_reader 2023-11-28T19:34:00.726 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] append_writer 2023-11-28T19:34:00.921 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] dirperf 2023-11-28T19:34:01.190 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] metaperf 2023-11-28T19:34:01.345 INFO:teuthology.orchestra.run.smithi203.stderr:metaperf.c: In function 'crfiles': 2023-11-28T19:34:01.345 INFO:teuthology.orchestra.run.smithi203.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:01.346 INFO:teuthology.orchestra.run.smithi203.stderr: 166 | write(fd, buf, fsize); 2023-11-28T19:34:01.346 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:01.347 INFO:teuthology.orchestra.run.smithi203.stderr:metaperf.c: In function 't_linkun': 2023-11-28T19:34:01.347 INFO:teuthology.orchestra.run.smithi203.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:01.347 INFO:teuthology.orchestra.run.smithi203.stderr: 454 | link("a", *fnp); 2023-11-28T19:34:01.347 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~ 2023-11-28T19:34:01.347 INFO:teuthology.orchestra.run.smithi203.stderr:metaperf.c: In function 't_chown': 2023-11-28T19:34:01.347 INFO:teuthology.orchestra.run.smithi203.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:01.347 INFO:teuthology.orchestra.run.smithi203.stderr: 404 | chown(*fnp, 2, -1); 2023-11-28T19:34:01.347 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:01.348 INFO:teuthology.orchestra.run.smithi203.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:01.348 INFO:teuthology.orchestra.run.smithi203.stderr: 406 | chown(*fnp, 1, -1); 2023-11-28T19:34:01.348 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:01.348 INFO:teuthology.orchestra.run.smithi203.stderr:metaperf.c: In function 'i_chown': 2023-11-28T19:34:01.348 INFO:teuthology.orchestra.run.smithi203.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:01.348 INFO:teuthology.orchestra.run.smithi203.stderr: 291 | chown(*fnp, 1, -1); 2023-11-28T19:34:01.348 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:01.348 INFO:teuthology.orchestra.run.smithi203.stderr:metaperf.c: In function 'main': 2023-11-28T19:34:01.348 INFO:teuthology.orchestra.run.smithi203.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:01.348 INFO:teuthology.orchestra.run.smithi203.stderr: 152 | chdir(".."); 2023-11-28T19:34:01.348 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~ 2023-11-28T19:34:01.514 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] devzero 2023-11-28T19:34:01.737 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] feature 2023-11-28T19:34:02.012 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] alloc 2023-11-28T19:34:02.175 INFO:teuthology.orchestra.run.smithi203.stderr:alloc.c: In function 'main': 2023-11-28T19:34:02.175 INFO:teuthology.orchestra.run.smithi203.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:02.175 INFO:teuthology.orchestra.run.smithi203.stderr: 247 | mkstemp(tmpfile); 2023-11-28T19:34:02.175 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T19:34:02.271 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fault 2023-11-28T19:34:02.479 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fstest 2023-11-28T19:34:02.766 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_access_root 2023-11-28T19:34:02.914 INFO:teuthology.orchestra.run.smithi203.stderr:t_access_root.c: In function 'main': 2023-11-28T19:34:02.914 INFO:teuthology.orchestra.run.smithi203.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:02.914 INFO:teuthology.orchestra.run.smithi203.stderr: 55 | system(cmd); 2023-11-28T19:34:02.914 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~ 2023-11-28T19:34:02.965 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] godown 2023-11-28T19:34:03.181 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] resvtest 2023-11-28T19:34:03.414 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] writemod 2023-11-28T19:34:03.601 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] writev_on_pagefault 2023-11-28T19:34:03.806 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] makeextents 2023-11-28T19:34:04.031 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] itrash 2023-11-28T19:34:04.226 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] rename 2023-11-28T19:34:04.404 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] multi_open_unlink 2023-11-28T19:34:04.615 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] unwritten_sync 2023-11-28T19:34:04.843 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] genhashnames 2023-11-28T19:34:05.075 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_holes 2023-11-28T19:34:05.265 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_mmap_writev 2023-11-28T19:34:05.457 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_truncate_cmtime 2023-11-28T19:34:05.658 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] dirhash_collide 2023-11-28T19:34:05.884 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_rename_overwrite 2023-11-28T19:34:05.989 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:34:05.993 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:34:05.997 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:34:06.066 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] holetest 2023-11-28T19:34:06.223 INFO:teuthology.orchestra.run.smithi203.stderr:holetest.c: In function 'pt_write_marker': 2023-11-28T19:34:06.223 INFO:teuthology.orchestra.run.smithi203.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:06.223 INFO:teuthology.orchestra.run.smithi203.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-11-28T19:34:06.223 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:06.338 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_truncate_self 2023-11-28T19:34:06.520 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] af_unix 2023-11-28T19:34:06.716 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_mmap_stale_pmd 2023-11-28T19:34:06.866 INFO:teuthology.orchestra.run.smithi203.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-11-28T19:34:06.867 INFO:teuthology.orchestra.run.smithi203.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:06.867 INFO:teuthology.orchestra.run.smithi203.stderr: 42 | ftruncate(fd, 0); 2023-11-28T19:34:06.867 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T19:34:06.867 INFO:teuthology.orchestra.run.smithi203.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:06.867 INFO:teuthology.orchestra.run.smithi203.stderr: 43 | ftruncate(fd, MiB(4)); 2023-11-28T19:34:06.867 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:06.868 INFO:teuthology.orchestra.run.smithi203.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:06.868 INFO:teuthology.orchestra.run.smithi203.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-11-28T19:34:06.868 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:06.913 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_mmap_cow_race 2023-11-28T19:34:07.068 INFO:teuthology.orchestra.run.smithi203.stderr:t_mmap_cow_race.c: In function 'main': 2023-11-28T19:34:07.069 INFO:teuthology.orchestra.run.smithi203.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:07.069 INFO:teuthology.orchestra.run.smithi203.stderr: 61 | ftruncate(fd, 0); 2023-11-28T19:34:07.069 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T19:34:07.069 INFO:teuthology.orchestra.run.smithi203.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:07.069 INFO:teuthology.orchestra.run.smithi203.stderr: 62 | ftruncate(fd, MiB(2)); 2023-11-28T19:34:07.069 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:07.124 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_mmap_fallocate 2023-11-28T19:34:07.319 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fsync-err 2023-11-28T19:34:07.549 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_mmap_write_ro 2023-11-28T19:34:07.746 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_ext4_dax_journal_corruption 2023-11-28T19:34:07.897 INFO:teuthology.orchestra.run.smithi203.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-11-28T19:34:07.897 INFO:teuthology.orchestra.run.smithi203.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:07.897 INFO:teuthology.orchestra.run.smithi203.stderr: 61 | ftruncate(fd, 0); 2023-11-28T19:34:07.897 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T19:34:07.950 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_ext4_dax_inline_corruption 2023-11-28T19:34:08.150 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_ofd_locks 2023-11-28T19:34:08.391 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_mmap_collision 2023-11-28T19:34:08.637 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] mmap-write-concurrent 2023-11-28T19:34:08.851 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_get_file_time 2023-11-28T19:34:09.250 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_create_short_dirs 2023-11-28T19:34:09.467 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_create_long_dirs 2023-11-28T19:34:09.678 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_enospc 2023-11-28T19:34:09.930 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_mmap_writev_overlap 2023-11-28T19:34:10.146 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] checkpoint_journal 2023-11-28T19:34:10.346 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] mmap-rw-fault 2023-11-28T19:34:10.576 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] allocstale 2023-11-28T19:34:10.791 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_mmap_cow_memory_failure 2023-11-28T19:34:11.007 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fake-dump-rootino 2023-11-28T19:34:11.200 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] dio-buf-fault 2023-11-28T19:34:11.398 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] rewinddir-test 2023-11-28T19:34:11.612 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfsctl 2023-11-28T19:34:11.851 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] bstat 2023-11-28T19:34:12.107 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_mtab 2023-11-28T19:34:12.260 INFO:teuthology.orchestra.run.smithi203.stderr:t_mtab.c: In function 'update_mtab': 2023-11-28T19:34:12.261 INFO:teuthology.orchestra.run.smithi203.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:12.261 INFO:teuthology.orchestra.run.smithi203.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-11-28T19:34:12.261 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:12.341 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] getdevicesize 2023-11-28T19:34:12.525 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] preallo_rw_pattern_reader 2023-11-28T19:34:12.686 INFO:teuthology.orchestra.run.smithi203.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-11-28T19:34:12.686 INFO:teuthology.orchestra.run.smithi203.stderr:iopat.c: In function 'main': 2023-11-28T19:34:12.686 INFO:teuthology.orchestra.run.smithi203.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:12.686 INFO:teuthology.orchestra.run.smithi203.stderr: 38 | read(fd, &x, 1048576); 2023-11-28T19:34:12.686 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:12.730 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] preallo_rw_pattern_writer 2023-11-28T19:34:12.889 INFO:teuthology.orchestra.run.smithi203.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-11-28T19:34:12.889 INFO:teuthology.orchestra.run.smithi203.stderr:iopat.c: In function 'main': 2023-11-28T19:34:12.889 INFO:teuthology.orchestra.run.smithi203.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:12.889 INFO:teuthology.orchestra.run.smithi203.stderr: 34 | write(fd, &x, 1048576); 2023-11-28T19:34:12.889 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:12.933 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] ftrunc 2023-11-28T19:34:13.124 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] trunc 2023-11-28T19:34:13.333 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fs_perms 2023-11-28T19:34:13.486 INFO:teuthology.orchestra.run.smithi203.stderr:fs_perms.c: In function 'main': 2023-11-28T19:34:13.487 INFO:teuthology.orchestra.run.smithi203.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:13.487 INFO:teuthology.orchestra.run.smithi203.stderr: 54 | system("rm -f test.file"); 2023-11-28T19:34:13.487 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:13.487 INFO:teuthology.orchestra.run.smithi203.stderr:fs_perms.c: In function 'testsetup': 2023-11-28T19:34:13.487 INFO:teuthology.orchestra.run.smithi203.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:13.487 INFO:teuthology.orchestra.run.smithi203.stderr: 67 | system("cp testx.file test.file"); 2023-11-28T19:34:13.487 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:13.487 INFO:teuthology.orchestra.run.smithi203.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:13.487 INFO:teuthology.orchestra.run.smithi203.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-11-28T19:34:13.487 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:13.488 INFO:teuthology.orchestra.run.smithi203.stderr:fs_perms.c: In function 'testfperm': 2023-11-28T19:34:13.488 INFO:teuthology.orchestra.run.smithi203.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:13.488 INFO:teuthology.orchestra.run.smithi203.stderr: 123 | seteuid(0); 2023-11-28T19:34:13.488 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~ 2023-11-28T19:34:13.488 INFO:teuthology.orchestra.run.smithi203.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:13.488 INFO:teuthology.orchestra.run.smithi203.stderr: 124 | setegid(0); 2023-11-28T19:34:13.488 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~ 2023-11-28T19:34:13.541 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] testx 2023-11-28T19:34:13.711 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] looptest 2023-11-28T19:34:13.951 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] locktest 2023-11-28T19:34:14.317 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] unwritten_mmap 2023-11-28T19:34:14.525 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] bulkstat_unlink_test 2023-11-28T19:34:14.685 INFO:teuthology.orchestra.run.smithi203.stderr:bulkstat_unlink_test.c: In function 'main': 2023-11-28T19:34:14.685 INFO:teuthology.orchestra.run.smithi203.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:14.685 INFO:teuthology.orchestra.run.smithi203.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-11-28T19:34:14.685 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:14.686 INFO:teuthology.orchestra.run.smithi203.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:14.686 INFO:teuthology.orchestra.run.smithi203.stderr: 178 | system(fname); 2023-11-28T19:34:14.686 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~ 2023-11-28T19:34:14.772 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] deduperace 2023-11-28T19:34:15.016 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] bulkstat_unlink_test_modified 2023-11-28T19:34:15.177 INFO:teuthology.orchestra.run.smithi203.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-11-28T19:34:15.177 INFO:teuthology.orchestra.run.smithi203.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.178 INFO:teuthology.orchestra.run.smithi203.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-11-28T19:34:15.178 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.178 INFO:teuthology.orchestra.run.smithi203.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.178 INFO:teuthology.orchestra.run.smithi203.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-11-28T19:34:15.178 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.178 INFO:teuthology.orchestra.run.smithi203.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.178 INFO:teuthology.orchestra.run.smithi203.stderr: 185 | system(fname); 2023-11-28T19:34:15.178 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~ 2023-11-28T19:34:15.262 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_dir_offset 2023-11-28T19:34:15.453 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_futimens 2023-11-28T19:34:15.634 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_immutable 2023-11-28T19:34:15.809 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c: In function 'create_test_area': 2023-11-28T19:34:15.809 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.809 INFO:teuthology.orchestra.run.smithi203.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-11-28T19:34:15.809 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.810 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.810 INFO:teuthology.orchestra.run.smithi203.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-11-28T19:34:15.810 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.814 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c: In function 'remove_test_area': 2023-11-28T19:34:15.814 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.814 INFO:teuthology.orchestra.run.smithi203.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-11-28T19:34:15.814 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.814 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.814 INFO:teuthology.orchestra.run.smithi203.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-11-28T19:34:15.814 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.814 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.814 INFO:teuthology.orchestra.run.smithi203.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-11-28T19:34:15.815 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.815 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.815 INFO:teuthology.orchestra.run.smithi203.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-11-28T19:34:15.815 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.815 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.815 INFO:teuthology.orchestra.run.smithi203.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-11-28T19:34:15.815 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.816 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.816 INFO:teuthology.orchestra.run.smithi203.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-11-28T19:34:15.816 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.816 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c: In function 'check_test_area': 2023-11-28T19:34:15.822 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.822 INFO:teuthology.orchestra.run.smithi203.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-11-28T19:34:15.822 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.822 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.822 INFO:teuthology.orchestra.run.smithi203.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-11-28T19:34:15.822 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.822 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.823 INFO:teuthology.orchestra.run.smithi203.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-11-28T19:34:15.823 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.823 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.823 INFO:teuthology.orchestra.run.smithi203.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-11-28T19:34:15.823 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.823 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.823 INFO:teuthology.orchestra.run.smithi203.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-11-28T19:34:15.823 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.823 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.824 INFO:teuthology.orchestra.run.smithi203.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-11-28T19:34:15.824 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.824 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.824 INFO:teuthology.orchestra.run.smithi203.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-11-28T19:34:15.824 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.824 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.824 INFO:teuthology.orchestra.run.smithi203.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-11-28T19:34:15.824 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.824 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.825 INFO:teuthology.orchestra.run.smithi203.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-11-28T19:34:15.825 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.825 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c: In function 'test_immutable': 2023-11-28T19:34:15.825 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.825 INFO:teuthology.orchestra.run.smithi203.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-11-28T19:34:15.825 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.825 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.825 INFO:teuthology.orchestra.run.smithi203.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-11-28T19:34:15.825 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.825 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.826 INFO:teuthology.orchestra.run.smithi203.stderr: 408 | chown(path, 0, 0); 2023-11-28T19:34:15.826 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.826 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.826 INFO:teuthology.orchestra.run.smithi203.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-11-28T19:34:15.826 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.826 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.826 INFO:teuthology.orchestra.run.smithi203.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-11-28T19:34:15.826 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.827 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.827 INFO:teuthology.orchestra.run.smithi203.stderr: 553 | chown(path, 0, 0); 2023-11-28T19:34:15.827 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.827 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.827 INFO:teuthology.orchestra.run.smithi203.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-11-28T19:34:15.827 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.827 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.827 INFO:teuthology.orchestra.run.smithi203.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-11-28T19:34:15.827 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.827 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.828 INFO:teuthology.orchestra.run.smithi203.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-11-28T19:34:15.828 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.828 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.828 INFO:teuthology.orchestra.run.smithi203.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-11-28T19:34:15.828 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.828 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.828 INFO:teuthology.orchestra.run.smithi203.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-11-28T19:34:15.828 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.829 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.829 INFO:teuthology.orchestra.run.smithi203.stderr: 653 | chown(path, 0, 0); 2023-11-28T19:34:15.829 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.829 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.829 INFO:teuthology.orchestra.run.smithi203.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-11-28T19:34:15.829 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.829 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.829 INFO:teuthology.orchestra.run.smithi203.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-11-28T19:34:15.830 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.830 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.830 INFO:teuthology.orchestra.run.smithi203.stderr: 705 | chown(path, 0, 0); 2023-11-28T19:34:15.830 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.830 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.830 INFO:teuthology.orchestra.run.smithi203.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-11-28T19:34:15.830 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.830 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c: In function 'test_append': 2023-11-28T19:34:15.830 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.831 INFO:teuthology.orchestra.run.smithi203.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-11-28T19:34:15.831 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.831 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.831 INFO:teuthology.orchestra.run.smithi203.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-11-28T19:34:15.831 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.831 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.831 INFO:teuthology.orchestra.run.smithi203.stderr: 1051 | chown(path, 0, 0); 2023-11-28T19:34:15.831 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.831 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.832 INFO:teuthology.orchestra.run.smithi203.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-11-28T19:34:15.832 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.832 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.832 INFO:teuthology.orchestra.run.smithi203.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-11-28T19:34:15.832 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.832 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.832 INFO:teuthology.orchestra.run.smithi203.stderr: 1516 | chown(path, 0, 0); 2023-11-28T19:34:15.832 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.833 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.833 INFO:teuthology.orchestra.run.smithi203.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-11-28T19:34:15.833 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.833 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.833 INFO:teuthology.orchestra.run.smithi203.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-11-28T19:34:15.833 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.833 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.834 INFO:teuthology.orchestra.run.smithi203.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-11-28T19:34:15.834 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.834 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.834 INFO:teuthology.orchestra.run.smithi203.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-11-28T19:34:15.834 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.834 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.834 INFO:teuthology.orchestra.run.smithi203.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-11-28T19:34:15.834 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.835 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.835 INFO:teuthology.orchestra.run.smithi203.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-11-28T19:34:15.835 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.835 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.835 INFO:teuthology.orchestra.run.smithi203.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-11-28T19:34:15.835 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.835 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.835 INFO:teuthology.orchestra.run.smithi203.stderr: 1618 | chown(path, 0, 0); 2023-11-28T19:34:15.836 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.836 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.836 INFO:teuthology.orchestra.run.smithi203.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-11-28T19:34:15.836 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.836 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.836 INFO:teuthology.orchestra.run.smithi203.stderr: 1644 | chown(path, 0, 0); 2023-11-28T19:34:15.836 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.836 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.836 INFO:teuthology.orchestra.run.smithi203.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-11-28T19:34:15.837 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.837 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.837 INFO:teuthology.orchestra.run.smithi203.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-11-28T19:34:15.837 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.837 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.837 INFO:teuthology.orchestra.run.smithi203.stderr: 1692 | chown(path, 0, 0); 2023-11-28T19:34:15.837 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~ 2023-11-28T19:34:15.837 INFO:teuthology.orchestra.run.smithi203.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:15.838 INFO:teuthology.orchestra.run.smithi203.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-11-28T19:34:15.838 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:16.382 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] stale_handle 2023-11-28T19:34:16.542 INFO:teuthology.orchestra.run.smithi203.stderr:stale_handle.c: In function 'main': 2023-11-28T19:34:16.542 INFO:teuthology.orchestra.run.smithi203.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:16.542 INFO:teuthology.orchestra.run.smithi203.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-11-28T19:34:16.542 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:16.600 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] pwrite_mmap_blocked 2023-11-28T19:34:16.797 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_dir_offset2 2023-11-28T19:34:17.036 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] seek_sanity_test 2023-11-28T19:34:17.204 INFO:teuthology.orchestra.run.smithi203.stderr:seek_sanity_test.c: In function 'test18': 2023-11-28T19:34:17.205 INFO:teuthology.orchestra.run.smithi203.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:17.205 INFO:teuthology.orchestra.run.smithi203.stderr: 460 | ftruncate(fd, 0); 2023-11-28T19:34:17.205 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T19:34:17.206 INFO:teuthology.orchestra.run.smithi203.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-11-28T19:34:17.206 INFO:teuthology.orchestra.run.smithi203.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:17.207 INFO:teuthology.orchestra.run.smithi203.stderr: 1207 | ftruncate(fd, 0); 2023-11-28T19:34:17.207 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T19:34:17.207 INFO:teuthology.orchestra.run.smithi203.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:17.207 INFO:teuthology.orchestra.run.smithi203.stderr: 1256 | ftruncate(fd, 0); 2023-11-28T19:34:17.207 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T19:34:17.208 INFO:teuthology.orchestra.run.smithi203.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-11-28T19:34:17.208 INFO:teuthology.orchestra.run.smithi203.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:17.208 INFO:teuthology.orchestra.run.smithi203.stderr: 88 | ftruncate(fd, 0); 2023-11-28T19:34:17.208 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T19:34:17.208 INFO:teuthology.orchestra.run.smithi203.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:17.209 INFO:teuthology.orchestra.run.smithi203.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-11-28T19:34:17.209 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:17.209 INFO:teuthology.orchestra.run.smithi203.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:17.209 INFO:teuthology.orchestra.run.smithi203.stderr: 98 | ftruncate(fd, 0); 2023-11-28T19:34:17.209 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~ 2023-11-28T19:34:17.209 INFO:teuthology.orchestra.run.smithi203.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:17.209 INFO:teuthology.orchestra.run.smithi203.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-11-28T19:34:17.209 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:17.526 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] seek_copy_test 2023-11-28T19:34:17.749 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_readdir_1 2023-11-28T19:34:17.898 INFO:teuthology.orchestra.run.smithi203.stderr:t_readdir_1.c: In function 'main': 2023-11-28T19:34:17.898 INFO:teuthology.orchestra.run.smithi203.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:17.899 INFO:teuthology.orchestra.run.smithi203.stderr: 30 | read(fd, buf, 100); 2023-11-28T19:34:17.899 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:17.940 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_readdir_2 2023-11-28T19:34:18.134 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fsync-tester 2023-11-28T19:34:18.286 INFO:teuthology.orchestra.run.smithi203.stderr:fsync-tester.c: In function 'main': 2023-11-28T19:34:18.286 INFO:teuthology.orchestra.run.smithi203.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:18.286 INFO:teuthology.orchestra.run.smithi203.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-11-28T19:34:18.286 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:18.286 INFO:teuthology.orchestra.run.smithi203.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:18.286 INFO:teuthology.orchestra.run.smithi203.stderr: 541 | system("reboot -fn"); 2023-11-28T19:34:18.286 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:18.287 INFO:teuthology.orchestra.run.smithi203.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-11-28T19:34:18.287 INFO:teuthology.orchestra.run.smithi203.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:18.287 INFO:teuthology.orchestra.run.smithi203.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-11-28T19:34:18.287 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:18.441 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] nsexec 2023-11-28T19:34:18.668 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] cloner 2023-11-28T19:34:18.892 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] renameat2 2023-11-28T19:34:19.102 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_getcwd 2023-11-28T19:34:19.253 INFO:teuthology.orchestra.run.smithi203.stderr:t_getcwd.c: In function 'test_getcwd': 2023-11-28T19:34:19.253 INFO:teuthology.orchestra.run.smithi203.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:19.253 INFO:teuthology.orchestra.run.smithi203.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-11-28T19:34:19.253 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:19.308 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] e4compact 2023-11-28T19:34:19.558 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] test-nextquota 2023-11-28T19:34:19.779 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] punch-alternating 2023-11-28T19:34:19.997 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] attr-list-by-handle-cursor-test 2023-11-28T19:34:20.210 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] listxattr 2023-11-28T19:34:20.398 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] dio-interleaved 2023-11-28T19:34:20.605 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_dir_type 2023-11-28T19:34:20.804 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] dio-invalidate-cache 2023-11-28T19:34:20.955 INFO:teuthology.orchestra.run.smithi203.stderr:dio-invalidate-cache.c: In function 'main': 2023-11-28T19:34:20.956 INFO:teuthology.orchestra.run.smithi203.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:20.956 INFO:teuthology.orchestra.run.smithi203.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-11-28T19:34:20.956 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:21.055 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] stat_test 2023-11-28T19:34:21.396 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_encrypted_d_revalidate 2023-11-28T19:34:21.605 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] attr_replace_test 2023-11-28T19:34:21.815 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] swapon 2023-11-28T19:34:22.027 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] mkswap 2023-11-28T19:34:22.222 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_attr_corruption 2023-11-28T19:34:22.415 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_open_tmpfiles 2023-11-28T19:34:22.640 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fscrypt-crypt-util 2023-11-28T19:34:23.349 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] bulkstat_null_ocount 2023-11-28T19:34:23.553 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] splice-test 2023-11-28T19:34:23.781 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] chprojid_fail 2023-11-28T19:34:23.990 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] detached_mounts_propagation 2023-11-28T19:34:24.223 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] ext4_resize 2023-11-28T19:34:24.418 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_readdir_3 2023-11-28T19:34:24.658 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] splice2pipe 2023-11-28T19:34:24.808 INFO:teuthology.orchestra.run.smithi203.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-11-28T19:34:24.808 INFO:teuthology.orchestra.run.smithi203.stderr:splice2pipe.c:57:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:24.808 INFO:teuthology.orchestra.run.smithi203.stderr: 57 | write(p[1], buffer, n); 2023-11-28T19:34:24.808 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:24.808 INFO:teuthology.orchestra.run.smithi203.stderr:splice2pipe.c:65:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:24.808 INFO:teuthology.orchestra.run.smithi203.stderr: 65 | read(p[0], buffer, n); 2023-11-28T19:34:24.809 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:24.866 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] uuid_ioctl 2023-11-28T19:34:25.068 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fiemap-tester 2023-11-28T19:34:25.379 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_stripealign 2023-11-28T19:34:25.579 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] open_by_handle 2023-11-28T19:34:25.875 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] t_mmap_dio 2023-11-28T19:34:26.084 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] uring_read_fault 2023-11-28T19:34:26.314 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfsfind 2023-11-28T19:34:26.557 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fssum 2023-11-28T19:34:27.049 INFO:teuthology.orchestra.run.smithi203.stdout:Building log-writes 2023-11-28T19:34:27.058 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] replay-log 2023-11-28T19:34:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:Building perf 2023-11-28T19:34:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:Building aio-dio-regress 2023-11-28T19:34:27.457 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aiocp 2023-11-28T19:34:27.737 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-dio-append-write-fallocate-race 2023-11-28T19:34:27.958 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-dio-append-write-read-race 2023-11-28T19:34:28.187 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-dio-cow-race 2023-11-28T19:34:28.392 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-dio-cycle-write 2023-11-28T19:34:28.542 INFO:teuthology.orchestra.run.smithi203.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-11-28T19:34:28.542 INFO:teuthology.orchestra.run.smithi203.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:28.543 INFO:teuthology.orchestra.run.smithi203.stderr: 83 | ftruncate(fd, buf_size); 2023-11-28T19:34:28.543 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:28.632 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-dio-eof-race 2023-11-28T19:34:28.867 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-dio-extend-stat 2023-11-28T19:34:29.082 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-dio-fcntl-race 2023-11-28T19:34:29.294 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-dio-hole-filling-race 2023-11-28T19:34:29.495 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-dio-invalidate-failure 2023-11-28T19:34:29.705 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-dio-invalidate-readahead 2023-11-28T19:34:29.921 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aiodio_sparse2 2023-11-28T19:34:30.072 INFO:teuthology.orchestra.run.smithi203.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-11-28T19:34:30.072 INFO:teuthology.orchestra.run.smithi203.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:30.072 INFO:teuthology.orchestra.run.smithi203.stderr: 111 | ftruncate(fd, filesize); 2023-11-28T19:34:30.072 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:30.072 INFO:teuthology.orchestra.run.smithi203.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-11-28T19:34:30.072 INFO:teuthology.orchestra.run.smithi203.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-11-28T19:34:30.073 INFO:teuthology.orchestra.run.smithi203.stderr: 274 | ftruncate(fd, size); 2023-11-28T19:34:30.073 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-11-28T19:34:30.194 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-dio-subblock-eof-read 2023-11-28T19:34:30.389 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-dio-write-verify 2023-11-28T19:34:30.638 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-11-28T19:34:30.819 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-11-28T19:34:31.001 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] aio-last-ref-held-by-io 2023-11-28T19:34:31.229 INFO:teuthology.orchestra.run.smithi203.stdout:Building vfs 2023-11-28T19:34:31.238 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] vfstest 2023-11-28T19:34:35.526 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] mount-idmapped 2023-11-28T19:34:39.129 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:34:39.133 INFO:teuthology.orchestra.run.smithi203.stdout:Building m4 2023-11-28T19:34:39.133 INFO:teuthology.orchestra.run.smithi203.stdout:Building common 2023-11-28T19:34:39.133 INFO:teuthology.orchestra.run.smithi203.stdout:Building tests 2023-11-28T19:34:39.133 INFO:teuthology.orchestra.run.smithi203.stdout:Building btrfs 2023-11-28T19:34:39.133 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/btrfs/group.list 2023-11-28T19:34:39.133 INFO:teuthology.orchestra.run.smithi203.stdout:Building ceph 2023-11-28T19:34:39.133 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/ceph/group.list 2023-11-28T19:34:39.133 INFO:teuthology.orchestra.run.smithi203.stdout:Building cifs 2023-11-28T19:34:39.133 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/cifs/group.list 2023-11-28T19:34:39.134 INFO:teuthology.orchestra.run.smithi203.stdout:Building ext4 2023-11-28T19:34:39.134 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/ext4/group.list 2023-11-28T19:34:39.134 INFO:teuthology.orchestra.run.smithi203.stdout:Building f2fs 2023-11-28T19:34:39.134 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/f2fs/group.list 2023-11-28T19:34:39.134 INFO:teuthology.orchestra.run.smithi203.stdout:Building generic 2023-11-28T19:34:39.134 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/generic/group.list 2023-11-28T19:34:39.134 INFO:teuthology.orchestra.run.smithi203.stdout:Building nfs 2023-11-28T19:34:39.134 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/nfs/group.list 2023-11-28T19:34:39.134 INFO:teuthology.orchestra.run.smithi203.stdout:Building ocfs2 2023-11-28T19:34:39.134 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/ocfs2/group.list 2023-11-28T19:34:39.134 INFO:teuthology.orchestra.run.smithi203.stdout:Building overlay 2023-11-28T19:34:39.134 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/overlay/group.list 2023-11-28T19:34:39.134 INFO:teuthology.orchestra.run.smithi203.stdout:Building perf 2023-11-28T19:34:39.134 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/perf/group.list 2023-11-28T19:34:39.135 INFO:teuthology.orchestra.run.smithi203.stdout:Building selftest 2023-11-28T19:34:39.135 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/selftest/group.list 2023-11-28T19:34:39.135 INFO:teuthology.orchestra.run.smithi203.stdout:Building shared 2023-11-28T19:34:39.135 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/shared/group.list 2023-11-28T19:34:39.135 INFO:teuthology.orchestra.run.smithi203.stdout:Building tmpfs 2023-11-28T19:34:39.135 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/tmpfs/group.list 2023-11-28T19:34:39.135 INFO:teuthology.orchestra.run.smithi203.stdout:Building udf 2023-11-28T19:34:39.135 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/udf/group.list 2023-11-28T19:34:39.135 INFO:teuthology.orchestra.run.smithi203.stdout:Building xfs 2023-11-28T19:34:39.135 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/xfs/group.list 2023-11-28T19:34:39.136 DEBUG:teuthology.orchestra.run.smithi203:> (cd /tmp/tmp.N8wkfFNIvbxfstests-dev && exec sudo make install) 2023-11-28T19:34:39.145 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:34:39.148 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:34:39.223 INFO:teuthology.orchestra.run.smithi203.stdout:Building include 2023-11-28T19:34:39.229 INFO:teuthology.orchestra.run.smithi203.stdout:Building lib 2023-11-28T19:34:39.238 INFO:teuthology.orchestra.run.smithi203.stdout:Building ltp 2023-11-28T19:34:39.245 INFO:teuthology.orchestra.run.smithi203.stdout:Building src 2023-11-28T19:34:39.302 INFO:teuthology.orchestra.run.smithi203.stdout:Building log-writes 2023-11-28T19:34:39.308 INFO:teuthology.orchestra.run.smithi203.stdout:Building perf 2023-11-28T19:34:39.315 INFO:teuthology.orchestra.run.smithi203.stdout:Building aio-dio-regress 2023-11-28T19:34:39.322 INFO:teuthology.orchestra.run.smithi203.stdout:Building vfs 2023-11-28T19:34:39.329 INFO:teuthology.orchestra.run.smithi203.stdout:Building m4 2023-11-28T19:34:39.335 INFO:teuthology.orchestra.run.smithi203.stdout:Building common 2023-11-28T19:34:39.342 INFO:teuthology.orchestra.run.smithi203.stdout:Building tests 2023-11-28T19:34:39.350 INFO:teuthology.orchestra.run.smithi203.stdout:Building btrfs 2023-11-28T19:34:39.360 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/btrfs/group.list 2023-11-28T19:34:39.489 INFO:teuthology.orchestra.run.smithi203.stdout:Building ceph 2023-11-28T19:34:39.498 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/ceph/group.list 2023-11-28T19:34:39.530 INFO:teuthology.orchestra.run.smithi203.stdout:Building cifs 2023-11-28T19:34:39.539 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/cifs/group.list 2023-11-28T19:34:39.567 INFO:teuthology.orchestra.run.smithi203.stdout:Building ext4 2023-11-28T19:34:39.575 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/ext4/group.list 2023-11-28T19:34:39.659 INFO:teuthology.orchestra.run.smithi203.stdout:Building f2fs 2023-11-28T19:34:39.668 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/f2fs/group.list 2023-11-28T19:34:39.707 INFO:teuthology.orchestra.run.smithi203.stdout:Building generic 2023-11-28T19:34:39.718 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/generic/group.list 2023-11-28T19:34:39.927 INFO:teuthology.orchestra.run.smithi203.stdout:Building nfs 2023-11-28T19:34:39.935 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/nfs/group.list 2023-11-28T19:34:39.968 INFO:teuthology.orchestra.run.smithi203.stdout:Building ocfs2 2023-11-28T19:34:39.976 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/ocfs2/group.list 2023-11-28T19:34:40.006 INFO:teuthology.orchestra.run.smithi203.stdout:Building overlay 2023-11-28T19:34:40.016 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/overlay/group.list 2023-11-28T19:34:40.105 INFO:teuthology.orchestra.run.smithi203.stdout:Building perf 2023-11-28T19:34:40.113 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/perf/group.list 2023-11-28T19:34:40.139 INFO:teuthology.orchestra.run.smithi203.stdout:Building selftest 2023-11-28T19:34:40.148 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/selftest/group.list 2023-11-28T19:34:40.177 INFO:teuthology.orchestra.run.smithi203.stdout:Building shared 2023-11-28T19:34:40.185 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/shared/group.list 2023-11-28T19:34:40.223 INFO:teuthology.orchestra.run.smithi203.stdout:Building tmpfs 2023-11-28T19:34:40.232 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/tmpfs/group.list 2023-11-28T19:34:40.263 INFO:teuthology.orchestra.run.smithi203.stdout:Building udf 2023-11-28T19:34:40.271 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/udf/group.list 2023-11-28T19:34:40.297 INFO:teuthology.orchestra.run.smithi203.stdout:Building xfs 2023-11-28T19:34:40.308 INFO:teuthology.orchestra.run.smithi203.stdout: [GROUP] /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/xfs/group.list 2023-11-28T19:34:40.516 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-11-28T19:34:40.520 INFO:teuthology.orchestra.run.smithi203.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-28T19:34:40.520 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-11-28T19:34:40.525 INFO:teuthology.orchestra.run.smithi203.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-28T19:34:40.525 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-11-28T19:34:40.529 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-11-28T19:34:40.550 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-11-28T19:34:40.708 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-11-28T19:34:40.729 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-11-28T19:34:40.757 INFO:teuthology.orchestra.run.smithi203.stdout:Building log-writes 2023-11-28T19:34:40.764 INFO:teuthology.orchestra.run.smithi203.stdout:Building perf 2023-11-28T19:34:40.770 INFO:teuthology.orchestra.run.smithi203.stdout:Building aio-dio-regress 2023-11-28T19:34:40.777 INFO:teuthology.orchestra.run.smithi203.stdout:Building vfs 2023-11-28T19:34:40.782 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake -C log-writes install 2023-11-28T19:34:40.786 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-11-28T19:34:40.806 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-11-28T19:34:40.827 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake -C perf install 2023-11-28T19:34:40.830 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-11-28T19:34:40.850 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-11-28T19:34:40.899 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-11-28T19:34:40.903 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-11-28T19:34:40.923 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-11-28T19:34:41.036 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake -C vfs install 2023-11-28T19:34:41.040 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-11-28T19:34:41.060 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-11-28T19:34:41.088 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-11-28T19:34:41.108 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio uring_read_fault xfsfind fssum /var/lib/xfstests/src 2023-11-28T19:34:43.880 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-11-28T19:34:44.101 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-11-28T19:34:44.148 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-11-28T19:34:44.152 INFO:teuthology.orchestra.run.smithi203.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-28T19:34:44.152 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-11-28T19:34:44.159 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-11-28T19:34:44.175 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-11-28T19:34:44.458 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-11-28T19:34:44.462 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/btrfs/ install 2023-11-28T19:34:44.467 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-11-28T19:34:44.487 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 /var/lib/xfstests/tests/btrfs 2023-11-28T19:34:46.208 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-11-28T19:34:46.229 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out /var/lib/xfstests/tests/btrfs 2023-11-28T19:34:47.963 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/ceph/ install 2023-11-28T19:34:47.967 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-11-28T19:34:47.987 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-11-28T19:34:48.031 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-11-28T19:34:48.051 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-11-28T19:34:48.094 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/cifs/ install 2023-11-28T19:34:48.098 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-11-28T19:34:48.118 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-11-28T19:34:48.138 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-11-28T19:34:48.158 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-11-28T19:34:48.178 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/ext4/ install 2023-11-28T19:34:48.183 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-11-28T19:34:48.203 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-11-28T19:34:48.598 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-11-28T19:34:48.619 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-11-28T19:34:49.039 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/f2fs/ install 2023-11-28T19:34:49.043 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-11-28T19:34:49.063 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-11-28T19:34:49.089 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-11-28T19:34:49.109 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-11-28T19:34:49.135 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/generic/ install 2023-11-28T19:34:49.143 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-11-28T19:34:49.163 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 /var/lib/xfstests/tests/generic 2023-11-28T19:34:53.375 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-11-28T19:34:53.396 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out /var/lib/xfstests/tests/generic 2023-11-28T19:34:57.624 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/nfs/ install 2023-11-28T19:34:57.627 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-11-28T19:34:57.647 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-11-28T19:34:57.668 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-11-28T19:34:57.688 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-11-28T19:34:57.708 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/ocfs2/ install 2023-11-28T19:34:57.712 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-11-28T19:34:57.732 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-11-28T19:34:57.753 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-11-28T19:34:57.773 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-11-28T19:34:57.793 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/overlay/ install 2023-11-28T19:34:57.797 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-11-28T19:34:57.817 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-11-28T19:34:58.405 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-11-28T19:34:58.425 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-11-28T19:34:59.012 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/perf/ install 2023-11-28T19:34:59.016 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-11-28T19:34:59.036 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-11-28T19:34:59.056 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-11-28T19:34:59.076 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-11-28T19:34:59.097 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/selftest/ install 2023-11-28T19:34:59.100 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-11-28T19:34:59.121 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-11-28T19:34:59.169 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-11-28T19:34:59.189 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-11-28T19:34:59.238 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/shared/ install 2023-11-28T19:34:59.241 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-11-28T19:34:59.262 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-11-28T19:34:59.293 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-11-28T19:34:59.313 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-11-28T19:34:59.345 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/tmpfs/ install 2023-11-28T19:34:59.349 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-11-28T19:34:59.369 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-11-28T19:34:59.390 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-11-28T19:34:59.410 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-11-28T19:34:59.431 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/udf/ install 2023-11-28T19:34:59.434 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-11-28T19:34:59.455 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-11-28T19:34:59.475 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-11-28T19:34:59.495 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-11-28T19:34:59.516 INFO:teuthology.orchestra.run.smithi203.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.N8wkfFNIvbxfstests-dev/tests/xfs/ install 2023-11-28T19:34:59.523 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-11-28T19:34:59.543 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-11-28T19:35:03.512 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-11-28T19:35:03.533 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-11-28T19:35:07.543 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-11-28T19:35:07.563 INFO:teuthology.orchestra.run.smithi203.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-11-28T19:35:07.583 INFO:teuthology.orchestra.run.smithi203.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-11-28T19:35:07.603 INFO:teuthology.orchestra.run.smithi203.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-11-28T19:35:07.626 DEBUG:teuthology.orchestra.run.smithi203:> (cd /tmp/tmp.eVcldRLPeyxfsprogs-dev && exec sudo make) 2023-11-28T19:35:07.696 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize -c -i -f 2023-11-28T19:35:07.907 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-11-28T19:35:07.907 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file './config.guess' 2023-11-28T19:35:07.916 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file './config.sub' 2023-11-28T19:35:07.925 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file './install-sh' 2023-11-28T19:35:07.938 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file './ltmain.sh' 2023-11-28T19:35:07.976 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-11-28T19:35:07.977 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-11-28T19:35:07.987 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-11-28T19:35:07.997 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-11-28T19:35:08.007 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-11-28T19:35:08.018 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-11-28T19:35:08.028 INFO:teuthology.orchestra.run.smithi203.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-11-28T19:35:08.030 INFO:teuthology.orchestra.run.smithi203.stdout:cp include/install-sh . 2023-11-28T19:35:08.032 INFO:teuthology.orchestra.run.smithi203.stdout:aclocal -I m4 2023-11-28T19:35:09.058 INFO:teuthology.orchestra.run.smithi203.stdout:autoconf 2023-11-28T19:35:09.237 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:35:09.240 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:35:09.242 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:35:09.498 INFO:teuthology.orchestra.run.smithi203.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-11-28T19:35:09.652 INFO:teuthology.orchestra.run.smithi203.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-11-28T19:35:09.724 INFO:teuthology.orchestra.run.smithi203.stdout:checking build system type... x86_64-pc-linux-gnu 2023-11-28T19:35:09.724 INFO:teuthology.orchestra.run.smithi203.stdout:checking host system type... x86_64-pc-linux-gnu 2023-11-28T19:35:09.755 INFO:teuthology.orchestra.run.smithi203.stdout:checking how to print strings... printf 2023-11-28T19:35:09.755 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc... gcc 2023-11-28T19:35:09.842 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether the C compiler works... yes 2023-11-28T19:35:09.843 INFO:teuthology.orchestra.run.smithi203.stdout:checking for C compiler default output file name... a.out 2023-11-28T19:35:09.884 INFO:teuthology.orchestra.run.smithi203.stdout:checking for suffix of executables... 2023-11-28T19:35:09.933 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether we are cross compiling... no 2023-11-28T19:35:09.960 INFO:teuthology.orchestra.run.smithi203.stdout:checking for suffix of object files... o 2023-11-28T19:35:09.984 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether the compiler supports GNU C... yes 2023-11-28T19:35:10.008 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether gcc accepts -g... yes 2023-11-28T19:35:10.059 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc option to enable C11 features... none needed 2023-11-28T19:35:10.066 INFO:teuthology.orchestra.run.smithi203.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-11-28T19:35:10.070 INFO:teuthology.orchestra.run.smithi203.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-11-28T19:35:10.073 INFO:teuthology.orchestra.run.smithi203.stdout:checking for egrep... /usr/bin/grep -E 2023-11-28T19:35:10.076 INFO:teuthology.orchestra.run.smithi203.stdout:checking for fgrep... /usr/bin/grep -F 2023-11-28T19:35:10.083 INFO:teuthology.orchestra.run.smithi203.stdout:checking for ld used by gcc... /usr/bin/ld 2023-11-28T19:35:10.087 INFO:teuthology.orchestra.run.smithi203.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-11-28T19:35:10.091 INFO:teuthology.orchestra.run.smithi203.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-11-28T19:35:10.122 INFO:teuthology.orchestra.run.smithi203.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-11-28T19:35:10.122 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether ln -s works... yes 2023-11-28T19:35:10.129 INFO:teuthology.orchestra.run.smithi203.stdout:checking the maximum length of command line arguments... 1572864 2023-11-28T19:35:10.136 INFO:teuthology.orchestra.run.smithi203.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-11-28T19:35:10.136 INFO:teuthology.orchestra.run.smithi203.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-11-28T19:35:10.136 INFO:teuthology.orchestra.run.smithi203.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-11-28T19:35:10.137 INFO:teuthology.orchestra.run.smithi203.stdout:checking for objdump... objdump 2023-11-28T19:35:10.137 INFO:teuthology.orchestra.run.smithi203.stdout:checking how to recognize dependent libraries... pass_all 2023-11-28T19:35:10.137 INFO:teuthology.orchestra.run.smithi203.stdout:checking for dlltool... no 2023-11-28T19:35:10.137 INFO:teuthology.orchestra.run.smithi203.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-11-28T19:35:10.137 INFO:teuthology.orchestra.run.smithi203.stdout:checking for ar... ar 2023-11-28T19:35:10.173 INFO:teuthology.orchestra.run.smithi203.stdout:checking for archiver @FILE support... @ 2023-11-28T19:35:10.173 INFO:teuthology.orchestra.run.smithi203.stdout:checking for strip... strip 2023-11-28T19:35:10.173 INFO:teuthology.orchestra.run.smithi203.stdout:checking for ranlib... ranlib 2023-11-28T19:35:10.173 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gawk... gawk 2023-11-28T19:35:10.262 INFO:teuthology.orchestra.run.smithi203.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-11-28T19:35:10.265 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sysroot... no 2023-11-28T19:35:10.272 INFO:teuthology.orchestra.run.smithi203.stdout:checking for a working dd... /usr/bin/dd 2023-11-28T19:35:10.279 INFO:teuthology.orchestra.run.smithi203.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-11-28T19:35:10.298 INFO:teuthology.orchestra.run.smithi203.stdout:checking for mt... mt 2023-11-28T19:35:10.305 INFO:teuthology.orchestra.run.smithi203.stdout:checking if mt is a manifest tool... no 2023-11-28T19:35:10.332 INFO:teuthology.orchestra.run.smithi203.stdout:checking for stdio.h... yes 2023-11-28T19:35:10.362 INFO:teuthology.orchestra.run.smithi203.stdout:checking for stdlib.h... yes 2023-11-28T19:35:10.394 INFO:teuthology.orchestra.run.smithi203.stdout:checking for string.h... yes 2023-11-28T19:35:10.426 INFO:teuthology.orchestra.run.smithi203.stdout:checking for inttypes.h... yes 2023-11-28T19:35:10.459 INFO:teuthology.orchestra.run.smithi203.stdout:checking for stdint.h... yes 2023-11-28T19:35:10.491 INFO:teuthology.orchestra.run.smithi203.stdout:checking for strings.h... yes 2023-11-28T19:35:10.524 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/stat.h... yes 2023-11-28T19:35:10.557 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/types.h... yes 2023-11-28T19:35:10.594 INFO:teuthology.orchestra.run.smithi203.stdout:checking for unistd.h... yes 2023-11-28T19:35:10.632 INFO:teuthology.orchestra.run.smithi203.stdout:checking for dlfcn.h... yes 2023-11-28T19:35:10.638 INFO:teuthology.orchestra.run.smithi203.stdout:checking for objdir... .libs 2023-11-28T19:35:10.738 INFO:teuthology.orchestra.run.smithi203.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-11-28T19:35:10.738 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-11-28T19:35:10.766 INFO:teuthology.orchestra.run.smithi203.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-11-28T19:35:10.870 INFO:teuthology.orchestra.run.smithi203.stdout:checking if gcc static flag -static works... yes 2023-11-28T19:35:10.912 INFO:teuthology.orchestra.run.smithi203.stdout:checking if gcc supports -c -o file.o... yes 2023-11-28T19:35:10.912 INFO:teuthology.orchestra.run.smithi203.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-11-28T19:35:10.926 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-11-28T19:35:10.962 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether -lc should be explicitly linked in... no 2023-11-28T19:35:11.040 INFO:teuthology.orchestra.run.smithi203.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-11-28T19:35:11.041 INFO:teuthology.orchestra.run.smithi203.stdout:checking how to hardcode library paths into programs... immediate 2023-11-28T19:35:11.043 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether stripping libraries is possible... yes 2023-11-28T19:35:11.043 INFO:teuthology.orchestra.run.smithi203.stdout:checking if libtool supports shared libraries... yes 2023-11-28T19:35:11.044 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether to build shared libraries... yes 2023-11-28T19:35:11.044 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether to build static libraries... yes 2023-11-28T19:35:11.044 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc... (cached) gcc 2023-11-28T19:35:11.087 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-28T19:35:11.087 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-28T19:35:11.088 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-28T19:35:11.100 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc... (cached) gcc 2023-11-28T19:35:11.143 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-28T19:35:11.143 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-28T19:35:11.143 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-28T19:35:11.151 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc... (cached) gcc 2023-11-28T19:35:11.194 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-11-28T19:35:11.195 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether gcc accepts -g... (cached) yes 2023-11-28T19:35:11.195 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-11-28T19:35:11.195 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gmake... /usr/bin/gmake 2023-11-28T19:35:11.195 INFO:teuthology.orchestra.run.smithi203.stdout:checking for tar... /usr/bin/tar 2023-11-28T19:35:11.195 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gzip... /usr/bin/gzip 2023-11-28T19:35:11.209 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether gcc -MM is supported... yes 2023-11-28T19:35:11.209 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sort... /bin/sort 2023-11-28T19:35:11.209 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether ln -s works... yes 2023-11-28T19:35:11.210 INFO:teuthology.orchestra.run.smithi203.stdout:checking for msgfmt... /usr/bin/msgfmt 2023-11-28T19:35:11.210 INFO:teuthology.orchestra.run.smithi203.stdout:checking for msgmerge... /usr/bin/msgmerge 2023-11-28T19:35:11.210 INFO:teuthology.orchestra.run.smithi203.stdout:checking for xgettext... /usr/bin/xgettext 2023-11-28T19:35:11.211 INFO:teuthology.orchestra.run.smithi203.stdout:checking for rpm... no 2023-11-28T19:35:11.265 INFO:teuthology.orchestra.run.smithi203.stdout:checking for ini.h... yes 2023-11-28T19:35:11.314 INFO:teuthology.orchestra.run.smithi203.stdout:checking for ini_parse in -linih... yes 2023-11-28T19:35:11.356 INFO:teuthology.orchestra.run.smithi203.stdout:checking for uuid.h... no 2023-11-28T19:35:11.396 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sys/uuid.h... no 2023-11-28T19:35:11.435 INFO:teuthology.orchestra.run.smithi203.stdout:checking for uuid/uuid.h... yes 2023-11-28T19:35:11.493 INFO:teuthology.orchestra.run.smithi203.stdout:checking for uuid_compare... no 2023-11-28T19:35:11.543 INFO:teuthology.orchestra.run.smithi203.stdout:checking for uuid_compare in -luuid... yes 2023-11-28T19:35:11.582 INFO:teuthology.orchestra.run.smithi203.stdout:checking for pthread.h... yes 2023-11-28T19:35:11.631 INFO:teuthology.orchestra.run.smithi203.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-11-28T19:35:11.675 INFO:teuthology.orchestra.run.smithi203.stdout:checking for urcu.h... yes 2023-11-28T19:35:11.714 INFO:teuthology.orchestra.run.smithi203.stdout:checking for liburcu... yes 2023-11-28T19:35:11.743 INFO:teuthology.orchestra.run.smithi203.stdout:checking for fadvise ... yes 2023-11-28T19:35:11.770 INFO:teuthology.orchestra.run.smithi203.stdout:checking for madvise ... yes 2023-11-28T19:35:11.798 INFO:teuthology.orchestra.run.smithi203.stdout:checking for mincore ... yes 2023-11-28T19:35:11.830 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sendfile ... yes 2023-11-28T19:35:11.862 INFO:teuthology.orchestra.run.smithi203.stdout:checking for getmntent ... yes 2023-11-28T19:35:11.913 INFO:teuthology.orchestra.run.smithi203.stdout:checking for fallocate... yes 2023-11-28T19:35:11.965 INFO:teuthology.orchestra.run.smithi203.stdout:checking for fiemap... yes 2023-11-28T19:35:12.024 INFO:teuthology.orchestra.run.smithi203.stdout:checking for pwritev2... yes 2023-11-28T19:35:12.083 INFO:teuthology.orchestra.run.smithi203.stdout:checking for preadv... yes 2023-11-28T19:35:12.139 INFO:teuthology.orchestra.run.smithi203.stdout:checking for copy_file_range... yes 2023-11-28T19:35:12.190 INFO:teuthology.orchestra.run.smithi203.stdout:checking for sync_file_range... yes 2023-11-28T19:35:12.246 INFO:teuthology.orchestra.run.smithi203.stdout:checking for syncfs... yes 2023-11-28T19:35:12.285 INFO:teuthology.orchestra.run.smithi203.stdout:checking for mntent.h... yes 2023-11-28T19:35:12.334 INFO:teuthology.orchestra.run.smithi203.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-11-28T19:35:12.370 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether fls is declared... no 2023-11-28T19:35:12.424 INFO:teuthology.orchestra.run.smithi203.stdout:checking for readdir... yes 2023-11-28T19:35:12.464 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether fsetxattr is declared... yes 2023-11-28T19:35:12.500 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether mremap is declared... yes 2023-11-28T19:35:12.553 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct fsxattr... yes 2023-11-28T19:35:12.580 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-11-28T19:35:12.632 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct fscrypt_add_key_arg... yes 2023-11-28T19:35:12.659 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct fscrypt_add_key_arg.key_id... yes 2023-11-28T19:35:12.741 INFO:teuthology.orchestra.run.smithi203.stdout:checking for GETFSMAP... yes 2023-11-28T19:35:12.796 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct statfs... yes 2023-11-28T19:35:12.823 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct statfs.f_flags... yes 2023-11-28T19:35:12.848 INFO:teuthology.orchestra.run.smithi203.stdout:checking for MAP_SYNC... yes 2023-11-28T19:35:12.962 INFO:teuthology.orchestra.run.smithi203.stdout:checking for library containing dm_task_create... -ldevmapper 2023-11-28T19:35:12.999 INFO:teuthology.orchestra.run.smithi203.stdout:checking for mallinfo ... yes 2023-11-28T19:35:13.031 INFO:teuthology.orchestra.run.smithi203.stdout:checking for mallinfo2 ... yes 2023-11-28T19:35:13.071 INFO:teuthology.orchestra.run.smithi203.stdout:checking for attr/attributes.h... yes 2023-11-28T19:35:13.099 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct attrlist_cursor... yes 2023-11-28T19:35:13.101 INFO:teuthology.orchestra.run.smithi203.stdout:checking for pkg-config... /usr/bin/pkg-config 2023-11-28T19:35:13.103 INFO:teuthology.orchestra.run.smithi203.stdout:checking pkg-config is at least version 0.9.0... yes 2023-11-28T19:35:13.115 INFO:teuthology.orchestra.run.smithi203.stdout:checking for icu-i18n... yes 2023-11-28T19:35:13.154 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether openat is declared... yes 2023-11-28T19:35:13.198 INFO:teuthology.orchestra.run.smithi203.stdout:checking whether fstatat is declared... yes 2023-11-28T19:35:13.235 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct sg_io_hdr ... yes 2023-11-28T19:35:13.265 INFO:teuthology.orchestra.run.smithi203.stdout:checking for struct hd_geometry ... yes 2023-11-28T19:35:13.280 INFO:teuthology.orchestra.run.smithi203.stdout:checking for systemd... yes 2023-11-28T19:35:13.283 INFO:teuthology.orchestra.run.smithi203.stdout:checking for systemd system unit dir... /lib/systemd/system 2023-11-28T19:35:13.283 INFO:teuthology.orchestra.run.smithi203.stdout:checking for system crontab dir... /etc/cron.d 2023-11-28T19:35:13.295 INFO:teuthology.orchestra.run.smithi203.stdout:checking for udev... yes 2023-11-28T19:35:13.298 INFO:teuthology.orchestra.run.smithi203.stdout:checking for udev rule dir... /lib/udev/rules.d 2023-11-28T19:35:13.407 INFO:teuthology.orchestra.run.smithi203.stdout:checking for library containing blkid_probe_all... -lblkid 2023-11-28T19:35:13.460 INFO:teuthology.orchestra.run.smithi203.stdout:checking for blkid_probe_get_topology... yes 2023-11-28T19:35:13.534 INFO:teuthology.orchestra.run.smithi203.stdout:checking size of long... 8 2023-11-28T19:35:13.608 INFO:teuthology.orchestra.run.smithi203.stdout:checking size of char *... 8 2023-11-28T19:35:13.630 INFO:teuthology.orchestra.run.smithi203.stdout:checking for umode_t... no 2023-11-28T19:35:13.696 INFO:teuthology.orchestra.run.smithi203.stdout:checking for atomic64_t support in liburcu... yes 2023-11-28T19:35:13.726 INFO:teuthology.orchestra.run.smithi203.stdout:configure: creating ./config.status 2023-11-28T19:35:14.580 INFO:teuthology.orchestra.run.smithi203.stdout:config.status: creating include/builddefs 2023-11-28T19:35:14.606 INFO:teuthology.orchestra.run.smithi203.stdout:config.status: creating include/platform_defs.h 2023-11-28T19:35:14.627 INFO:teuthology.orchestra.run.smithi203.stdout:config.status: executing libtool commands 2023-11-28T19:35:14.707 INFO:teuthology.orchestra.run.smithi203.stdout: [HEADERS] include 2023-11-28T19:35:14.733 INFO:teuthology.orchestra.run.smithi203.stdout: [HEADERS] libxfs 2023-11-28T19:35:14.767 INFO:teuthology.orchestra.run.smithi203.stdout:Building include 2023-11-28T19:35:14.775 INFO:teuthology.orchestra.run.smithi203.stdout: [LN] disk 2023-11-28T19:35:14.780 INFO:teuthology.orchestra.run.smithi203.stdout:Building libfrog 2023-11-28T19:35:14.786 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] gen_crc32table 2023-11-28T19:35:14.853 INFO:teuthology.orchestra.run.smithi203.stdout: [GENERATE] crc32table.h 2023-11-28T19:35:15.331 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] avl64.lo 2023-11-28T19:35:15.803 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] bitmap.lo 2023-11-28T19:35:16.145 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] bulkstat.lo 2023-11-28T19:35:16.539 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] convert.lo 2023-11-28T19:35:16.909 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] crc32.lo 2023-11-28T19:35:17.141 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fsgeom.lo 2023-11-28T19:35:17.473 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] list_sort.lo 2023-11-28T19:35:17.696 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] linux.lo 2023-11-28T19:35:18.042 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] logging.lo 2023-11-28T19:35:18.211 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] paths.lo 2023-11-28T19:35:18.656 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] projects.lo 2023-11-28T19:35:18.974 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] ptvar.lo 2023-11-28T19:35:19.240 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] radix-tree.lo 2023-11-28T19:35:19.759 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] randbytes.lo 2023-11-28T19:35:19.987 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] scrub.lo 2023-11-28T19:35:20.204 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] util.lo 2023-11-28T19:35:20.437 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] workqueue.lo 2023-11-28T19:35:20.730 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] libfrog.la 2023-11-28T19:35:20.852 INFO:teuthology.orchestra.run.smithi203.stdout:Building libxfs 2023-11-28T19:35:22.513 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] cache.lo 2023-11-28T19:35:23.061 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] defer_item.lo 2023-11-28T19:35:23.510 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] init.lo 2023-11-28T19:35:24.231 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] kmem.lo 2023-11-28T19:35:24.546 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] logitem.lo 2023-11-28T19:35:24.879 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] rdwr.lo 2023-11-28T19:35:25.728 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] topology.lo 2023-11-28T19:35:26.126 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] trans.lo 2023-11-28T19:35:26.664 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] util.lo 2023-11-28T19:35:27.198 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_ag.lo 2023-11-28T19:35:28.003 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_ag_resv.lo 2023-11-28T19:35:28.373 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_alloc.lo 2023-11-28T19:35:29.918 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_alloc_btree.lo 2023-11-28T19:35:30.414 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_attr.lo 2023-11-28T19:35:31.025 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_attr_leaf.lo 2023-11-28T19:35:32.427 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_attr_remote.lo 2023-11-28T19:35:32.983 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_bit.lo 2023-11-28T19:35:33.283 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_bmap.lo 2023-11-28T19:35:36.041 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_bmap_btree.lo 2023-11-28T19:35:36.593 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_btree.lo 2023-11-28T19:35:38.781 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_btree_staging.lo 2023-11-28T19:35:39.262 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_da_btree.lo 2023-11-28T19:35:39.327 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:35:39.331 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:35:39.333 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:35:40.556 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_defer.lo 2023-11-28T19:35:41.083 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_dir2.lo 2023-11-28T19:35:41.607 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_dir2_block.lo 2023-11-28T19:35:42.458 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_dir2_data.lo 2023-11-28T19:35:43.235 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_dir2_leaf.lo 2023-11-28T19:35:44.166 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_dir2_node.lo 2023-11-28T19:35:45.233 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_dir2_sf.lo 2023-11-28T19:35:46.028 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_dquot_buf.lo 2023-11-28T19:35:46.431 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_ialloc.lo 2023-11-28T19:35:47.763 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_iext_tree.lo 2023-11-28T19:35:48.495 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_inode_buf.lo 2023-11-28T19:35:49.148 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_inode_fork.lo 2023-11-28T19:35:49.789 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_ialloc_btree.lo 2023-11-28T19:35:50.340 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_log_rlimit.lo 2023-11-28T19:35:50.665 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_refcount.lo 2023-11-28T19:35:51.514 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_refcount_btree.lo 2023-11-28T19:35:51.982 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_rmap.lo 2023-11-28T19:35:53.177 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_rmap_btree.lo 2023-11-28T19:35:53.733 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_rtbitmap.lo 2023-11-28T19:35:54.372 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_sb.lo 2023-11-28T19:35:55.200 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_symlink_remote.lo 2023-11-28T19:35:55.577 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_trans_inode.lo 2023-11-28T19:35:55.886 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_trans_resv.lo 2023-11-28T19:35:56.473 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_types.lo 2023-11-28T19:35:56.843 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] libxfs.la 2023-11-28T19:35:57.060 INFO:teuthology.orchestra.run.smithi203.stdout:Building libxlog 2023-11-28T19:35:57.153 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_log_recover.lo 2023-11-28T19:35:57.994 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] util.lo 2023-11-28T19:35:58.385 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] libxlog.la 2023-11-28T19:35:58.486 INFO:teuthology.orchestra.run.smithi203.stdout:Building libxcmd 2023-11-28T19:35:58.622 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] command.lo 2023-11-28T19:35:58.976 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] input.lo 2023-11-28T19:35:59.297 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] help.lo 2023-11-28T19:35:59.558 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] quit.lo 2023-11-28T19:35:59.793 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] libxcmd.la 2023-11-28T19:35:59.896 INFO:teuthology.orchestra.run.smithi203.stdout:Building libhandle 2023-11-28T19:35:59.977 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] handle.lo 2023-11-28T19:36:00.357 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] jdm.lo 2023-11-28T19:36:00.655 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] libhandle.la 2023-11-28T19:36:00.796 INFO:teuthology.orchestra.run.smithi203.stdout:Building copy 2023-11-28T19:36:00.853 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_copy.o 2023-11-28T19:36:01.302 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] xfs_copy 2023-11-28T19:36:01.490 INFO:teuthology.orchestra.run.smithi203.stdout:Building db 2023-11-28T19:36:03.542 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] addr.o 2023-11-28T19:36:03.661 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] agf.o 2023-11-28T19:36:03.774 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] agfl.o 2023-11-28T19:36:03.884 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] agi.o 2023-11-28T19:36:03.999 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] attr.o 2023-11-28T19:36:04.207 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] attrshort.o 2023-11-28T19:36:04.338 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] bit.o 2023-11-28T19:36:04.477 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] block.o 2023-11-28T19:36:04.634 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] bmap.o 2023-11-28T19:36:04.839 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] btblock.o 2023-11-28T19:36:04.983 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] bmroot.o 2023-11-28T19:36:05.157 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] check.o 2023-11-28T19:36:06.972 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] command.o 2023-11-28T19:36:07.095 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] crc.o 2023-11-28T19:36:07.217 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] debug.o 2023-11-28T19:36:07.315 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] dir2.o 2023-11-28T19:36:07.613 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] dir2sf.o 2023-11-28T19:36:07.769 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] dquot.o 2023-11-28T19:36:07.898 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] echo.o 2023-11-28T19:36:08.002 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] faddr.o 2023-11-28T19:36:08.196 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] field.o 2023-11-28T19:36:08.322 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] flist.o 2023-11-28T19:36:08.568 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fprint.o 2023-11-28T19:36:08.745 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] frag.o 2023-11-28T19:36:08.994 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] freesp.o 2023-11-28T19:36:09.198 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] hash.o 2023-11-28T19:36:09.280 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c: In function 'hash_f': 2023-11-28T19:36:09.280 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:76:58: warning: pointer targets in passing argument 1 of 'libxfs_da_hashname' differ in signedness [-Wpointer-sign] 2023-11-28T19:36:09.280 INFO:teuthology.orchestra.run.smithi203.stderr: 76 | hashval = libxfs_da_hashname(argv[c], strlen(argv[c])); 2023-11-28T19:36:09.280 INFO:teuthology.orchestra.run.smithi203.stderr: | ~~~~^~~ 2023-11-28T19:36:09.281 INFO:teuthology.orchestra.run.smithi203.stderr: | | 2023-11-28T19:36:09.281 INFO:teuthology.orchestra.run.smithi203.stderr: | char * 2023-11-28T19:36:09.281 INFO:teuthology.orchestra.run.smithi203.stderr:In file included from ../include/libxfs.h:59, 2023-11-28T19:36:09.281 INFO:teuthology.orchestra.run.smithi203.stderr: from hash.c:7: 2023-11-28T19:36:09.281 INFO:teuthology.orchestra.run.smithi203.stderr:../libxfs/xfs_da_btree.h:223:37: note: expected 'const uint8_t *' {aka 'const unsigned char *'} but argument is of type 'char *' 2023-11-28T19:36:09.281 INFO:teuthology.orchestra.run.smithi203.stderr: 223 | uint xfs_da_hashname(const uint8_t *name_string, int name_length); 2023-11-28T19:36:09.281 INFO:teuthology.orchestra.run.smithi203.stderr: | ~~~~~~~~~~~~~~~^~~~~~~~~~~ 2023-11-28T19:36:09.285 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c: In function 'collide_dirents': 2023-11-28T19:36:09.285 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:258:36: warning: pointer targets in passing argument 2 of 'openat' differ in signedness [-Wpointer-sign] 2023-11-28T19:36:09.286 INFO:teuthology.orchestra.run.smithi203.stderr: 258 | newfd = openat(fd, name, O_CREAT, 0600); 2023-11-28T19:36:09.286 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~ 2023-11-28T19:36:09.286 INFO:teuthology.orchestra.run.smithi203.stderr: | | 2023-11-28T19:36:09.286 INFO:teuthology.orchestra.run.smithi203.stderr: | const unsigned char * 2023-11-28T19:36:09.286 INFO:teuthology.orchestra.run.smithi203.stderr:In file included from /usr/include/fcntl.h:314, 2023-11-28T19:36:09.286 INFO:teuthology.orchestra.run.smithi203.stderr: from ../include/platform_defs.h:12, 2023-11-28T19:36:09.286 INFO:teuthology.orchestra.run.smithi203.stderr: from ../include/libxfs.h:11, 2023-11-28T19:36:09.286 INFO:teuthology.orchestra.run.smithi203.stderr: from hash.c:7: 2023-11-28T19:36:09.286 INFO:teuthology.orchestra.run.smithi203.stderr:/usr/include/x86_64-linux-gnu/bits/fcntl2.h:117:31: note: expected 'const char *' but argument is of type 'const unsigned char *' 2023-11-28T19:36:09.287 INFO:teuthology.orchestra.run.smithi203.stderr: 117 | openat (int __fd, const char *__path, int __oflag, ...) 2023-11-28T19:36:09.287 INFO:teuthology.orchestra.run.smithi203.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-11-28T19:36:09.287 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:273:25: warning: pointer targets in passing argument 1 of 'strncpy' differ in signedness [-Wpointer-sign] 2023-11-28T19:36:09.287 INFO:teuthology.orchestra.run.smithi203.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-11-28T19:36:09.287 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~ 2023-11-28T19:36:09.287 INFO:teuthology.orchestra.run.smithi203.stderr: | | 2023-11-28T19:36:09.287 INFO:teuthology.orchestra.run.smithi203.stderr: | unsigned char * 2023-11-28T19:36:09.287 INFO:teuthology.orchestra.run.smithi203.stderr:In file included from /usr/include/features.h:486, 2023-11-28T19:36:09.287 INFO:teuthology.orchestra.run.smithi203.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-11-28T19:36:09.287 INFO:teuthology.orchestra.run.smithi203.stderr: from /usr/include/stdio.h:27, 2023-11-28T19:36:09.288 INFO:teuthology.orchestra.run.smithi203.stderr: from ../include/platform_defs.h:10, 2023-11-28T19:36:09.288 INFO:teuthology.orchestra.run.smithi203.stderr: from ../include/libxfs.h:11, 2023-11-28T19:36:09.288 INFO:teuthology.orchestra.run.smithi203.stderr: from hash.c:7: 2023-11-28T19:36:09.288 INFO:teuthology.orchestra.run.smithi203.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:92:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2023-11-28T19:36:09.288 INFO:teuthology.orchestra.run.smithi203.stderr: 92 | __NTH (strncpy (char *__restrict __dest, const char *__restrict __src, 2023-11-28T19:36:09.288 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~ 2023-11-28T19:36:09.288 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:273:37: warning: pointer targets in passing argument 2 of 'strncpy' differ in signedness [-Wpointer-sign] 2023-11-28T19:36:09.288 INFO:teuthology.orchestra.run.smithi203.stderr: 273 | strncpy(direntname, name, MAXNAMELEN); 2023-11-28T19:36:09.288 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~ 2023-11-28T19:36:09.288 INFO:teuthology.orchestra.run.smithi203.stderr: | | 2023-11-28T19:36:09.288 INFO:teuthology.orchestra.run.smithi203.stderr: | const unsigned char * 2023-11-28T19:36:09.288 INFO:teuthology.orchestra.run.smithi203.stderr:In file included from /usr/include/features.h:486, 2023-11-28T19:36:09.289 INFO:teuthology.orchestra.run.smithi203.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-11-28T19:36:09.289 INFO:teuthology.orchestra.run.smithi203.stderr: from /usr/include/stdio.h:27, 2023-11-28T19:36:09.289 INFO:teuthology.orchestra.run.smithi203.stderr: from ../include/platform_defs.h:10, 2023-11-28T19:36:09.289 INFO:teuthology.orchestra.run.smithi203.stderr: from ../include/libxfs.h:11, 2023-11-28T19:36:09.289 INFO:teuthology.orchestra.run.smithi203.stderr: from hash.c:7: 2023-11-28T19:36:09.289 INFO:teuthology.orchestra.run.smithi203.stderr:/usr/include/x86_64-linux-gnu/bits/string_fortified.h:92:1: note: expected 'const char * restrict' but argument is of type 'const unsigned char *' 2023-11-28T19:36:09.289 INFO:teuthology.orchestra.run.smithi203.stderr: 92 | __NTH (strncpy (char *__restrict __dest, const char *__restrict __src, 2023-11-28T19:36:09.290 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~ 2023-11-28T19:36:09.290 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:278:44: warning: pointer targets in passing argument 2 of 'linkat' differ in signedness [-Wpointer-sign] 2023-11-28T19:36:09.290 INFO:teuthology.orchestra.run.smithi203.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-11-28T19:36:09.290 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~ 2023-11-28T19:36:09.290 INFO:teuthology.orchestra.run.smithi203.stderr: | | 2023-11-28T19:36:09.290 INFO:teuthology.orchestra.run.smithi203.stderr: | const unsigned char * 2023-11-28T19:36:09.291 INFO:teuthology.orchestra.run.smithi203.stderr:In file included from ../include/platform_defs.h:19, 2023-11-28T19:36:09.291 INFO:teuthology.orchestra.run.smithi203.stderr: from ../include/libxfs.h:11, 2023-11-28T19:36:09.291 INFO:teuthology.orchestra.run.smithi203.stderr: from hash.c:7: 2023-11-28T19:36:09.293 INFO:teuthology.orchestra.run.smithi203.stderr:/usr/include/unistd.h:825:46: note: expected 'const char *' but argument is of type 'const unsigned char *' 2023-11-28T19:36:09.293 INFO:teuthology.orchestra.run.smithi203.stderr: 825 | extern int linkat (int __fromfd, const char *__from, int __tofd, 2023-11-28T19:36:09.293 INFO:teuthology.orchestra.run.smithi203.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-11-28T19:36:09.293 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:278:54: warning: pointer targets in passing argument 4 of 'linkat' differ in signedness [-Wpointer-sign] 2023-11-28T19:36:09.293 INFO:teuthology.orchestra.run.smithi203.stderr: 278 | error = linkat(fd, name, fd, direntname, 0); 2023-11-28T19:36:09.293 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~~ 2023-11-28T19:36:09.293 INFO:teuthology.orchestra.run.smithi203.stderr: | | 2023-11-28T19:36:09.293 INFO:teuthology.orchestra.run.smithi203.stderr: | unsigned char * 2023-11-28T19:36:09.293 INFO:teuthology.orchestra.run.smithi203.stderr:In file included from ../include/platform_defs.h:19, 2023-11-28T19:36:09.293 INFO:teuthology.orchestra.run.smithi203.stderr: from ../include/libxfs.h:11, 2023-11-28T19:36:09.294 INFO:teuthology.orchestra.run.smithi203.stderr: from hash.c:7: 2023-11-28T19:36:09.294 INFO:teuthology.orchestra.run.smithi203.stderr:/usr/include/unistd.h:826:32: note: expected 'const char *' but argument is of type 'unsigned char *' 2023-11-28T19:36:09.294 INFO:teuthology.orchestra.run.smithi203.stderr: 826 | const char *__to, int __flags) 2023-11-28T19:36:09.294 INFO:teuthology.orchestra.run.smithi203.stderr: | ~~~~~~~~~~~~^~~~ 2023-11-28T19:36:09.294 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c: In function 'collide_xattrs': 2023-11-28T19:36:09.294 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:318:26: warning: pointer targets in passing argument 1 of 'snprintf' differ in signedness [-Wpointer-sign] 2023-11-28T19:36:09.294 INFO:teuthology.orchestra.run.smithi203.stderr: 318 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-11-28T19:36:09.294 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~ 2023-11-28T19:36:09.294 INFO:teuthology.orchestra.run.smithi203.stderr: | | 2023-11-28T19:36:09.294 INFO:teuthology.orchestra.run.smithi203.stderr: | unsigned char * 2023-11-28T19:36:09.294 INFO:teuthology.orchestra.run.smithi203.stderr:In file included from /usr/include/features.h:486, 2023-11-28T19:36:09.294 INFO:teuthology.orchestra.run.smithi203.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-11-28T19:36:09.295 INFO:teuthology.orchestra.run.smithi203.stderr: from /usr/include/stdio.h:27, 2023-11-28T19:36:09.295 INFO:teuthology.orchestra.run.smithi203.stderr: from ../include/platform_defs.h:10, 2023-11-28T19:36:09.295 INFO:teuthology.orchestra.run.smithi203.stderr: from ../include/libxfs.h:11, 2023-11-28T19:36:09.295 INFO:teuthology.orchestra.run.smithi203.stderr: from hash.c:7: 2023-11-28T19:36:09.295 INFO:teuthology.orchestra.run.smithi203.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:68:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2023-11-28T19:36:09.295 INFO:teuthology.orchestra.run.smithi203.stderr: 68 | __NTH (snprintf (char *__restrict __s, size_t __n, 2023-11-28T19:36:09.295 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~ 2023-11-28T19:36:09.295 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:319:39: warning: pointer targets in passing argument 2 of 'fsetxattr' differ in signedness [-Wpointer-sign] 2023-11-28T19:36:09.295 INFO:teuthology.orchestra.run.smithi203.stderr: 319 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-11-28T19:36:09.295 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~ 2023-11-28T19:36:09.295 INFO:teuthology.orchestra.run.smithi203.stderr: | | 2023-11-28T19:36:09.295 INFO:teuthology.orchestra.run.smithi203.stderr: | unsigned char * 2023-11-28T19:36:09.296 INFO:teuthology.orchestra.run.smithi203.stderr:In file included from hash.c:16: 2023-11-28T19:36:09.296 INFO:teuthology.orchestra.run.smithi203.stderr:/usr/include/x86_64-linux-gnu/sys/xattr.h:54:45: note: expected 'const char *' but argument is of type 'unsigned char *' 2023-11-28T19:36:09.296 INFO:teuthology.orchestra.run.smithi203.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-11-28T19:36:09.296 INFO:teuthology.orchestra.run.smithi203.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-11-28T19:36:09.296 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:332:26: warning: pointer targets in passing argument 1 of 'snprintf' differ in signedness [-Wpointer-sign] 2023-11-28T19:36:09.296 INFO:teuthology.orchestra.run.smithi203.stderr: 332 | snprintf(xattrname, MAXNAMELEN + 5, "user.%s", name); 2023-11-28T19:36:09.296 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~ 2023-11-28T19:36:09.296 INFO:teuthology.orchestra.run.smithi203.stderr: | | 2023-11-28T19:36:09.296 INFO:teuthology.orchestra.run.smithi203.stderr: | unsigned char * 2023-11-28T19:36:09.296 INFO:teuthology.orchestra.run.smithi203.stderr:In file included from /usr/include/features.h:486, 2023-11-28T19:36:09.296 INFO:teuthology.orchestra.run.smithi203.stderr: from /usr/include/x86_64-linux-gnu/bits/libc-header-start.h:33, 2023-11-28T19:36:09.297 INFO:teuthology.orchestra.run.smithi203.stderr: from /usr/include/stdio.h:27, 2023-11-28T19:36:09.297 INFO:teuthology.orchestra.run.smithi203.stderr: from ../include/platform_defs.h:10, 2023-11-28T19:36:09.297 INFO:teuthology.orchestra.run.smithi203.stderr: from ../include/libxfs.h:11, 2023-11-28T19:36:09.297 INFO:teuthology.orchestra.run.smithi203.stderr: from hash.c:7: 2023-11-28T19:36:09.297 INFO:teuthology.orchestra.run.smithi203.stderr:/usr/include/x86_64-linux-gnu/bits/stdio2.h:68:1: note: expected 'char * restrict' but argument is of type 'unsigned char *' 2023-11-28T19:36:09.297 INFO:teuthology.orchestra.run.smithi203.stderr: 68 | __NTH (snprintf (char *__restrict __s, size_t __n, 2023-11-28T19:36:09.297 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~ 2023-11-28T19:36:09.297 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:337:47: warning: pointer targets in passing argument 2 of 'fsetxattr' differ in signedness [-Wpointer-sign] 2023-11-28T19:36:09.297 INFO:teuthology.orchestra.run.smithi203.stderr: 337 | error = fsetxattr(fd, xattrname, "1", 1, 0); 2023-11-28T19:36:09.297 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~~~~~~~ 2023-11-28T19:36:09.297 INFO:teuthology.orchestra.run.smithi203.stderr: | | 2023-11-28T19:36:09.297 INFO:teuthology.orchestra.run.smithi203.stderr: | unsigned char * 2023-11-28T19:36:09.298 INFO:teuthology.orchestra.run.smithi203.stderr:In file included from hash.c:16: 2023-11-28T19:36:09.298 INFO:teuthology.orchestra.run.smithi203.stderr:/usr/include/x86_64-linux-gnu/sys/xattr.h:54:45: note: expected 'const char *' but argument is of type 'unsigned char *' 2023-11-28T19:36:09.298 INFO:teuthology.orchestra.run.smithi203.stderr: 54 | extern int fsetxattr (int __fd, const char *__name, const void *__value, 2023-11-28T19:36:09.298 INFO:teuthology.orchestra.run.smithi203.stderr: | ~~~~~~~~~~~~^~~~~~ 2023-11-28T19:36:09.298 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c: In function 'hashcoll_f': 2023-11-28T19:36:09.298 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:417:52: warning: pointer targets in passing argument 2 of 'collide_xattrs' differ in signedness [-Wpointer-sign] 2023-11-28T19:36:09.298 INFO:teuthology.orchestra.run.smithi203.stderr: 417 | error = collide_xattrs(nr, buf, len, fd); 2023-11-28T19:36:09.298 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~ 2023-11-28T19:36:09.298 INFO:teuthology.orchestra.run.smithi203.stderr: | | 2023-11-28T19:36:09.298 INFO:teuthology.orchestra.run.smithi203.stderr: | char * 2023-11-28T19:36:09.298 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:300:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-11-28T19:36:09.298 INFO:teuthology.orchestra.run.smithi203.stderr: 300 | const unsigned char *name, 2023-11-28T19:36:09.299 INFO:teuthology.orchestra.run.smithi203.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-11-28T19:36:09.299 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:419:53: warning: pointer targets in passing argument 2 of 'collide_dirents' differ in signedness [-Wpointer-sign] 2023-11-28T19:36:09.299 INFO:teuthology.orchestra.run.smithi203.stderr: 419 | error = collide_dirents(nr, buf, len, fd); 2023-11-28T19:36:09.299 INFO:teuthology.orchestra.run.smithi203.stderr: | ^~~ 2023-11-28T19:36:09.299 INFO:teuthology.orchestra.run.smithi203.stderr: | | 2023-11-28T19:36:09.299 INFO:teuthology.orchestra.run.smithi203.stderr: | char * 2023-11-28T19:36:09.299 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:234:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-11-28T19:36:09.299 INFO:teuthology.orchestra.run.smithi203.stderr: 234 | const unsigned char *name, 2023-11-28T19:36:09.299 INFO:teuthology.orchestra.run.smithi203.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-11-28T19:36:09.299 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:431:56: warning: pointer targets in passing argument 2 of 'collide_xattrs' differ in signedness [-Wpointer-sign] 2023-11-28T19:36:09.299 INFO:teuthology.orchestra.run.smithi203.stderr: 431 | error = collide_xattrs(nr, argv[c], len, fd); 2023-11-28T19:36:09.299 INFO:teuthology.orchestra.run.smithi203.stderr: | ~~~~^~~ 2023-11-28T19:36:09.300 INFO:teuthology.orchestra.run.smithi203.stderr: | | 2023-11-28T19:36:09.300 INFO:teuthology.orchestra.run.smithi203.stderr: | char * 2023-11-28T19:36:09.300 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:300:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-11-28T19:36:09.300 INFO:teuthology.orchestra.run.smithi203.stderr: 300 | const unsigned char *name, 2023-11-28T19:36:09.300 INFO:teuthology.orchestra.run.smithi203.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-11-28T19:36:09.300 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:433:57: warning: pointer targets in passing argument 2 of 'collide_dirents' differ in signedness [-Wpointer-sign] 2023-11-28T19:36:09.300 INFO:teuthology.orchestra.run.smithi203.stderr: 433 | error = collide_dirents(nr, argv[c], len, fd); 2023-11-28T19:36:09.300 INFO:teuthology.orchestra.run.smithi203.stderr: | ~~~~^~~ 2023-11-28T19:36:09.300 INFO:teuthology.orchestra.run.smithi203.stderr: | | 2023-11-28T19:36:09.300 INFO:teuthology.orchestra.run.smithi203.stderr: | char * 2023-11-28T19:36:09.300 INFO:teuthology.orchestra.run.smithi203.stderr:hash.c:234:34: note: expected 'const unsigned char *' but argument is of type 'char *' 2023-11-28T19:36:09.300 INFO:teuthology.orchestra.run.smithi203.stderr: 234 | const unsigned char *name, 2023-11-28T19:36:09.301 INFO:teuthology.orchestra.run.smithi203.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~~~^~~~ 2023-11-28T19:36:09.383 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] help.o 2023-11-28T19:36:09.386 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:36:09.391 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:36:09.394 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:36:09.497 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] init.o 2023-11-28T19:36:09.633 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] inode.o 2023-11-28T19:36:09.922 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] input.o 2023-11-28T19:36:10.071 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] io.o 2023-11-28T19:36:10.290 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] logformat.o 2023-11-28T19:36:10.425 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] malloc.o 2023-11-28T19:36:10.531 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] metadump.o 2023-11-28T19:36:11.349 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] output.o 2023-11-28T19:36:11.464 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] print.o 2023-11-28T19:36:11.626 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] quit.o 2023-11-28T19:36:11.725 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] sb.o 2023-11-28T19:36:11.977 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] sig.o 2023-11-28T19:36:12.084 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] strvec.o 2023-11-28T19:36:12.196 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] text.o 2023-11-28T19:36:12.310 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] type.o 2023-11-28T19:36:12.447 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] write.o 2023-11-28T19:36:12.689 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] attrset.o 2023-11-28T19:36:12.822 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] symlink.o 2023-11-28T19:36:12.934 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fsmap.o 2023-11-28T19:36:13.073 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fuzz.o 2023-11-28T19:36:13.250 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] obfuscate.o 2023-11-28T19:36:13.400 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] btdump.o 2023-11-28T19:36:13.588 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] btheight.o 2023-11-28T19:36:13.768 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] convert.o 2023-11-28T19:36:13.920 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] info.o 2023-11-28T19:36:14.054 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] iunlink.o 2023-11-28T19:36:14.246 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] namei.o 2023-11-28T19:36:14.460 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] timelimit.o 2023-11-28T19:36:14.585 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] xfs_db 2023-11-28T19:36:14.833 INFO:teuthology.orchestra.run.smithi203.stdout:Building estimate 2023-11-28T19:36:14.890 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_estimate.o 2023-11-28T19:36:15.034 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] xfs_estimate 2023-11-28T19:36:15.121 INFO:teuthology.orchestra.run.smithi203.stdout:Building fsck 2023-11-28T19:36:15.128 INFO:teuthology.orchestra.run.smithi203.stdout:Building fsr 2023-11-28T19:36:15.186 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_fsr.o 2023-11-28T19:36:15.624 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] xfs_fsr 2023-11-28T19:36:15.751 INFO:teuthology.orchestra.run.smithi203.stdout:Building growfs 2023-11-28T19:36:15.808 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_growfs.o 2023-11-28T19:36:15.996 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] xfs_growfs 2023-11-28T19:36:16.182 INFO:teuthology.orchestra.run.smithi203.stdout:Building io 2023-11-28T19:36:17.562 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] init.o 2023-11-28T19:36:17.679 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] attr.o 2023-11-28T19:36:17.821 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] bmap.o 2023-11-28T19:36:17.999 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] bulkstat.o 2023-11-28T19:36:18.163 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] crc32cselftest.o 2023-11-28T19:36:18.248 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] cowextsize.o 2023-11-28T19:36:18.360 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] encrypt.o 2023-11-28T19:36:18.583 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] file.o 2023-11-28T19:36:18.685 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] freeze.o 2023-11-28T19:36:18.772 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fsuuid.o 2023-11-28T19:36:18.880 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fsync.o 2023-11-28T19:36:18.960 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] getrusage.o 2023-11-28T19:36:19.053 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] imap.o 2023-11-28T19:36:19.140 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] inject.o 2023-11-28T19:36:19.237 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] label.o 2023-11-28T19:36:19.349 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] link.o 2023-11-28T19:36:19.430 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] mmap.o 2023-11-28T19:36:19.633 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] open.o 2023-11-28T19:36:19.914 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] parent.o 2023-11-28T19:36:20.071 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] pread.o 2023-11-28T19:36:20.249 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] prealloc.o 2023-11-28T19:36:20.390 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] pwrite.o 2023-11-28T19:36:20.542 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] reflink.o 2023-11-28T19:36:20.673 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] resblks.o 2023-11-28T19:36:20.757 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] scrub.o 2023-11-28T19:36:20.888 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] seek.o 2023-11-28T19:36:20.995 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] shutdown.o 2023-11-28T19:36:21.078 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] stat.o 2023-11-28T19:36:21.280 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] swapext.o 2023-11-28T19:36:21.369 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] sync.o 2023-11-28T19:36:21.447 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] truncate.o 2023-11-28T19:36:21.527 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] utimes.o 2023-11-28T19:36:21.608 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fadvise.o 2023-11-28T19:36:21.700 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] madvise.o 2023-11-28T19:36:21.791 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] mincore.o 2023-11-28T19:36:21.888 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] sendfile.o 2023-11-28T19:36:21.993 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fiemap.o 2023-11-28T19:36:22.144 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] copy_file_range.o 2023-11-28T19:36:22.248 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] sync_file_range.o 2023-11-28T19:36:22.336 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] readdir.o 2023-11-28T19:36:22.440 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] log_writes.o 2023-11-28T19:36:22.532 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fsmap.o 2023-11-28T19:36:22.763 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] xfs_io 2023-11-28T19:36:22.952 INFO:teuthology.orchestra.run.smithi203.stdout:Building logprint 2023-11-28T19:36:23.229 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] logprint.o 2023-11-28T19:36:23.374 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] log_copy.o 2023-11-28T19:36:23.492 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] log_dump.o 2023-11-28T19:36:23.616 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] log_misc.o 2023-11-28T19:36:24.135 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] log_print_all.o 2023-11-28T19:36:24.393 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] log_print_trans.o 2023-11-28T19:36:24.503 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] log_redo.o 2023-11-28T19:36:24.760 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] xfs_logprint 2023-11-28T19:36:24.953 INFO:teuthology.orchestra.run.smithi203.stdout:Building mkfs 2023-11-28T19:36:25.047 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] proto.o 2023-11-28T19:36:25.334 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_mkfs.o 2023-11-28T19:36:26.068 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] mkfs.xfs 2023-11-28T19:36:26.264 INFO:teuthology.orchestra.run.smithi203.stdout:Building quota 2023-11-28T19:36:26.653 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] init.o 2023-11-28T19:36:26.754 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] util.o 2023-11-28T19:36:26.912 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] edit.o 2023-11-28T19:36:27.113 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] free.o 2023-11-28T19:36:27.264 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] linux.o 2023-11-28T19:36:27.337 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] path.o 2023-11-28T19:36:27.447 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] project.o 2023-11-28T19:36:27.591 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] quot.o 2023-11-28T19:36:27.749 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] quota.o 2023-11-28T19:36:27.925 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] report.o 2023-11-28T19:36:28.146 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] state.o 2023-11-28T19:36:28.325 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] xfs_quota 2023-11-28T19:36:28.458 INFO:teuthology.orchestra.run.smithi203.stdout:Building mdrestore 2023-11-28T19:36:28.514 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_mdrestore.o 2023-11-28T19:36:28.678 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] xfs_mdrestore 2023-11-28T19:36:28.846 INFO:teuthology.orchestra.run.smithi203.stdout:Building repair 2023-11-28T19:36:30.170 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] agheader.o 2023-11-28T19:36:30.386 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] agbtree.o 2023-11-28T19:36:30.627 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] attr_repair.o 2023-11-28T19:36:30.980 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] avl.o 2023-11-28T19:36:31.197 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] bulkload.o 2023-11-28T19:36:31.313 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] bmap.o 2023-11-28T19:36:31.467 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] btree.o 2023-11-28T19:36:31.805 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] da_util.o 2023-11-28T19:36:32.029 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] dino_chunks.o 2023-11-28T19:36:32.412 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] dinode.o 2023-11-28T19:36:33.152 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] dir2.o 2023-11-28T19:36:33.569 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] globals.o 2023-11-28T19:36:33.663 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] incore_bmc.o 2023-11-28T19:36:33.765 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] incore.o 2023-11-28T19:36:33.914 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] incore_ext.o 2023-11-28T19:36:34.138 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] incore_ino.o 2023-11-28T19:36:34.408 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] init.o 2023-11-28T19:36:34.545 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] phase1.o 2023-11-28T19:36:34.679 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] phase2.o 2023-11-28T19:36:34.869 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] phase3.o 2023-11-28T19:36:35.008 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] phase4.o 2023-11-28T19:36:35.195 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] phase5.o 2023-11-28T19:36:35.446 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] phase6.o 2023-11-28T19:36:36.312 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] phase7.o 2023-11-28T19:36:36.442 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] prefetch.o 2023-11-28T19:36:36.783 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] progress.o 2023-11-28T19:36:36.992 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] quotacheck.o 2023-11-28T19:36:37.202 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] rmap.o 2023-11-28T19:36:37.600 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] rt.o 2023-11-28T19:36:37.755 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] sb.o 2023-11-28T19:36:37.976 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] scan.o 2023-11-28T19:36:38.746 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] slab.o 2023-11-28T19:36:38.912 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] threads.o 2023-11-28T19:36:39.026 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] versions.o 2023-11-28T19:36:39.146 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_repair.o 2023-11-28T19:36:39.451 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] xfs_repair 2023-11-28T19:36:39.512 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:36:39.516 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:36:39.518 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:36:39.703 INFO:teuthology.orchestra.run.smithi203.stdout:Building rtcp 2023-11-28T19:36:49.022 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_rtcp.o 2023-11-28T19:36:49.024 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] xfs_rtcp 2023-11-28T19:36:49.024 INFO:teuthology.orchestra.run.smithi203.stdout:Building m4 2023-11-28T19:36:49.075 INFO:teuthology.orchestra.run.smithi203.stdout:Building man 2023-11-28T19:36:49.075 INFO:teuthology.orchestra.run.smithi203.stdout:Building man2 2023-11-28T19:36:49.075 INFO:teuthology.orchestra.run.smithi203.stdout:Building man3 2023-11-28T19:36:49.075 INFO:teuthology.orchestra.run.smithi203.stdout:Building man5 2023-11-28T19:36:49.075 INFO:teuthology.orchestra.run.smithi203.stdout:Building man8 2023-11-28T19:36:49.075 INFO:teuthology.orchestra.run.smithi203.stdout: [SED] mkfs.xfs.8 2023-11-28T19:36:49.075 INFO:teuthology.orchestra.run.smithi203.stdout:Building doc 2023-11-28T19:36:49.075 INFO:teuthology.orchestra.run.smithi203.stdout: [ZIP] CHANGES.gz 2023-11-28T19:36:49.076 INFO:teuthology.orchestra.run.smithi203.stdout:Building debian 2023-11-28T19:36:49.076 INFO:teuthology.orchestra.run.smithi203.stdout:Building spaceman 2023-11-28T19:36:49.076 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] info.o 2023-11-28T19:36:49.076 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] init.o 2023-11-28T19:36:49.076 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] file.o 2023-11-28T19:36:49.076 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] health.o 2023-11-28T19:36:49.077 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] prealloc.o 2023-11-28T19:36:49.077 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] trim.o 2023-11-28T19:36:49.077 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] freesp.o 2023-11-28T19:36:49.077 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] xfs_spaceman 2023-11-28T19:36:49.077 INFO:teuthology.orchestra.run.smithi203.stdout:Building scrub 2023-11-28T19:36:49.077 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] common.o 2023-11-28T19:36:49.077 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] counter.o 2023-11-28T19:36:49.078 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] descr.o 2023-11-28T19:36:49.078 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] disk.o 2023-11-28T19:36:49.078 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] filemap.o 2023-11-28T19:36:49.078 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] fscounters.o 2023-11-28T19:36:49.078 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] inodes.o 2023-11-28T19:36:49.078 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] phase1.o 2023-11-28T19:36:49.079 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] phase2.o 2023-11-28T19:36:49.079 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] phase3.o 2023-11-28T19:36:49.079 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] phase4.o 2023-11-28T19:36:49.079 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] phase5.o 2023-11-28T19:36:49.079 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] phase6.o 2023-11-28T19:36:49.079 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] phase7.o 2023-11-28T19:36:49.080 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] progress.o 2023-11-28T19:36:49.080 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] read_verify.o 2023-11-28T19:36:49.080 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] repair.o 2023-11-28T19:36:49.080 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] scrub.o 2023-11-28T19:36:49.081 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] spacemap.o 2023-11-28T19:36:49.081 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] vfs.o 2023-11-28T19:36:49.081 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] xfs_scrub.o 2023-11-28T19:36:49.081 INFO:teuthology.orchestra.run.smithi203.stdout: [CC] unicrash.o 2023-11-28T19:36:49.081 INFO:teuthology.orchestra.run.smithi203.stdout: [LD] xfs_scrub 2023-11-28T19:36:49.082 INFO:teuthology.orchestra.run.smithi203.stdout: [SED] xfs_scrub_all 2023-11-28T19:36:49.082 INFO:teuthology.orchestra.run.smithi203.stdout: [SED] xfs_scrub@.service 2023-11-28T19:36:49.082 INFO:teuthology.orchestra.run.smithi203.stdout: [SED] xfs_scrub_all.service 2023-11-28T19:36:49.082 INFO:teuthology.orchestra.run.smithi203.stdout: [SED] xfs_scrub_fail@.service 2023-11-28T19:36:49.082 INFO:teuthology.orchestra.run.smithi203.stdout: [SED] xfs_scrub_all.cron 2023-11-28T19:36:49.082 INFO:teuthology.orchestra.run.smithi203.stdout:Building po 2023-11-28T19:36:49.083 INFO:teuthology.orchestra.run.smithi203.stdout: [GETTXT] xfsprogs.pot 2023-11-28T19:36:49.083 INFO:teuthology.orchestra.run.smithi203.stdout: [MSGFMT] de.mo 2023-11-28T19:36:49.083 INFO:teuthology.orchestra.run.smithi203.stderr:2345 translated messages. 2023-11-28T19:36:49.084 INFO:teuthology.orchestra.run.smithi203.stdout: [MSGFMT] pl.mo 2023-11-28T19:36:49.084 INFO:teuthology.orchestra.run.smithi203.stderr:3104 translated messages. 2023-11-28T19:36:49.086 INFO:teuthology.orchestra.run.smithi203.stdout:gmake[2]: Nothing to be done for 'include'. 2023-11-28T19:36:49.087 DEBUG:teuthology.orchestra.run.smithi203:> (cd /tmp/tmp.eVcldRLPeyxfsprogs-dev && exec sudo make install) 2023-11-28T19:36:49.124 INFO:teuthology.orchestra.run.smithi203.stdout:Installing libfrog-install 2023-11-28T19:36:49.568 INFO:teuthology.orchestra.run.smithi203.stdout:Installing libxfs-install 2023-11-28T19:36:51.222 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-11-28T19:36:51.244 INFO:teuthology.orchestra.run.smithi203.stdout:Installing libxlog-install 2023-11-28T19:36:51.334 INFO:teuthology.orchestra.run.smithi203.stdout:Installing libxcmd-install 2023-11-28T19:36:51.467 INFO:teuthology.orchestra.run.smithi203.stdout:Installing libhandle-install 2023-11-28T19:36:51.544 INFO:teuthology.orchestra.run.smithi203.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib 2023-11-28T19:36:51.610 INFO:teuthology.orchestra.run.smithi203.stdout:Installing copy-install 2023-11-28T19:36:51.662 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-28T19:36:51.682 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-11-28T19:36:51.738 INFO:teuthology.orchestra.run.smithi203.stdout:Installing db-install 2023-11-28T19:36:53.778 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-28T19:36:53.798 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-11-28T19:36:53.854 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-11-28T19:36:53.876 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-11-28T19:36:53.895 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-11-28T19:36:53.916 INFO:teuthology.orchestra.run.smithi203.stdout:Installing estimate-install 2023-11-28T19:36:53.968 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-28T19:36:53.988 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-11-28T19:36:54.036 INFO:teuthology.orchestra.run.smithi203.stdout:Installing fsck-install 2023-11-28T19:36:54.040 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-11-28T19:36:54.060 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-11-28T19:36:54.082 INFO:teuthology.orchestra.run.smithi203.stdout:Installing fsr-install 2023-11-28T19:36:54.135 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-28T19:36:54.156 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-11-28T19:36:54.204 INFO:teuthology.orchestra.run.smithi203.stdout:Installing growfs-install 2023-11-28T19:36:54.255 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-28T19:36:54.275 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-11-28T19:36:54.330 INFO:teuthology.orchestra.run.smithi203.stdout:Installing io-install 2023-11-28T19:36:55.704 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-28T19:36:55.724 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-11-28T19:36:55.772 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-11-28T19:36:55.819 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-11-28T19:36:55.865 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-11-28T19:36:55.913 INFO:teuthology.orchestra.run.smithi203.stdout:Installing logprint-install 2023-11-28T19:36:56.185 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-28T19:36:56.206 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-11-28T19:36:56.260 INFO:teuthology.orchestra.run.smithi203.stdout:Installing mkfs-install 2023-11-28T19:36:56.351 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-11-28T19:36:56.372 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-11-28T19:36:56.424 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-11-28T19:36:56.449 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf lts_6.6.conf /usr/share/xfsprogs/mkfs 2023-11-28T19:36:56.501 INFO:teuthology.orchestra.run.smithi203.stdout:Installing quota-install 2023-11-28T19:36:56.864 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-28T19:36:56.884 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-11-28T19:36:56.933 INFO:teuthology.orchestra.run.smithi203.stdout:Installing mdrestore-install 2023-11-28T19:36:56.984 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-28T19:36:57.004 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-11-28T19:36:57.058 INFO:teuthology.orchestra.run.smithi203.stdout:Installing repair-install 2023-11-28T19:36:58.374 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-11-28T19:36:58.394 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-11-28T19:36:58.451 INFO:teuthology.orchestra.run.smithi203.stdout:Installing rtcp-install 2023-11-28T19:36:58.503 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-28T19:36:58.523 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-11-28T19:36:58.572 INFO:teuthology.orchestra.run.smithi203.stdout:Installing m4-install 2023-11-28T19:36:58.576 INFO:teuthology.orchestra.run.smithi203.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-28T19:36:58.577 INFO:teuthology.orchestra.run.smithi203.stdout:Installing man-install 2023-11-28T19:36:58.588 INFO:teuthology.orchestra.run.smithi203.stdout:gmake[2]: Nothing to be done for 'install'. 2023-11-28T19:36:58.593 INFO:teuthology.orchestra.run.smithi203.stdout:gmake[2]: Nothing to be done for 'install'. 2023-11-28T19:36:58.602 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-11-28T19:36:58.628 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-11-28T19:36:58.652 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-11-28T19:36:58.676 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-11-28T19:36:58.708 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-11-28T19:36:58.732 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-11-28T19:36:58.756 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-11-28T19:36:58.779 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-11-28T19:36:58.803 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-11-28T19:36:58.827 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-11-28T19:36:58.851 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-11-28T19:36:58.874 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-11-28T19:36:58.897 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-11-28T19:36:58.921 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-11-28T19:36:58.945 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-11-28T19:36:58.969 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-11-28T19:36:58.993 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-11-28T19:36:59.017 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-11-28T19:36:59.040 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-11-28T19:36:59.064 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-11-28T19:36:59.088 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-11-28T19:36:59.112 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-11-28T19:36:59.135 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-11-28T19:36:59.159 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-11-28T19:36:59.182 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-11-28T19:36:59.206 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-11-28T19:36:59.230 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-11-28T19:36:59.254 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-11-28T19:36:59.277 INFO:teuthology.orchestra.run.smithi203.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-11-28T19:36:59.299 INFO:teuthology.orchestra.run.smithi203.stdout:Installing doc-install 2023-11-28T19:36:59.303 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-11-28T19:36:59.323 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-11-28T19:36:59.361 INFO:teuthology.orchestra.run.smithi203.stdout:Installing debian-install 2023-11-28T19:36:59.365 INFO:teuthology.orchestra.run.smithi203.stdout:gmake[1]: Nothing to be done for 'install'. 2023-11-28T19:36:59.366 INFO:teuthology.orchestra.run.smithi203.stdout:Installing spaceman-install 2023-11-28T19:36:59.644 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-28T19:36:59.664 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-11-28T19:36:59.711 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-11-28T19:36:59.733 INFO:teuthology.orchestra.run.smithi203.stdout:Installing scrub-install 2023-11-28T19:37:00.451 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-11-28T19:37:00.471 INFO:teuthology.orchestra.run.smithi203.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-11-28T19:37:00.519 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-11-28T19:37:00.540 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /lib/systemd/system 2023-11-28T19:37:00.559 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /lib/systemd/system 2023-11-28T19:37:00.597 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/xfsprogs 2023-11-28T19:37:00.617 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib/xfsprogs 2023-11-28T19:37:00.644 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/xfsprogs 2023-11-28T19:37:00.664 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib/xfsprogs 2023-11-28T19:37:00.685 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /lib/udev/rules.d 2023-11-28T19:37:00.705 INFO:teuthology.orchestra.run.smithi203.stdout:for i in xfs.rules; do \ 2023-11-28T19:37:00.705 INFO:teuthology.orchestra.run.smithi203.stdout: ../install-sh -o root -g root -m 644 $i /lib/udev/rules.d/64-$i; \ 2023-11-28T19:37:00.705 INFO:teuthology.orchestra.run.smithi203.stdout:done 2023-11-28T19:37:00.727 INFO:teuthology.orchestra.run.smithi203.stdout:Installing po-install 2023-11-28T19:37:00.821 INFO:teuthology.orchestra.run.smithi203.stdout:Installing include-install 2023-11-28T19:37:00.825 INFO:teuthology.orchestra.run.smithi203.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-11-28T19:37:00.845 INFO:teuthology.orchestra.run.smithi203.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-11-28T19:37:00.865 INFO:teuthology.orchestra.run.smithi203.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-11-28T19:37:00.888 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-11-28T19:37:01.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.019+0000 7f8f80100640 1 Processor -- start 2023-11-28T19:37:01.024 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f80100640 1 -- start start 2023-11-28T19:37:01.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f80100640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8f780bbad0 0x7f8f7814b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:37:01.027 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f80100640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f780bce60 con 0x7f8f7806af40 2023-11-28T19:37:01.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f80100640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f780a6b70 con 0x7f8f7806ab60 2023-11-28T19:37:01.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f80100640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f780bd5d0 con 0x7f8f780bbad0 2023-11-28T19:37:01.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7e69d640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8f7806af40 0x7f8f78155e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:49998/0 (socket says 172.21.15.28:49998) 2023-11-28T19:37:01.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7e69d640 1 -- 172.21.15.28:0/793056594 learned_addr learned my addr 172.21.15.28:0/793056594 (peer_addr_for_me v1:172.21.15.28:0/0) 2023-11-28T19:37:01.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7d69b640 1 --2- 172.21.15.28:0/793056594 >> v2:172.21.15.131:3300/0 conn(0x7f8f780bbad0 0x7f8f7814b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:37:01.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 -- 172.21.15.28:0/793056594 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2579559093 0 0) 0x7f8f780bce60 con 0x7f8f7806af40 2023-11-28T19:37:01.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 -- 172.21.15.28:0/793056594 --> v1:172.21.15.28:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f64003530 con 0x7f8f7806af40 2023-11-28T19:37:01.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 -- 172.21.15.28:0/793056594 <== mon.0 v1:172.21.15.28:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3131615769 0 0) 0x7f8f64003530 con 0x7f8f7806af40 2023-11-28T19:37:01.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 -- 172.21.15.28:0/793056594 >> v2:172.21.15.131:3300/0 conn(0x7f8f780bbad0 msgr2=0x7f8f7814b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:37:01.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 --2- 172.21.15.28:0/793056594 >> v2:172.21.15.131:3300/0 conn(0x7f8f780bbad0 0x7f8f7814b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.028 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 -- 172.21.15.28:0/793056594 >> v1:172.21.15.131:6789/0 conn(0x7f8f7806ab60 legacy=0x7f8f780a6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:37:01.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 -- 172.21.15.28:0/793056594 --> v1:172.21.15.28:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f780bff70 con 0x7f8f7806af40 2023-11-28T19:37:01.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 -- 172.21.15.28:0/793056594 <== mon.0 v1:172.21.15.28:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3675247816 0 0) 0x7f8f70001a00 con 0x7f8f7806af40 2023-11-28T19:37:01.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 -- 172.21.15.28:0/793056594 >> v1:172.21.15.28:6789/0 conn(0x7f8f7806af40 legacy=0x7f8f78155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:37:01.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 --2- 172.21.15.28:0/793056594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f640039d0 0x7f8f64003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:37:01.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 --2- 172.21.15.28:0/793056594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f640047d0 0x7f8f64004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:37:01.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 --2- 172.21.15.28:0/793056594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f64005190 0x7f8f6400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:37:01.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7de9c640 1 --2- 172.21.15.28:0/793056594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f640039d0 0x7f8f64003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:37:01.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 -- 172.21.15.28:0/793056594 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f780bd5d0 con 0x7f8f640039d0 2023-11-28T19:37:01.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 -- 172.21.15.28:0/793056594 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6400c090 con 0x7f8f64005190 2023-11-28T19:37:01.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7ce9a640 1 -- 172.21.15.28:0/793056594 --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f6400c250 con 0x7f8f640047d0 2023-11-28T19:37:01.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7d69b640 1 --2- 172.21.15.28:0/793056594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f640047d0 0x7f8f64004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:37:01.029 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7e69d640 1 --2- 172.21.15.28:0/793056594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f64005190 0x7f8f6400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:37:01.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7de9c640 1 -- 172.21.15.28:0/793056594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f640047d0 msgr2=0x7f8f64004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:37:01.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7de9c640 1 --2- 172.21.15.28:0/793056594 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f640047d0 0x7f8f64004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7de9c640 1 -- 172.21.15.28:0/793056594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f64005190 msgr2=0x7f8f6400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:37:01.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7de9c640 1 --2- 172.21.15.28:0/793056594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f64005190 0x7f8f6400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7de9c640 1 -- 172.21.15.28:0/793056594 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f64003530 con 0x7f8f640039d0 2023-11-28T19:37:01.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7e69d640 1 --2- 172.21.15.28:0/793056594 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f64005190 0x7f8f6400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-11-28T19:37:01.030 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.023+0000 7f8f7e69d640 1 -- 172.21.15.28:0/793056594 reap_dead start 2023-11-28T19:37:01.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.027+0000 7f8f7de9c640 1 --2- 172.21.15.28:0/793056594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f640039d0 0x7f8f64003df0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8f74001780 tx=0x7f8f7401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fbf892eb09bdc1 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:37:01.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.027+0000 7f8f7ce9a640 1 -- 172.21.15.28:0/793056594 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f740052d0 con 0x7f8f640039d0 2023-11-28T19:37:01.031 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.027+0000 7f8f7ce9a640 1 -- 172.21.15.28:0/793056594 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f740a7050 con 0x7f8f640039d0 2023-11-28T19:37:01.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.027+0000 7f8f7ce9a640 1 -- 172.21.15.28:0/793056594 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f74003600 con 0x7f8f640039d0 2023-11-28T19:37:01.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.027+0000 7f8f80100640 1 -- 172.21.15.28:0/793056594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f640039d0 msgr2=0x7f8f64003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:37:01.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.027+0000 7f8f80100640 1 --2- 172.21.15.28:0/793056594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f640039d0 0x7f8f64003df0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8f74001780 tx=0x7f8f7401c3b0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.027+0000 7f8f80100640 1 -- 172.21.15.28:0/793056594 shutdown_connections 2023-11-28T19:37:01.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.027+0000 7f8f80100640 1 --2- 172.21.15.28:0/793056594 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f640039d0 0x7f8f64003df0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.027+0000 7f8f80100640 1 -- 172.21.15.28:0/793056594 >> 172.21.15.28:0/793056594 conn(0x7f8f780c0c90 msgr2=0x7f8f780c10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:37:01.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.027+0000 7f8f80100640 1 -- 172.21.15.28:0/793056594 shutdown_connections 2023-11-28T19:37:01.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.027+0000 7f8f80100640 1 -- 172.21.15.28:0/793056594 wait complete. 2023-11-28T19:37:01.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.027+0000 7f8f80100640 1 Processor -- start 2023-11-28T19:37:01.032 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.027+0000 7f8f80100640 1 -- start start 2023-11-28T19:37:01.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f80100640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f640039d0 0x7f8f78147810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:37:01.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f80100640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f780b9ed0 0x7f8f780ba330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:37:01.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f80100640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f781e4a00 0x7f8f781e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:37:01.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f80100640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f78147d50 con 0x7f8f780b9ed0 2023-11-28T19:37:01.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f80100640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f781e53c0 con 0x7f8f640039d0 2023-11-28T19:37:01.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f80100640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f780b8270 con 0x7f8f781e4a00 2023-11-28T19:37:01.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f7d69b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f780b9ed0 0x7f8f780ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:37:01.034 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f7d69b640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f780b9ed0 0x7f8f780ba330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38508/0 (socket says 172.21.15.28:38508) 2023-11-28T19:37:01.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f7d69b640 1 -- 172.21.15.28:0/918731639 learned_addr learned my addr 172.21.15.28:0/918731639 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:37:01.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f7e69d640 1 --2- 172.21.15.28:0/918731639 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f781e4a00 0x7f8f781e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:37:01.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f7de9c640 1 --2- 172.21.15.28:0/918731639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f640039d0 0x7f8f78147810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:37:01.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f7d69b640 1 -- 172.21.15.28:0/918731639 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f781e4a00 msgr2=0x7f8f781e4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:37:01.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f7d69b640 1 --2- 172.21.15.28:0/918731639 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f781e4a00 0x7f8f781e4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f7d69b640 1 -- 172.21.15.28:0/918731639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f640039d0 msgr2=0x7f8f78147810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:37:01.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f7d69b640 1 --2- 172.21.15.28:0/918731639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f640039d0 0x7f8f78147810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f7d69b640 1 -- 172.21.15.28:0/918731639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f780b7f90 con 0x7f8f780b9ed0 2023-11-28T19:37:01.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f7d69b640 1 --2- 172.21.15.28:0/918731639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f780b9ed0 0x7f8f780ba330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8f68011650 tx=0x7f8f68011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:37:01.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f6e7fc640 1 -- 172.21.15.28:0/918731639 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f6800f9c0 con 0x7f8f780b9ed0 2023-11-28T19:37:01.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f6e7fc640 1 -- 172.21.15.28:0/918731639 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f6800fb20 con 0x7f8f780b9ed0 2023-11-28T19:37:01.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f80100640 1 -- 172.21.15.28:0/918731639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f7814e0f0 con 0x7f8f780b9ed0 2023-11-28T19:37:01.035 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f6e7fc640 1 -- 172.21.15.28:0/918731639 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f68015460 con 0x7f8f780b9ed0 2023-11-28T19:37:01.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f80100640 1 -- 172.21.15.28:0/918731639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f781e44e0 con 0x7f8f780b9ed0 2023-11-28T19:37:01.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f80100640 1 -- 172.21.15.28:0/918731639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f78074a90 con 0x7f8f780b9ed0 2023-11-28T19:37:01.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f6e7fc640 1 -- 172.21.15.28:0/918731639 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8f680155c0 con 0x7f8f780b9ed0 2023-11-28T19:37:01.036 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f6e7fc640 1 --2- 172.21.15.28:0/918731639 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8f5c066470 0x7f8f5c068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:37:01.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f6e7fc640 1 -- 172.21.15.28:0/918731639 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f680846a0 con 0x7f8f780b9ed0 2023-11-28T19:37:01.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.031+0000 7f8f7de9c640 1 --2- 172.21.15.28:0/918731639 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8f5c066470 0x7f8f5c068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:37:01.037 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.035+0000 7f8f7de9c640 1 --2- 172.21.15.28:0/918731639 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8f5c066470 0x7f8f5c068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8f74001750 tx=0x7f8f740011a0 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:37:01.040 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.035+0000 7f8f6e7fc640 1 -- 172.21.15.28:0/918731639 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8f68051bb0 con 0x7f8f780b9ed0 2023-11-28T19:37:01.253 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.251+0000 7f8f80100640 1 -- 172.21.15.28:0/918731639 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8f780bfaa0 con 0x7f8f780b9ed0 2023-11-28T19:37:01.254 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.251+0000 7f8f6e7fc640 1 -- 172.21.15.28:0/918731639 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f8f68022510 con 0x7f8f780b9ed0 2023-11-28T19:37:01.254 INFO:teuthology.orchestra.run.smithi028.stdout: 2023-11-28T19:37:01.254 INFO:teuthology.orchestra.run.smithi028.stdout:{"epoch":1,"fsid":"ae116b99-23bb-451b-9ddc-fdb049a33145","modified":"2023-11-28T19:30:37.694716Z","created":"2023-11-28T19:30:37.694716Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.28:3300","nonce":0},{"type":"v1","addr":"172.21.15.28:6789","nonce":0}]},"addr":"172.21.15.28:6789/0","public_addr":"172.21.15.28:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:3300","nonce":0},{"type":"v1","addr":"172.21.15.131:6789","nonce":0}]},"addr":"172.21.15.131:6789/0","public_addr":"172.21.15.131:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:3301","nonce":0},{"type":"v1","addr":"172.21.15.131:6790","nonce":0}]},"addr":"172.21.15.131:6790/0","public_addr":"172.21.15.131:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-11-28T19:37:01.254 INFO:teuthology.orchestra.run.smithi028.stderr:dumped monmap epoch 1 2023-11-28T19:37:01.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.251+0000 7f8f80100640 1 -- 172.21.15.28:0/918731639 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8f5c066470 msgr2=0x7f8f5c068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:37:01.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.251+0000 7f8f80100640 1 --2- 172.21.15.28:0/918731639 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8f5c066470 0x7f8f5c068930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f8f74001750 tx=0x7f8f740011a0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.251+0000 7f8f80100640 1 -- 172.21.15.28:0/918731639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f780b9ed0 msgr2=0x7f8f780ba330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:37:01.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.251+0000 7f8f80100640 1 --2- 172.21.15.28:0/918731639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f780b9ed0 0x7f8f780ba330 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8f68011650 tx=0x7f8f68011b10 comp rx=0 tx=0).stop 2023-11-28T19:37:01.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.251+0000 7f8f80100640 1 -- 172.21.15.28:0/918731639 shutdown_connections 2023-11-28T19:37:01.257 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.251+0000 7f8f80100640 1 --2- 172.21.15.28:0/918731639 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8f5c066470 0x7f8f5c068930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.251+0000 7f8f80100640 1 --2- 172.21.15.28:0/918731639 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8f781e4a00 0x7f8f781e4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.251+0000 7f8f80100640 1 --2- 172.21.15.28:0/918731639 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8f780b9ed0 0x7f8f780ba330 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.251+0000 7f8f80100640 1 --2- 172.21.15.28:0/918731639 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f640039d0 0x7f8f78147810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.251+0000 7f8f80100640 1 -- 172.21.15.28:0/918731639 >> 172.21.15.28:0/918731639 conn(0x7f8f780c0c90 msgr2=0x7f8f780bd710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:37:01.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.255+0000 7f8f80100640 1 -- 172.21.15.28:0/918731639 shutdown_connections 2023-11-28T19:37:01.258 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.255+0000 7f8f80100640 1 -- 172.21.15.28:0/918731639 wait complete. 2023-11-28T19:37:01.273 DEBUG:teuthology.orchestra.run.smithi028:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-11-28T19:37:01.398 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.395+0000 7f8beef74640 1 Processor -- start 2023-11-28T19:37:01.399 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.395+0000 7f8beef74640 1 -- start start 2023-11-28T19:37:01.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.395+0000 7f8beef74640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8be8142560 0x7f8be80b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:37:01.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.395+0000 7f8beef74640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8be80b4610 0x7f8be80b6b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:37:01.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.395+0000 7f8beef74640 1 -- --> v1:172.21.15.28:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8be80b4a80 con 0x7f8be80b5dd0 2023-11-28T19:37:01.400 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.395+0000 7f8beef74640 1 -- --> v2:172.21.15.28:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be806f950 con 0x7f8be8142560 2023-11-28T19:37:01.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.395+0000 7f8beef74640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8be80b70c0 con 0x7f8be80b4610 2023-11-28T19:37:01.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.395+0000 7f8becd10640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8be8142560 0x7f8be80b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:37:01.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.395+0000 7f8becd10640 1 --2- >> v2:172.21.15.28:3300/0 conn(0x7f8be8142560 0x7f8be80b40d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38516/0 (socket says 172.21.15.28:38516) 2023-11-28T19:37:01.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.395+0000 7f8be7fff640 1 --1- >> v1:172.21.15.28:6789/0 conn(0x7f8be80b5dd0 0x7f8be80b6470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.28:6789/0 says I am v1:172.21.15.28:50006/0 (socket says 172.21.15.28:50006) 2023-11-28T19:37:01.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.395+0000 7f8becd10640 1 -- 172.21.15.28:0/2858739849 learned_addr learned my addr 172.21.15.28:0/2858739849 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:37:01.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.395+0000 7f8bed511640 1 --2- 172.21.15.28:0/2858739849 >> v2:172.21.15.131:3300/0 conn(0x7f8be80b4610 0x7f8be80b6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:37:01.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8becd10640 1 -- 172.21.15.28:0/2858739849 >> v2:172.21.15.131:3300/0 conn(0x7f8be80b4610 msgr2=0x7f8be80b6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-11-28T19:37:01.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8becd10640 1 --2- 172.21.15.28:0/2858739849 >> v2:172.21.15.131:3300/0 conn(0x7f8be80b4610 0x7f8be80b6b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8becd10640 1 -- 172.21.15.28:0/2858739849 >> v1:172.21.15.28:6789/0 conn(0x7f8be80b5dd0 legacy=0x7f8be80b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:37:01.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8be77fe640 1 -- 172.21.15.28:0/2858739849 <== mon.0 v1:172.21.15.28:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1744531463 0 0) 0x7f8be80b4a80 con 0x7f8be80b5dd0 2023-11-28T19:37:01.401 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8becd10640 1 -- 172.21.15.28:0/2858739849 --> v2:172.21.15.28:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be8142940 con 0x7f8be8142560 2023-11-28T19:37:01.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8becd10640 1 --2- 172.21.15.28:0/2858739849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8be8142560 0x7f8be80b40d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8be8149320 tx=0x7f8bdc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9a9015126b11df server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:37:01.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8be77fe640 1 -- 172.21.15.28:0/2858739849 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0a89f0 con 0x7f8be8142560 2023-11-28T19:37:01.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8be77fe640 1 -- 172.21.15.28:0/2858739849 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bdc0a8b50 con 0x7f8be8142560 2023-11-28T19:37:01.403 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8be77fe640 1 -- 172.21.15.28:0/2858739849 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0b0440 con 0x7f8be8142560 2023-11-28T19:37:01.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8beef74640 1 -- 172.21.15.28:0/2858739849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8be8142560 msgr2=0x7f8be80b40d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:37:01.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8beef74640 1 --2- 172.21.15.28:0/2858739849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8be8142560 0x7f8be80b40d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f8be8149320 tx=0x7f8bdc01ecf0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8beef74640 1 -- 172.21.15.28:0/2858739849 shutdown_connections 2023-11-28T19:37:01.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8beef74640 1 --2- 172.21.15.28:0/2858739849 >> v2:172.21.15.131:3300/0 conn(0x7f8be80b4610 0x7f8be80b6b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.404 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8beef74640 1 --2- 172.21.15.28:0/2858739849 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8be8142560 0x7f8be80b40d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8beef74640 1 -- 172.21.15.28:0/2858739849 >> 172.21.15.28:0/2858739849 conn(0x7f8be80bcb40 msgr2=0x7f8be80bcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:37:01.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8beef74640 1 -- 172.21.15.28:0/2858739849 shutdown_connections 2023-11-28T19:37:01.405 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.399+0000 7f8beef74640 1 -- 172.21.15.28:0/2858739849 wait complete. 2023-11-28T19:37:01.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8beef74640 1 Processor -- start 2023-11-28T19:37:01.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8beef74640 1 -- start start 2023-11-28T19:37:01.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8beef74640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8be80b4610 0x7f8be813c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:37:01.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8beef74640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8be80b5dd0 0x7f8be814a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:37:01.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8beef74640 1 --2- >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8be8142560 0x7f8be813d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:37:01.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8beef74640 1 -- --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8141380 con 0x7f8be80b5dd0 2023-11-28T19:37:01.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8beef74640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8be813cdf0 con 0x7f8be80b4610 2023-11-28T19:37:01.406 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8beef74640 1 -- --> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8be8141560 con 0x7f8be8142560 2023-11-28T19:37:01.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8be7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8be80b5dd0 0x7f8be814a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:37:01.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8be7fff640 1 --2- >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8be80b5dd0 0x7f8be814a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.28:3300/0 says I am v2:172.21.15.28:38532/0 (socket says 172.21.15.28:38532) 2023-11-28T19:37:01.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8be7fff640 1 -- 172.21.15.28:0/352649024 learned_addr learned my addr 172.21.15.28:0/352649024 (peer_addr_for_me v2:172.21.15.28:0/0) 2023-11-28T19:37:01.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8be7fff640 1 -- 172.21.15.28:0/352649024 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8be8142560 msgr2=0x7f8be813d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:37:01.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8be7fff640 1 --2- 172.21.15.28:0/352649024 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8be8142560 0x7f8be813d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8be7fff640 1 -- 172.21.15.28:0/352649024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8be80b4610 msgr2=0x7f8be813c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:37:01.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8be7fff640 1 --2- 172.21.15.28:0/352649024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8be80b4610 0x7f8be813c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.407 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8be7fff640 1 -- 172.21.15.28:0/352649024 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc0094d0 con 0x7f8be80b5dd0 2023-11-28T19:37:01.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8be7fff640 1 --2- 172.21.15.28:0/352649024 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8be80b5dd0 0x7f8be814a5d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c4b0 tx=0x7f8bd400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:37:01.408 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8be57fa640 1 -- 172.21.15.28:0/352649024 <== mon.0 v2:172.21.15.28:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40074e0 con 0x7f8be80b5dd0 2023-11-28T19:37:01.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8be57fa640 1 -- 172.21.15.28:0/352649024 <== mon.0 v2:172.21.15.28:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd4007660 con 0x7f8be80b5dd0 2023-11-28T19:37:01.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8beef74640 1 -- 172.21.15.28:0/352649024 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8be813e9b0 con 0x7f8be80b5dd0 2023-11-28T19:37:01.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8be57fa640 1 -- 172.21.15.28:0/352649024 <== mon.0 v2:172.21.15.28:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4004a30 con 0x7f8be80b5dd0 2023-11-28T19:37:01.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8beef74640 1 -- 172.21.15.28:0/352649024 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8be813e640 con 0x7f8be80b5dd0 2023-11-28T19:37:01.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.403+0000 7f8beef74640 1 -- 172.21.15.28:0/352649024 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8be8074a90 con 0x7f8be80b5dd0 2023-11-28T19:37:01.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.407+0000 7f8be57fa640 1 -- 172.21.15.28:0/352649024 <== mon.0 v2:172.21.15.28:3300/0 4 ==== mgrmap(e 5) v1 ==== 85852+0+0 (secure 0 0 0) 0x7f8bd4004b90 con 0x7f8be80b5dd0 2023-11-28T19:37:01.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.407+0000 7f8be57fa640 1 --2- 172.21.15.28:0/352649024 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8bcc066470 0x7f8bcc068930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-11-28T19:37:01.409 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.407+0000 7f8be57fa640 1 -- 172.21.15.28:0/352649024 <== mon.0 v2:172.21.15.28:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8bd4083160 con 0x7f8be80b5dd0 2023-11-28T19:37:01.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.407+0000 7f8becd10640 1 --2- 172.21.15.28:0/352649024 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8bcc066470 0x7f8bcc068930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-11-28T19:37:01.410 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.407+0000 7f8becd10640 1 --2- 172.21.15.28:0/352649024 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8bcc066470 0x7f8bcc068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0b2000 tx=0x7f8bdc004740 comp rx=0 tx=0).ready entity=mgr.4100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-11-28T19:37:01.413 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.411+0000 7f8be57fa640 1 -- 172.21.15.28:0/352649024 <== mon.0 v2:172.21.15.28:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+172649 (secure 0 0 0) 0x7f8bd40505d0 con 0x7f8be80b5dd0 2023-11-28T19:37:01.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.627+0000 7f8beef74640 1 -- 172.21.15.28:0/352649024 --> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f8be813eb40 con 0x7f8be80b5dd0 2023-11-28T19:37:01.632 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.631+0000 7f8be57fa640 1 -- 172.21.15.28:0/352649024 <== mon.0 v2:172.21.15.28:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) v1 ==== 92+0+63 (secure 0 0 0) 0x7f8bd40180a0 con 0x7f8be80b5dd0 2023-11-28T19:37:01.632 INFO:teuthology.orchestra.run.smithi028.stdout:[client.admin] 2023-11-28T19:37:01.633 INFO:teuthology.orchestra.run.smithi028.stdout: key = AQDdP2ZlbxBENBAAPWOr8aN2mLMM5rsjI2r/lA== 2023-11-28T19:37:01.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.631+0000 7f8beef74640 1 -- 172.21.15.28:0/352649024 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8bcc066470 msgr2=0x7f8bcc068930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:37:01.634 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.631+0000 7f8beef74640 1 --2- 172.21.15.28:0/352649024 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8bcc066470 0x7f8bcc068930 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0b2000 tx=0x7f8bdc004740 comp rx=0 tx=0).stop 2023-11-28T19:37:01.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.631+0000 7f8beef74640 1 -- 172.21.15.28:0/352649024 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8be80b5dd0 msgr2=0x7f8be814a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-11-28T19:37:01.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.631+0000 7f8beef74640 1 --2- 172.21.15.28:0/352649024 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8be80b5dd0 0x7f8be814a5d0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400c4b0 tx=0x7f8bd400c970 comp rx=0 tx=0).stop 2023-11-28T19:37:01.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.631+0000 7f8beef74640 1 -- 172.21.15.28:0/352649024 shutdown_connections 2023-11-28T19:37:01.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.631+0000 7f8beef74640 1 --2- 172.21.15.28:0/352649024 >> [v2:172.21.15.131:6832/3367043860,v1:172.21.15.131:6833/3367043860] conn(0x7f8bcc066470 0x7f8bcc068930 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.631+0000 7f8beef74640 1 --2- 172.21.15.28:0/352649024 >> [v2:172.21.15.131:3301/0,v1:172.21.15.131:6790/0] conn(0x7f8be8142560 0x7f8be813d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.631+0000 7f8beef74640 1 --2- 172.21.15.28:0/352649024 >> [v2:172.21.15.28:3300/0,v1:172.21.15.28:6789/0] conn(0x7f8be80b5dd0 0x7f8be814a5d0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.631+0000 7f8beef74640 1 --2- 172.21.15.28:0/352649024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8be80b4610 0x7f8be813c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-11-28T19:37:01.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.631+0000 7f8beef74640 1 -- 172.21.15.28:0/352649024 >> 172.21.15.28:0/352649024 conn(0x7f8be80bcb40 msgr2=0x7f8be8132060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-11-28T19:37:01.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.631+0000 7f8beef74640 1 -- 172.21.15.28:0/352649024 shutdown_connections 2023-11-28T19:37:01.635 INFO:teuthology.orchestra.run.smithi028.stderr:2023-11-28T19:37:01.631+0000 7f8beef74640 1 -- 172.21.15.28:0/352649024 wait complete. 2023-11-28T19:37:01.652 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2023-11-28T19:37:01.652 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/tmp/tmp.N8wkfFNIvbxfstests-dev/local.config 2023-11-28T19:37:01.673 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.28:6789:/test export TEST_DIR=/tmp/tmp.T5Ht4oNXxhtest export SCRATCH_DEV=172.21.15.28:6789:/scratch export SCRATCH_MNT=/tmp/tmp.KZg81Ahl5Nscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQDdP2ZlbxBENBAAPWOr8aN2mLMM5rsjI2r/lA==,test_dummy_encryption" 2023-11-28T19:37:01.673 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-11-28T19:37:01.673 DEBUG:teuthology.orchestra.run.smithi203:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.N8wkfFNIvbxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-11-28T19:37:03.450 INFO:teuthology.orchestra.run.smithi203.stdout:FSTYP -- ceph 2023-11-28T19:37:03.461 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM -- Linux/x86_64 smithi203 6.6.0-g8247bbb5b470 #1 SMP PREEMPT_DYNAMIC Thu Nov 23 03:51:03 UTC 2023 2023-11-28T19:37:03.462 INFO:teuthology.orchestra.run.smithi203.stdout:MKFS_OPTIONS -- 172.21.15.28:6789:/scratch 2023-11-28T19:37:03.464 INFO:teuthology.orchestra.run.smithi203.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDdP2ZlbxBENBAAPWOr8aN2mLMM5rsjI2r/lA==,test_dummy_encryption 172.21.15.28:6789:/scratch /tmp/tmp.KZg81Ahl5Nscratch 2023-11-28T19:37:03.464 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:37:03.596 INFO:teuthology.orchestra.run.smithi203.stdout:ceph/001 [expunged] 2023-11-28T19:37:03.953 INFO:teuthology.orchestra.run.smithi203.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-28T19:37:04.319 INFO:teuthology.orchestra.run.smithi203.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-28T19:37:04.784 INFO:teuthology.orchestra.run.smithi203.stdout:ceph/004 0s 2023-11-28T19:37:05.070 INFO:teuthology.orchestra.run.smithi203.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-28T19:37:09.654 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:37:09.657 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:37:09.659 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:37:15.033 INFO:teuthology.orchestra.run.smithi203.stdout:generic/001 10s 2023-11-28T19:37:15.743 INFO:teuthology.orchestra.run.smithi203.stdout:generic/002 0s 2023-11-28T19:37:16.068 INFO:teuthology.orchestra.run.smithi203.stdout:generic/003 [not run] atime not maintained by ceph 2023-11-28T19:37:16.381 INFO:teuthology.orchestra.run.smithi203.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-11-28T19:37:17.180 INFO:teuthology.orchestra.run.smithi203.stdout:generic/005 1s 2023-11-28T19:37:39.781 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:37:39.785 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:37:39.788 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:37:58.324 INFO:teuthology.orchestra.run.smithi203.stdout:generic/006 41s 2023-11-28T19:38:09.904 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:38:09.907 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:38:09.910 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:38:39.968 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:38:43.723 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:38:43.730 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:39:13.815 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:39:13.819 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:39:13.822 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:39:33.214 INFO:teuthology.orchestra.run.smithi203.stdout:generic/007 95s 2023-11-28T19:39:35.622 INFO:teuthology.orchestra.run.smithi203.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T19:39:39.323 INFO:teuthology.orchestra.run.smithi203.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T19:39:44.116 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:39:44.119 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:39:44.122 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:40:14.274 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:40:14.279 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:40:14.282 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:40:34.881 INFO:teuthology.orchestra.run.smithi203.stdout:generic/011 55s 2023-11-28T19:40:37.561 INFO:teuthology.orchestra.run.smithi203.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T19:40:44.387 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:40:44.390 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:40:44.391 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:41:14.508 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:41:14.512 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:41:14.514 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:41:30.820 INFO:teuthology.orchestra.run.smithi203.stdout:generic/013 _check_dmesg: something found in dmesg (see /tmp/tmp.N8wkfFNIvbxfstests-dev/results//generic/013.dmesg) 2023-11-28T19:41:30.828 INFO:teuthology.orchestra.run.smithi203.stdout: 2023-11-28T19:41:44.800 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:41:44.803 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:41:44.805 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:42:15.011 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:42:15.014 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:42:15.016 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:42:45.443 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:42:45.445 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:42:45.448 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:43:15.514 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:43:15.516 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:43:15.518 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:43:45.575 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:43:45.578 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:43:45.581 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:43:50.734 INFO:teuthology.orchestra.run.smithi203.stdout:generic/014 140s 2023-11-28T19:43:51.049 INFO:teuthology.orchestra.run.smithi203.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T19:43:55.497 INFO:teuthology.orchestra.run.smithi203.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T19:43:55.920 INFO:teuthology.orchestra.run.smithi203.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-11-28T19:44:01.367 INFO:teuthology.orchestra.run.smithi203.stdout:generic/020 6s 2023-11-28T19:44:10.293 INFO:teuthology.orchestra.run.smithi203.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T19:44:14.528 INFO:teuthology.orchestra.run.smithi203.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T19:44:15.702 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:44:15.705 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:44:15.708 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:44:16.501 INFO:teuthology.orchestra.run.smithi203.stdout:generic/023 2s 2023-11-28T19:44:16.856 INFO:teuthology.orchestra.run.smithi203.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-11-28T19:44:17.209 INFO:teuthology.orchestra.run.smithi203.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-11-28T19:44:17.568 INFO:teuthology.orchestra.run.smithi203.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-11-28T19:44:22.878 INFO:teuthology.orchestra.run.smithi203.stdout:generic/028 5s 2023-11-28T19:44:24.092 INFO:teuthology.orchestra.run.smithi203.stdout:generic/029 2s 2023-11-28T19:44:33.791 INFO:teuthology.orchestra.run.smithi203.stdout:generic/030 9s 2023-11-28T19:44:38.917 INFO:teuthology.orchestra.run.smithi203.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-11-28T19:44:39.228 INFO:teuthology.orchestra.run.smithi203.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:44:45.783 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:44:45.786 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:44:45.788 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:44:46.246 INFO:teuthology.orchestra.run.smithi203.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T19:44:46.556 INFO:teuthology.orchestra.run.smithi203.stdout:generic/034 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:44:46.975 INFO:teuthology.orchestra.run.smithi203.stdout:generic/035 0s 2023-11-28T19:44:54.265 INFO:teuthology.orchestra.run.smithi203.stdout:generic/037 8s 2023-11-28T19:45:00.694 INFO:teuthology.orchestra.run.smithi203.stdout:generic/039 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:45:00.727 INFO:teuthology.orchestra.run.smithi203.stdout:generic/040 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:45:00.727 INFO:teuthology.orchestra.run.smithi203.stdout:generic/041 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:45:00.727 INFO:teuthology.orchestra.run.smithi203.stdout:generic/042 [not run] ceph does not support shutdown 2023-11-28T19:45:00.727 INFO:teuthology.orchestra.run.smithi203.stdout:generic/050 [not run] ceph does not support shutdown 2023-11-28T19:45:00.727 INFO:teuthology.orchestra.run.smithi203.stdout:generic/052 [not run] ceph does not support shutdown 2023-11-28T19:45:00.728 INFO:teuthology.orchestra.run.smithi203.stdout:generic/053 1s 2023-11-28T19:45:00.728 INFO:teuthology.orchestra.run.smithi203.stdout:generic/056 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:45:00.728 INFO:teuthology.orchestra.run.smithi203.stdout:generic/057 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:45:03.067 INFO:teuthology.orchestra.run.smithi203.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T19:45:03.393 INFO:teuthology.orchestra.run.smithi203.stdout:generic/059 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:45:14.082 INFO:teuthology.orchestra.run.smithi203.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T19:45:15.855 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:45:15.857 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:45:15.859 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:45:19.914 INFO:teuthology.orchestra.run.smithi203.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T19:45:22.503 INFO:teuthology.orchestra.run.smithi203.stdout:generic/062 3s 2023-11-28T19:45:29.877 INFO:teuthology.orchestra.run.smithi203.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T19:45:30.237 INFO:teuthology.orchestra.run.smithi203.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T19:45:30.564 INFO:teuthology.orchestra.run.smithi203.stdout:generic/065 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:45:30.882 INFO:teuthology.orchestra.run.smithi203.stdout:generic/066 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:45:31.224 INFO:teuthology.orchestra.run.smithi203.stdout:generic/067 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:45:46.151 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:45:46.154 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:45:46.156 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:45:54.578 INFO:teuthology.orchestra.run.smithi203.stdout:generic/069 23s 2023-11-28T19:46:16.313 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:46:16.316 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:46:16.318 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:46:19.674 INFO:teuthology.orchestra.run.smithi203.stdout:generic/070 25s 2023-11-28T19:46:19.999 INFO:teuthology.orchestra.run.smithi203.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T19:46:20.338 INFO:teuthology.orchestra.run.smithi203.stdout:generic/073 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:46:46.364 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:46:46.367 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:46:46.369 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:46:46.395 INFO:tasks.ceph.mds.c.smithi028.stderr:2023-11-28T19:46:46.395+0000 7f2738088640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47587) UID: 0 2023-11-28T19:46:46.396 INFO:tasks.ceph.mds.a.smithi028.stderr:2023-11-28T19:46:46.395+0000 7f479a9ae640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 47587) UID: 0 2023-11-28T19:47:12.302 INFO:teuthology.orchestra.run.smithi203.stdout:generic/075 52s 2023-11-28T19:47:12.606 INFO:teuthology.orchestra.run.smithi203.stdout:generic/076 [not run] require 172.21.15.28:6789:/scratch to be local device 2023-11-28T19:47:12.939 INFO:teuthology.orchestra.run.smithi203.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-11-28T19:47:13.253 INFO:teuthology.orchestra.run.smithi203.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-11-28T19:47:15.626 INFO:teuthology.orchestra.run.smithi203.stdout:generic/080 2s 2023-11-28T19:47:16.071 INFO:teuthology.orchestra.run.smithi203.stdout:generic/081 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:47:16.373 INFO:teuthology.orchestra.run.smithi203.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T19:47:22.688 INFO:teuthology.orchestra.run.smithi203.stdout:generic/084 6s 2023-11-28T19:47:23.113 INFO:teuthology.orchestra.run.smithi203.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:47:23.521 INFO:teuthology.orchestra.run.smithi203.stdout:generic/087 0s 2023-11-28T19:47:23.855 INFO:teuthology.orchestra.run.smithi203.stdout:generic/088 0s 2023-11-28T19:47:24.192 INFO:teuthology.orchestra.run.smithi203.stdout:generic/090 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:49:24.321 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:49:24.325 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:49:24.328 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:49:45.592 INFO:teuthology.orchestra.run.smithi203.stdout:generic/091 141s 2023-11-28T19:49:45.915 INFO:teuthology.orchestra.run.smithi203.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:49:46.322 INFO:teuthology.orchestra.run.smithi203.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T19:49:51.404 INFO:teuthology.orchestra.run.smithi203.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-11-28T19:49:52.091 INFO:teuthology.orchestra.run.smithi203.stdout:generic/097 1s 2023-11-28T19:49:53.386 INFO:teuthology.orchestra.run.smithi203.stdout:generic/098 1s 2023-11-28T19:49:54.450 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:49:54.452 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:49:54.455 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:49:55.134 INFO:teuthology.orchestra.run.smithi203.stdout:generic/099 2s 2023-11-28T19:49:55.463 INFO:teuthology.orchestra.run.smithi203.stdout:generic/101 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:49:55.796 INFO:teuthology.orchestra.run.smithi203.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T19:49:56.132 INFO:teuthology.orchestra.run.smithi203.stdout:generic/104 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:49:57.017 INFO:teuthology.orchestra.run.smithi203.stdout:generic/105 1s 2023-11-28T19:49:57.419 INFO:teuthology.orchestra.run.smithi203.stdout:generic/106 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:49:57.760 INFO:teuthology.orchestra.run.smithi203.stdout:generic/107 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:49:58.321 INFO:teuthology.orchestra.run.smithi203.stdout:generic/108 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T19:49:58.674 INFO:teuthology.orchestra.run.smithi203.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:49:59.013 INFO:teuthology.orchestra.run.smithi203.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:50:24.581 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:50:24.584 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:50:24.587 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:50:54.411 INFO:teuthology.orchestra.run.smithi203.stdout:generic/112 55s 2023-11-28T19:50:54.719 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:50:54.723 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:50:54.726 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:51:24.784 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:51:24.787 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:51:24.789 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:51:54.842 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:51:59.885 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:51:59.888 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:52:29.970 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:52:29.973 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:52:29.975 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:53:00.075 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:53:00.078 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:53:00.080 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:53:07.478 INFO:teuthology.orchestra.run.smithi203.stdout:generic/113 133s 2023-11-28T19:53:07.904 INFO:teuthology.orchestra.run.smithi203.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-11-28T19:53:08.240 INFO:teuthology.orchestra.run.smithi203.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:53:08.599 INFO:teuthology.orchestra.run.smithi203.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:53:22.819 INFO:teuthology.orchestra.run.smithi203.stdout:generic/117 14s 2023-11-28T19:53:23.224 INFO:teuthology.orchestra.run.smithi203.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:53:23.560 INFO:teuthology.orchestra.run.smithi203.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T19:53:23.864 INFO:teuthology.orchestra.run.smithi203.stdout:generic/120 [not run] atime not maintained by ceph 2023-11-28T19:53:24.217 INFO:teuthology.orchestra.run.smithi203.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T19:53:24.571 INFO:teuthology.orchestra.run.smithi203.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T19:53:25.293 INFO:teuthology.orchestra.run.smithi203.stdout:generic/123 1s 2023-11-28T19:53:30.205 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:53:30.208 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:53:30.210 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:54:00.361 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:54:00.365 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:54:00.367 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:54:08.662 INFO:teuthology.orchestra.run.smithi203.stdout:generic/124 43s 2023-11-28T19:54:09.299 INFO:teuthology.orchestra.run.smithi203.stdout:generic/126 1s 2023-11-28T19:54:10.911 INFO:teuthology.orchestra.run.smithi203.stdout:generic/128 1s 2023-11-28T19:54:31.025 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:54:35.131 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:54:35.135 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:55:05.213 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:55:05.216 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:55:05.218 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:55:35.280 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:55:35.282 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:55:35.284 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:56:05.408 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:56:05.411 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:56:05.413 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:56:35.490 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:56:35.493 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:56:35.495 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:57:05.594 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:57:05.597 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:57:05.599 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:57:35.734 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:57:35.738 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:57:35.741 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:58:05.802 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:58:05.804 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:58:05.806 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:58:35.868 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:58:35.871 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:58:35.875 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:59:05.969 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:59:05.972 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:59:05.978 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:59:36.298 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:59:36.301 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T19:59:36.303 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:00:06.384 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:00:06.386 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:00:06.388 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:00:36.506 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:00:36.509 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:00:36.511 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:01:06.580 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:01:06.583 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:01:06.585 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:01:36.670 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:01:36.672 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:01:36.675 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:02:06.753 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:02:06.756 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:02:06.758 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:02:36.810 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:02:36.822 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:02:36.824 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:06.912 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:06.915 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:06.917 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:37.269 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:37.272 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:03:37.276 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:04:07.343 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:04:07.345 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:04:07.347 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:04:37.898 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:04:37.901 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:04:37.903 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:05:08.337 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:05:08.339 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:05:08.346 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:05:38.728 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:05:38.737 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:05:38.741 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:06:09.232 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:06:09.259 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:06:09.261 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:06:40.714 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:06:40.716 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:06:40.964 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:07:12.162 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:07:12.164 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:07:12.173 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:07:42.415 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:07:42.420 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:07:42.481 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:08:12.580 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:08:12.583 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:08:12.585 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:08:42.697 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:08:42.700 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:08:42.705 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:09:12.783 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:09:12.786 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:09:12.787 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:09:43.161 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:09:43.164 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:09:43.166 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:10:13.237 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:10:13.239 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:10:13.242 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:10:43.346 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:10:43.349 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:10:43.351 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:11:13.674 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:11:13.677 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:11:13.679 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:11:43.754 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:11:43.756 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:11:43.758 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:12:13.926 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:12:13.932 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:12:13.937 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:12:44.018 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:12:44.020 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:12:44.022 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:13:14.121 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:13:14.123 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:13:14.125 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:13:44.261 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:13:44.265 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:13:44.285 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:14:14.482 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:14:14.485 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:14:14.488 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:14:44.646 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:14:44.650 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:14:44.653 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:15:14.744 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:15:14.746 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:15:14.748 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:15:45.109 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:15:45.111 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:15:45.113 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:16:15.214 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:16:15.217 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:16:15.219 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:16:45.316 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:16:45.319 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:16:45.321 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:17:15.501 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:17:15.504 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:17:15.506 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:17:45.905 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:17:45.907 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:17:45.915 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:17:58.986 INFO:teuthology.orchestra.run.smithi203.stdout:generic/129 1428s 2023-11-28T20:18:16.052 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:18:16.054 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:18:16.057 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:18:21.422 INFO:teuthology.orchestra.run.smithi203.stdout:generic/130 22s 2023-11-28T20:18:23.064 INFO:teuthology.orchestra.run.smithi203.stdout:generic/131 2s 2023-11-28T20:18:23.434 INFO:teuthology.orchestra.run.smithi203.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:24.995 INFO:teuthology.orchestra.run.smithi203.stdout:generic/135 1s 2023-11-28T20:18:25.429 INFO:teuthology.orchestra.run.smithi203.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T20:18:25.793 INFO:teuthology.orchestra.run.smithi203.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:26.135 INFO:teuthology.orchestra.run.smithi203.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:26.463 INFO:teuthology.orchestra.run.smithi203.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:28.695 INFO:teuthology.orchestra.run.smithi203.stdout:generic/141 2s 2023-11-28T20:18:29.130 INFO:teuthology.orchestra.run.smithi203.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:29.488 INFO:teuthology.orchestra.run.smithi203.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:29.844 INFO:teuthology.orchestra.run.smithi203.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:30.189 INFO:teuthology.orchestra.run.smithi203.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:30.558 INFO:teuthology.orchestra.run.smithi203.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:30.905 INFO:teuthology.orchestra.run.smithi203.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:31.241 INFO:teuthology.orchestra.run.smithi203.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:31.583 INFO:teuthology.orchestra.run.smithi203.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:31.927 INFO:teuthology.orchestra.run.smithi203.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:32.268 INFO:teuthology.orchestra.run.smithi203.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:32.635 INFO:teuthology.orchestra.run.smithi203.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:32.985 INFO:teuthology.orchestra.run.smithi203.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:33.347 INFO:teuthology.orchestra.run.smithi203.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:33.714 INFO:teuthology.orchestra.run.smithi203.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:34.058 INFO:teuthology.orchestra.run.smithi203.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:34.407 INFO:teuthology.orchestra.run.smithi203.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:34.759 INFO:teuthology.orchestra.run.smithi203.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T20:18:35.088 INFO:teuthology.orchestra.run.smithi203.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-11-28T20:18:35.443 INFO:teuthology.orchestra.run.smithi203.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-11-28T20:18:36.136 INFO:teuthology.orchestra.run.smithi203.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:18:36.616 INFO:teuthology.orchestra.run.smithi203.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-28T20:18:37.297 INFO:teuthology.orchestra.run.smithi203.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-28T20:18:38.610 INFO:teuthology.orchestra.run.smithi203.stdout:generic/169 1s 2023-11-28T20:18:39.372 INFO:teuthology.orchestra.run.smithi203.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:18:40.018 INFO:teuthology.orchestra.run.smithi203.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:18:40.670 INFO:teuthology.orchestra.run.smithi203.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:18:41.383 INFO:teuthology.orchestra.run.smithi203.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:18:46.153 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:18:46.156 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:18:46.158 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:18:46.187 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-11-28T20:18:46.184+0000 7f23bc0c2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44954) UID: 0 2023-11-28T20:18:46.187 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-11-28T20:18:46.184+0000 7faeafb56640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44954) UID: 0 2023-11-28T20:18:46.188 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-11-28T20:18:46.184+0000 7fb33c8a0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44954) UID: 0 2023-11-28T20:18:46.188 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-11-28T20:18:46.184+0000 7f2192366640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44954) UID: 0 2023-11-28T20:18:51.762 INFO:teuthology.orchestra.run.smithi203.stdout:generic/177 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T20:18:52.122 INFO:teuthology.orchestra.run.smithi203.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:52.495 INFO:teuthology.orchestra.run.smithi203.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:52.872 INFO:teuthology.orchestra.run.smithi203.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:53.218 INFO:teuthology.orchestra.run.smithi203.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:18:53.576 INFO:teuthology.orchestra.run.smithi203.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T20:18:54.433 INFO:teuthology.orchestra.run.smithi203.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:18:54.783 INFO:teuthology.orchestra.run.smithi203.stdout:generic/184 0s 2023-11-28T20:18:55.418 INFO:teuthology.orchestra.run.smithi203.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:18:56.092 INFO:teuthology.orchestra.run.smithi203.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:18:56.748 INFO:teuthology.orchestra.run.smithi203.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:18:57.381 INFO:teuthology.orchestra.run.smithi203.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:18:58.067 INFO:teuthology.orchestra.run.smithi203.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:18:59.459 INFO:teuthology.orchestra.run.smithi203.stdout:generic/193 1s 2023-11-28T20:19:00.114 INFO:teuthology.orchestra.run.smithi203.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:19:00.725 INFO:teuthology.orchestra.run.smithi203.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:19:01.413 INFO:teuthology.orchestra.run.smithi203.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:19:02.031 INFO:teuthology.orchestra.run.smithi203.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:19:41.092 INFO:teuthology.orchestra.run.smithi203.stdout:generic/198 39s 2023-11-28T20:19:41.737 INFO:teuthology.orchestra.run.smithi203.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:19:42.314 INFO:teuthology.orchestra.run.smithi203.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:19:42.879 INFO:teuthology.orchestra.run.smithi203.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:19:43.620 INFO:teuthology.orchestra.run.smithi203.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:19:44.206 INFO:teuthology.orchestra.run.smithi203.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:19:44.790 INFO:teuthology.orchestra.run.smithi203.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:19:45.371 INFO:teuthology.orchestra.run.smithi203.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:20:18.246 INFO:teuthology.orchestra.run.smithi203.stdout:generic/207 33s 2023-11-28T20:20:18.812 INFO:teuthology.orchestra.run.smithi203.stdout:generic/210 0s 2023-11-28T20:20:19.653 INFO:teuthology.orchestra.run.smithi203.stdout:generic/211 1s 2023-11-28T20:20:20.176 INFO:teuthology.orchestra.run.smithi203.stdout:generic/212 1s 2023-11-28T20:20:20.496 INFO:teuthology.orchestra.run.smithi203.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:20:20.849 INFO:teuthology.orchestra.run.smithi203.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:20:23.269 INFO:teuthology.orchestra.run.smithi203.stdout:generic/215 3s 2023-11-28T20:20:25.117 INFO:teuthology.orchestra.run.smithi203.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:20:25.143 INFO:teuthology.orchestra.run.smithi203.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:20:25.393 INFO:teuthology.orchestra.run.smithi203.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:20:25.696 INFO:teuthology.orchestra.run.smithi203.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T20:20:26.328 INFO:teuthology.orchestra.run.smithi203.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:20:27.653 INFO:teuthology.orchestra.run.smithi203.stdout:generic/221 1s 2023-11-28T20:20:28.362 INFO:teuthology.orchestra.run.smithi203.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:20:28.670 INFO:teuthology.orchestra.run.smithi203.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:20:29.091 INFO:teuthology.orchestra.run.smithi203.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-11-28T20:20:29.847 INFO:teuthology.orchestra.run.smithi203.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:20:30.179 INFO:teuthology.orchestra.run.smithi203.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:20:30.874 INFO:teuthology.orchestra.run.smithi203.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:20:31.165 INFO:teuthology.orchestra.run.smithi203.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T20:20:31.486 INFO:teuthology.orchestra.run.smithi203.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T20:20:32.997 INFO:teuthology.orchestra.run.smithi203.stdout:generic/236 1s 2023-11-28T20:20:33.444 INFO:teuthology.orchestra.run.smithi203.stdout:generic/237 0s 2023-11-28T20:20:34.077 INFO:teuthology.orchestra.run.smithi203.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:20:50.352 INFO:teuthology.orchestra.run.smithi203.stdout:generic/240 16s 2023-11-28T20:20:50.629 INFO:teuthology.orchestra.run.smithi203.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T20:20:51.064 INFO:teuthology.orchestra.run.smithi203.stdout:generic/245 1s 2023-11-28T20:20:51.395 INFO:teuthology.orchestra.run.smithi203.stdout:generic/246 0s 2023-11-28T20:21:46.788 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:21:46.791 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:21:46.793 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:21:46.854 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-11-28T20:21:46.852+0000 7f96c864f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47795) UID: 0 2023-11-28T20:21:46.854 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-11-28T20:21:46.852+0000 7fb9e217e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47795) UID: 0 2023-11-28T20:21:46.855 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-11-28T20:21:46.852+0000 7fc01b0d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47795) UID: 0 2023-11-28T20:21:46.855 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-11-28T20:21:46.852+0000 7f75dde79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47795) UID: 0 2023-11-28T20:21:46.921 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-11-28T20:21:46.920+0000 7f2192366640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44965) UID: 0 2023-11-28T20:21:46.921 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-11-28T20:21:46.920+0000 7fb33c8a0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44965) UID: 0 2023-11-28T20:21:46.922 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-11-28T20:21:46.920+0000 7f23bc0c2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44965) UID: 0 2023-11-28T20:21:46.922 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-11-28T20:21:46.920+0000 7faeafb56640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44965) UID: 0 2023-11-28T20:25:05.632 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:25:05.635 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:25:05.637 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:25:05.671 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-11-28T20:25:05.668+0000 7f2192366640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44981) UID: 0 2023-11-28T20:25:05.672 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-11-28T20:25:05.668+0000 7fb33c8a0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44981) UID: 0 2023-11-28T20:25:05.672 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-11-28T20:25:05.668+0000 7f23bc0c2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 44981) UID: 0 2023-11-28T20:25:05.672 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-11-28T20:25:05.672+0000 7faeafb56640 -1 Fail to open '/proc/44981/cmdline' error = (2) No such file or directory 2023-11-28T20:25:05.673 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-11-28T20:25:05.672+0000 7faeafb56640 -1 received signal: Hangup from (PID: 44981) UID: 0 2023-11-28T20:27:02.530 INFO:teuthology.orchestra.run.smithi203.stdout:generic/247 371s 2023-11-28T20:27:02.920 INFO:teuthology.orchestra.run.smithi203.stdout:generic/248 0s 2023-11-28T20:27:34.307 INFO:teuthology.orchestra.run.smithi203.stdout:generic/249 32s 2023-11-28T20:27:34.623 INFO:teuthology.orchestra.run.smithi203.stdout:generic/250 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:27:34.979 INFO:teuthology.orchestra.run.smithi203.stdout:generic/252 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:27:35.654 INFO:teuthology.orchestra.run.smithi203.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:27:36.230 INFO:teuthology.orchestra.run.smithi203.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:27:45.105 INFO:teuthology.orchestra.run.smithi203.stdout:generic/255 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T20:27:54.678 INFO:teuthology.orchestra.run.smithi203.stdout:generic/256 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T20:27:55.974 INFO:teuthology.orchestra.run.smithi203.stdout:generic/257 1s 2023-11-28T20:27:56.300 INFO:teuthology.orchestra.run.smithi203.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-11-28T20:27:57.076 INFO:teuthology.orchestra.run.smithi203.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:27:57.673 INFO:teuthology.orchestra.run.smithi203.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.KZg81Ahl5Nscratch 2023-11-28T20:27:58.357 INFO:teuthology.orchestra.run.smithi203.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:27:59.080 INFO:teuthology.orchestra.run.smithi203.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:28:26.133 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:28:26.137 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:28:26.140 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:28:56.287 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:28:56.291 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:28:56.294 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:29:26.434 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:29:26.438 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:29:26.443 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:29:56.572 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:29:56.575 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:29:56.578 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:30:26.825 INFO:teuthology.orchestra.run.smithi203.stdout:generic/263 147s 2023-11-28T20:30:26.859 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:30:26.862 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:30:26.865 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:30:27.634 INFO:teuthology.orchestra.run.smithi203.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:28.317 INFO:teuthology.orchestra.run.smithi203.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:28.951 INFO:teuthology.orchestra.run.smithi203.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:29.631 INFO:teuthology.orchestra.run.smithi203.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:30.310 INFO:teuthology.orchestra.run.smithi203.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:31.129 INFO:teuthology.orchestra.run.smithi203.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:31.808 INFO:teuthology.orchestra.run.smithi203.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:32.534 INFO:teuthology.orchestra.run.smithi203.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:32.841 INFO:teuthology.orchestra.run.smithi203.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-11-28T20:30:33.558 INFO:teuthology.orchestra.run.smithi203.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:34.263 INFO:teuthology.orchestra.run.smithi203.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:34.986 INFO:teuthology.orchestra.run.smithi203.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:35.645 INFO:teuthology.orchestra.run.smithi203.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:36.241 INFO:teuthology.orchestra.run.smithi203.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:36.932 INFO:teuthology.orchestra.run.smithi203.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:37.259 INFO:teuthology.orchestra.run.smithi203.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:30:37.914 INFO:teuthology.orchestra.run.smithi203.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:38.374 INFO:teuthology.orchestra.run.smithi203.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.KZg81Ahl5Nscratch 2023-11-28T20:30:39.113 INFO:teuthology.orchestra.run.smithi203.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:39.810 INFO:teuthology.orchestra.run.smithi203.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:40.463 INFO:teuthology.orchestra.run.smithi203.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:41.037 INFO:teuthology.orchestra.run.smithi203.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:41.668 INFO:teuthology.orchestra.run.smithi203.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:42.430 INFO:teuthology.orchestra.run.smithi203.stdout:generic/294 1s 2023-11-28T20:30:43.116 INFO:teuthology.orchestra.run.smithi203.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:43.752 INFO:teuthology.orchestra.run.smithi203.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:44.370 INFO:teuthology.orchestra.run.smithi203.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:45.121 INFO:teuthology.orchestra.run.smithi203.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:45.478 INFO:teuthology.orchestra.run.smithi203.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:30:45.826 INFO:teuthology.orchestra.run.smithi203.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T20:30:46.503 INFO:teuthology.orchestra.run.smithi203.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:30:47.207 INFO:teuthology.orchestra.run.smithi203.stdout:generic/306 1s 2023-11-28T20:30:49.431 INFO:teuthology.orchestra.run.smithi203.stdout:generic/307 2s 2023-11-28T20:30:49.824 INFO:teuthology.orchestra.run.smithi203.stdout:generic/308 0s 2023-11-28T20:30:51.248 INFO:teuthology.orchestra.run.smithi203.stdout:generic/309 2s 2023-11-28T20:30:51.546 INFO:teuthology.orchestra.run.smithi203.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:30:55.977 INFO:teuthology.orchestra.run.smithi203.stdout:generic/313 4s 2023-11-28T20:30:56.630 INFO:teuthology.orchestra.run.smithi203.stdout:generic/314 1s 2023-11-28T20:30:56.932 INFO:teuthology.orchestra.run.smithi203.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T20:30:57.154 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:30:57.157 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:30:57.160 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:31:05.937 INFO:teuthology.orchestra.run.smithi203.stdout:generic/316 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T20:31:07.004 INFO:teuthology.orchestra.run.smithi203.stdout:generic/317 1s 2023-11-28T20:31:07.829 INFO:teuthology.orchestra.run.smithi203.stdout:generic/318 0s 2023-11-28T20:31:08.416 INFO:teuthology.orchestra.run.smithi203.stdout:generic/319 1s 2023-11-28T20:31:08.780 INFO:teuthology.orchestra.run.smithi203.stdout:generic/321 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:31:09.099 INFO:teuthology.orchestra.run.smithi203.stdout:generic/322 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:31:09.385 INFO:teuthology.orchestra.run.smithi203.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-11-28T20:31:09.691 INFO:teuthology.orchestra.run.smithi203.stdout:generic/325 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:31:10.340 INFO:teuthology.orchestra.run.smithi203.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:31:11.012 INFO:teuthology.orchestra.run.smithi203.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:31:11.633 INFO:teuthology.orchestra.run.smithi203.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:31:12.282 INFO:teuthology.orchestra.run.smithi203.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:31:13.008 INFO:teuthology.orchestra.run.smithi203.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:31:13.740 INFO:teuthology.orchestra.run.smithi203.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:31:14.398 INFO:teuthology.orchestra.run.smithi203.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:31:14.715 INFO:teuthology.orchestra.run.smithi203.stdout:generic/335 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:31:15.042 INFO:teuthology.orchestra.run.smithi203.stdout:generic/336 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:31:15.890 INFO:teuthology.orchestra.run.smithi203.stdout:generic/337 0s 2023-11-28T20:31:16.258 INFO:teuthology.orchestra.run.smithi203.stdout:generic/338 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:31:16.561 INFO:teuthology.orchestra.run.smithi203.stdout:generic/341 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:31:16.888 INFO:teuthology.orchestra.run.smithi203.stdout:generic/342 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:31:17.248 INFO:teuthology.orchestra.run.smithi203.stdout:generic/343 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:31:27.214 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:31:27.217 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:31:27.219 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:31:57.358 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:31:57.360 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:31:57.363 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:32:27.504 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:32:27.507 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:32:27.509 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:32:27.522 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-11-28T20:32:27.521+0000 7f96c864f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47845) UID: 0 2023-11-28T20:32:27.522 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-11-28T20:32:27.521+0000 7fb9e217e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47845) UID: 0 2023-11-28T20:32:27.523 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-11-28T20:32:27.521+0000 7f75dde79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47845) UID: 0 2023-11-28T20:32:27.523 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-11-28T20:32:27.521+0000 7fc01b0d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 47845) UID: 0 2023-11-28T20:35:22.917 INFO:teuthology.orchestra.run.smithi203.stdout:generic/346 245s 2023-11-28T20:35:23.319 INFO:teuthology.orchestra.run.smithi203.stdout:generic/347 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:35:23.724 INFO:teuthology.orchestra.run.smithi203.stdout:generic/348 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:35:24.454 INFO:teuthology.orchestra.run.smithi203.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:35:25.449 INFO:teuthology.orchestra.run.smithi203.stdout:generic/355 1s 2023-11-28T20:35:26.042 INFO:teuthology.orchestra.run.smithi203.stdout:generic/356 [not run] swapfiles are not supported 2023-11-28T20:35:26.603 INFO:teuthology.orchestra.run.smithi203.stdout:generic/357 [not run] swapfiles are not supported 2023-11-28T20:35:27.295 INFO:teuthology.orchestra.run.smithi203.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:35:27.924 INFO:teuthology.orchestra.run.smithi203.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:35:28.306 INFO:teuthology.orchestra.run.smithi203.stdout:generic/360 1s 2023-11-28T20:35:28.608 INFO:teuthology.orchestra.run.smithi203.stdout:generic/361 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:35:28.897 INFO:teuthology.orchestra.run.smithi203.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T20:35:29.202 INFO:teuthology.orchestra.run.smithi203.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T20:35:29.477 INFO:teuthology.orchestra.run.smithi203.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T20:35:29.773 INFO:teuthology.orchestra.run.smithi203.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T20:35:30.070 INFO:teuthology.orchestra.run.smithi203.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T20:35:30.347 INFO:teuthology.orchestra.run.smithi203.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T20:35:30.647 INFO:teuthology.orchestra.run.smithi203.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T20:35:30.942 INFO:teuthology.orchestra.run.smithi203.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T20:35:31.250 INFO:teuthology.orchestra.run.smithi203.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-11-28T20:35:31.549 INFO:teuthology.orchestra.run.smithi203.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:35:32.311 INFO:teuthology.orchestra.run.smithi203.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:35:32.975 INFO:teuthology.orchestra.run.smithi203.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:35:33.492 INFO:teuthology.orchestra.run.smithi203.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-28T20:35:34.199 INFO:teuthology.orchestra.run.smithi203.stdout:generic/375 1s 2023-11-28T20:35:34.524 INFO:teuthology.orchestra.run.smithi203.stdout:generic/376 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:35:35.365 INFO:teuthology.orchestra.run.smithi203.stdout:generic/377 1s 2023-11-28T20:35:36.110 INFO:teuthology.orchestra.run.smithi203.stdout:generic/378 1s 2023-11-28T20:35:36.417 INFO:teuthology.orchestra.run.smithi203.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T20:35:36.714 INFO:teuthology.orchestra.run.smithi203.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T20:35:37.012 INFO:teuthology.orchestra.run.smithi203.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T20:35:37.326 INFO:teuthology.orchestra.run.smithi203.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T20:35:37.619 INFO:teuthology.orchestra.run.smithi203.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T20:35:37.941 INFO:teuthology.orchestra.run.smithi203.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T20:35:38.275 INFO:teuthology.orchestra.run.smithi203.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T20:35:38.556 INFO:teuthology.orchestra.run.smithi203.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T20:35:38.864 INFO:teuthology.orchestra.run.smithi203.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-11-28T20:35:39.191 INFO:teuthology.orchestra.run.smithi203.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:35:39.629 INFO:teuthology.orchestra.run.smithi203.stdout:generic/392 [not run] ceph does not support shutdown 2023-11-28T20:35:40.999 INFO:teuthology.orchestra.run.smithi203.stdout:generic/393 1s 2023-11-28T20:35:41.443 INFO:teuthology.orchestra.run.smithi203.stdout:generic/394 0s 2023-11-28T20:35:41.845 INFO:teuthology.orchestra.run.smithi203.stdout:generic/395 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-28T20:35:42.271 INFO:teuthology.orchestra.run.smithi203.stdout:generic/396 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-28T20:35:42.712 INFO:teuthology.orchestra.run.smithi203.stdout:generic/397 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-28T20:35:43.094 INFO:teuthology.orchestra.run.smithi203.stdout:generic/398 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-28T20:35:43.384 INFO:teuthology.orchestra.run.smithi203.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T20:35:44.294 INFO:teuthology.orchestra.run.smithi203.stdout:generic/401 1s 2023-11-28T20:35:44.832 INFO:teuthology.orchestra.run.smithi203.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-11-28T20:35:45.927 INFO:teuthology.orchestra.run.smithi203.stdout:generic/403 1s 2023-11-28T20:35:46.291 INFO:teuthology.orchestra.run.smithi203.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:35:49.144 INFO:teuthology.orchestra.run.smithi203.stdout:generic/406 3s 2023-11-28T20:35:49.573 INFO:teuthology.orchestra.run.smithi203.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:35:49.920 INFO:teuthology.orchestra.run.smithi203.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T20:35:50.260 INFO:teuthology.orchestra.run.smithi203.stdout:generic/409 [not run] require 172.21.15.28:6789:/scratch to be local device 2023-11-28T20:35:50.582 INFO:teuthology.orchestra.run.smithi203.stdout:generic/410 [not run] require 172.21.15.28:6789:/scratch to be local device 2023-11-28T20:35:50.873 INFO:teuthology.orchestra.run.smithi203.stdout:generic/411 [not run] require 172.21.15.28:6789:/scratch to be local device 2023-11-28T20:35:51.973 INFO:teuthology.orchestra.run.smithi203.stdout:generic/412 1s 2023-11-28T20:35:52.482 INFO:teuthology.orchestra.run.smithi203.stdout:generic/413 [not run] mount 172.21.15.28:6789:/scratch with dax failed 2023-11-28T20:35:53.194 INFO:teuthology.orchestra.run.smithi203.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:35:53.609 INFO:teuthology.orchestra.run.smithi203.stdout:generic/417 [not run] ceph does not support shutdown 2023-11-28T20:35:54.002 INFO:teuthology.orchestra.run.smithi203.stdout:generic/419 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-28T20:36:06.606 INFO:teuthology.orchestra.run.smithi203.stdout:generic/420 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T20:36:07.004 INFO:teuthology.orchestra.run.smithi203.stdout:generic/421 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-28T20:36:07.315 INFO:teuthology.orchestra.run.smithi203.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T20:36:07.798 INFO:teuthology.orchestra.run.smithi203.stdout:generic/423 0s 2023-11-28T20:36:08.137 INFO:teuthology.orchestra.run.smithi203.stdout:generic/424 [not run] file system doesn't support any of /usr/bin/chattr +a/+c/+d/+i 2023-11-28T20:36:08.527 INFO:teuthology.orchestra.run.smithi203.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-11-28T20:36:39.716 INFO:teuthology.orchestra.run.smithi203.stdout:generic/426 31s 2023-11-28T20:36:40.677 INFO:teuthology.orchestra.run.smithi203.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T20:36:41.020 INFO:teuthology.orchestra.run.smithi203.stdout:generic/428 1s 2023-11-28T20:36:41.487 INFO:teuthology.orchestra.run.smithi203.stdout:generic/430 0s 2023-11-28T20:36:41.915 INFO:teuthology.orchestra.run.smithi203.stdout:generic/431 0s 2023-11-28T20:36:42.386 INFO:teuthology.orchestra.run.smithi203.stdout:generic/432 1s 2023-11-28T20:36:42.817 INFO:teuthology.orchestra.run.smithi203.stdout:generic/433 0s 2023-11-28T20:36:43.253 INFO:teuthology.orchestra.run.smithi203.stdout:generic/434 1s 2023-11-28T20:36:44.074 INFO:teuthology.orchestra.run.smithi203.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:36:45.171 INFO:teuthology.orchestra.run.smithi203.stdout:generic/437 1s 2023-11-28T20:36:55.147 INFO:teuthology.orchestra.run.smithi203.stdout:generic/439 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T20:36:55.545 INFO:teuthology.orchestra.run.smithi203.stdout:generic/440 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-11-28T20:36:55.914 INFO:teuthology.orchestra.run.smithi203.stdout:generic/441 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:36:56.278 INFO:teuthology.orchestra.run.smithi203.stdout:generic/443 1s 2023-11-28T20:36:56.718 INFO:teuthology.orchestra.run.smithi203.stdout:generic/444 0s 2023-11-28T20:36:57.421 INFO:teuthology.orchestra.run.smithi203.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:37:07.177 INFO:teuthology.orchestra.run.smithi203.stdout:generic/446 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-11-28T20:37:08.294 INFO:teuthology.orchestra.run.smithi203.stdout:generic/448 1s 2023-11-28T20:37:08.657 INFO:teuthology.orchestra.run.smithi203.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T20:37:15.543 INFO:teuthology.orchestra.run.smithi203.stdout:generic/450 7s 2023-11-28T20:37:46.127 INFO:teuthology.orchestra.run.smithi203.stdout:generic/451 31s 2023-11-28T20:37:47.896 INFO:teuthology.orchestra.run.smithi203.stdout:generic/452 1s 2023-11-28T20:37:48.233 INFO:teuthology.orchestra.run.smithi203.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-11-28T20:37:48.577 INFO:teuthology.orchestra.run.smithi203.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-11-28T20:37:48.916 INFO:teuthology.orchestra.run.smithi203.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:37:49.624 INFO:teuthology.orchestra.run.smithi203.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:38:05.050 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:38:05.052 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:38:05.054 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:38:35.585 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:38:35.587 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:38:35.589 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:39:05.714 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:39:05.717 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:39:05.719 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:39:35.834 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:39:35.837 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:39:35.839 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:40:05.972 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:40:05.974 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:40:05.976 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:40:36.101 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:40:36.104 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:40:36.106 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:41:06.247 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:41:06.249 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:41:06.251 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:41:36.496 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:41:36.501 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:41:36.503 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:42:06.785 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:42:06.788 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:42:06.790 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:42:36.901 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:42:36.904 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:42:36.907 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:42:42.506 INFO:teuthology.orchestra.run.smithi203.stdout:generic/460 293s 2023-11-28T20:42:43.009 INFO:teuthology.orchestra.run.smithi203.stdout:generic/462 [not run] mount 172.21.15.28:6789:/scratch with dax failed 2023-11-28T20:42:43.421 INFO:teuthology.orchestra.run.smithi203.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-11-28T20:42:50.124 INFO:teuthology.orchestra.run.smithi203.stdout:generic/465 7s 2023-11-28T20:42:50.448 INFO:teuthology.orchestra.run.smithi203.stdout:generic/466 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:42:53.843 INFO:teuthology.orchestra.run.smithi203.stdout:generic/467 3s 2023-11-28T20:42:55.516 INFO:teuthology.orchestra.run.smithi203.stdout:generic/468 [not run] ceph does not support shutdown 2023-11-28T20:42:55.871 INFO:teuthology.orchestra.run.smithi203.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T20:42:56.241 INFO:teuthology.orchestra.run.smithi203.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-11-28T20:43:07.047 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:43:07.050 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:43:07.052 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:43:37.561 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:43:37.565 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:43:37.568 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:43:54.818 INFO:teuthology.orchestra.run.smithi203.stdout:generic/471 58s 2023-11-28T20:43:55.665 INFO:teuthology.orchestra.run.smithi203.stdout:generic/472 [not run] swapfiles are not supported 2023-11-28T20:43:56.134 INFO:teuthology.orchestra.run.smithi203.stdout:generic/474 [not run] ceph does not support shutdown 2023-11-28T20:44:03.011 INFO:teuthology.orchestra.run.smithi203.stdout:generic/477 6s 2023-11-28T20:44:07.710 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:44:07.713 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:44:07.715 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:44:14.609 INFO:teuthology.orchestra.run.smithi203.stdout:generic/478 11s 2023-11-28T20:44:15.009 INFO:teuthology.orchestra.run.smithi203.stdout:generic/479 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:44:15.378 INFO:teuthology.orchestra.run.smithi203.stdout:generic/480 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:44:15.700 INFO:teuthology.orchestra.run.smithi203.stdout:generic/481 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:44:16.053 INFO:teuthology.orchestra.run.smithi203.stdout:generic/483 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:44:16.381 INFO:teuthology.orchestra.run.smithi203.stdout:generic/484 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:44:16.698 INFO:teuthology.orchestra.run.smithi203.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T20:44:18.228 INFO:teuthology.orchestra.run.smithi203.stdout:generic/486 2s 2023-11-28T20:44:18.607 INFO:teuthology.orchestra.run.smithi203.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-11-28T20:44:18.939 INFO:teuthology.orchestra.run.smithi203.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-11-28T20:44:19.333 INFO:teuthology.orchestra.run.smithi203.stdout:generic/489 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:44:20.614 INFO:teuthology.orchestra.run.smithi203.stdout:generic/490 1s 2023-11-28T20:44:20.954 INFO:teuthology.orchestra.run.smithi203.stdout:generic/491 [not run] ceph does not support freezing 2023-11-28T20:44:21.276 INFO:teuthology.orchestra.run.smithi203.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-11-28T20:44:21.970 INFO:teuthology.orchestra.run.smithi203.stdout:generic/493 [not run] swapfiles are not supported 2023-11-28T20:44:22.582 INFO:teuthology.orchestra.run.smithi203.stdout:generic/494 [not run] swapfiles are not supported 2023-11-28T20:44:23.198 INFO:teuthology.orchestra.run.smithi203.stdout:generic/495 [not run] swapfiles are not supported 2023-11-28T20:44:23.808 INFO:teuthology.orchestra.run.smithi203.stdout:generic/496 [not run] swapfiles are not supported 2023-11-28T20:44:24.401 INFO:teuthology.orchestra.run.smithi203.stdout:generic/497 [not run] swapfiles are not supported 2023-11-28T20:44:24.746 INFO:teuthology.orchestra.run.smithi203.stdout:generic/498 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:44:25.070 INFO:teuthology.orchestra.run.smithi203.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T20:44:25.857 INFO:teuthology.orchestra.run.smithi203.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:44:26.225 INFO:teuthology.orchestra.run.smithi203.stdout:generic/502 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:44:26.542 INFO:teuthology.orchestra.run.smithi203.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:44:26.930 INFO:teuthology.orchestra.run.smithi203.stdout:generic/504 0s 2023-11-28T20:44:27.386 INFO:teuthology.orchestra.run.smithi203.stdout:generic/505 [not run] ceph does not support shutdown 2023-11-28T20:44:27.687 INFO:teuthology.orchestra.run.smithi203.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-11-28T20:44:28.023 INFO:teuthology.orchestra.run.smithi203.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-11-28T20:44:28.334 INFO:teuthology.orchestra.run.smithi203.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-11-28T20:44:28.649 INFO:teuthology.orchestra.run.smithi203.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-11-28T20:44:28.942 INFO:teuthology.orchestra.run.smithi203.stdout:generic/510 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:44:29.243 INFO:teuthology.orchestra.run.smithi203.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-11-28T20:44:29.553 INFO:teuthology.orchestra.run.smithi203.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-11-28T20:44:30.258 INFO:teuthology.orchestra.run.smithi203.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:44:30.917 INFO:teuthology.orchestra.run.smithi203.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:44:31.566 INFO:teuthology.orchestra.run.smithi203.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:44:31.931 INFO:teuthology.orchestra.run.smithi203.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-11-28T20:44:32.416 INFO:teuthology.orchestra.run.smithi203.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-11-28T20:44:33.202 INFO:teuthology.orchestra.run.smithi203.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-11-28T20:44:33.554 INFO:teuthology.orchestra.run.smithi203.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-11-28T20:44:33.866 INFO:teuthology.orchestra.run.smithi203.stdout:generic/520 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:44:34.764 INFO:teuthology.orchestra.run.smithi203.stdout:generic/523 1s 2023-11-28T20:44:38.227 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:44:38.230 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:44:38.232 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:45:08.283 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:45:08.285 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:45:08.287 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:45:38.424 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:45:38.427 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:45:38.429 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:46:08.552 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:46:08.555 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:46:08.558 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:46:38.835 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:46:38.839 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:46:38.841 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:47:08.970 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:47:08.973 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:47:08.974 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:47:39.221 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:47:39.225 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:47:39.227 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:48:09.338 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:48:09.341 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:48:09.344 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:48:30.120 INFO:teuthology.orchestra.run.smithi203.stdout:generic/524 236s 2023-11-28T20:48:30.603 INFO:teuthology.orchestra.run.smithi203.stdout:generic/525 [not run] filesystem does not support huge file size 2023-11-28T20:48:30.981 INFO:teuthology.orchestra.run.smithi203.stdout:generic/526 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:48:31.341 INFO:teuthology.orchestra.run.smithi203.stdout:generic/527 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:48:31.770 INFO:teuthology.orchestra.run.smithi203.stdout:generic/528 0s 2023-11-28T20:48:32.629 INFO:teuthology.orchestra.run.smithi203.stdout:generic/529 1s 2023-11-28T20:48:33.087 INFO:teuthology.orchestra.run.smithi203.stdout:generic/530 [not run] ceph does not support shutdown 2023-11-28T20:48:33.401 INFO:teuthology.orchestra.run.smithi203.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-11-28T20:48:33.760 INFO:teuthology.orchestra.run.smithi203.stdout:generic/532 0s 2023-11-28T20:48:34.699 INFO:teuthology.orchestra.run.smithi203.stdout:generic/533 1s 2023-11-28T20:48:35.019 INFO:teuthology.orchestra.run.smithi203.stdout:generic/534 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:48:35.344 INFO:teuthology.orchestra.run.smithi203.stdout:generic/535 [not run] require 172.21.15.28:6789:/scratch to be valid block disk 2023-11-28T20:48:35.752 INFO:teuthology.orchestra.run.smithi203.stdout:generic/536 [not run] ceph does not support shutdown 2023-11-28T20:48:36.172 INFO:teuthology.orchestra.run.smithi203.stdout:generic/537 [not run] FSTRIM not supported 2023-11-28T20:48:39.392 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:48:39.398 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:48:39.400 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:49:09.459 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:49:09.463 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:49:09.465 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:49:39.726 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:49:39.730 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:49:39.732 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:50:10.049 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:50:10.052 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:50:10.054 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:50:40.130 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:50:40.133 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:50:40.136 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:51:10.209 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:51:10.214 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:51:10.220 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:51:40.332 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:51:40.336 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:51:40.339 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:52:10.446 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:52:10.450 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:52:10.452 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:52:40.577 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:52:40.580 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:52:40.582 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:53:10.899 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:53:10.903 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:53:10.907 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:53:40.961 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:53:40.969 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:53:40.976 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:54:11.084 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:54:11.088 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:54:11.091 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:54:41.206 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:54:41.209 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:54:41.212 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:55:11.521 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:55:11.525 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:55:11.527 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:55:41.767 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:55:41.771 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:55:41.774 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:56:11.852 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:56:11.856 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:56:11.858 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:56:42.127 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:56:42.130 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:56:42.133 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:57:12.614 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:57:12.617 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:57:12.619 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:57:42.669 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:57:42.673 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:57:42.675 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:58:12.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:58:12.790 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:58:12.792 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:58:42.940 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:58:42.943 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:58:42.945 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:59:13.073 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:59:13.076 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:59:13.078 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:59:43.169 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:59:43.172 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T20:59:43.175 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:00:13.306 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:00:13.309 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:00:13.312 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:00:43.372 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:00:43.375 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:00:43.378 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:01:13.869 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:01:13.873 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:01:13.876 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:01:43.991 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:01:43.994 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:01:43.997 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:02:14.138 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:02:14.141 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:02:14.143 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:02:44.202 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:02:44.205 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:02:44.208 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:03:14.340 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:03:14.343 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:03:14.345 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:03:44.528 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:03:44.532 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:03:44.536 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:04:14.609 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:04:14.612 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:04:14.615 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:04:44.683 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:04:44.687 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:04:44.689 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:05:14.827 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:05:14.830 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:05:14.833 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:05:44.903 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:05:44.906 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:05:44.909 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:06:15.268 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:06:15.271 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:06:15.273 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:06:45.406 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:06:45.409 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:06:45.412 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:07:15.682 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:07:15.685 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:07:15.688 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:07:45.789 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:07:45.793 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:07:45.796 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:08:15.882 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:08:15.886 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:08:15.889 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:08:46.022 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:08:46.025 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:08:46.028 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:16.147 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:16.150 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:16.153 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:46.236 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:46.240 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:09:46.243 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:16.334 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:16.337 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:16.340 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:46.426 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:46.429 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:10:46.432 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:11:16.582 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:11:16.585 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:11:16.587 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:11:46.654 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:11:46.657 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:11:46.660 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:12:16.779 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:12:16.783 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:12:16.786 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:12:46.886 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:12:46.889 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:12:46.891 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:16.997 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:17.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:17.003 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:47.051 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:47.054 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:13:47.057 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:14:17.701 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:14:17.705 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:14:17.709 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:14:47.761 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:14:47.764 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:14:47.767 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:15:17.885 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:15:17.888 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:15:17.890 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:15:48.141 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:15:48.144 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:15:48.146 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:18.287 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:18.290 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:18.293 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:48.369 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:48.372 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:16:48.375 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:17:18.598 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:17:18.601 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:17:18.604 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:17:48.655 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:17:48.659 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:17:48.662 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:18:18.719 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:18:18.722 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:18:18.725 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:18:48.824 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:18:48.827 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:18:48.830 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:19:18.945 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:19:18.949 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:19:18.952 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:19:49.084 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:19:49.087 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:19:49.090 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:19.207 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:19.211 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:19.213 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:49.321 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:49.324 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:20:49.328 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:19.394 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:19.397 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:19.400 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:49.532 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:49.535 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:21:49.538 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:22:19.621 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:22:19.625 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:22:19.629 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:22:49.757 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:22:49.760 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:22:49.763 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:23:19.879 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:23:19.882 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:23:19.885 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:23:49.936 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:23:49.939 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:23:49.942 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:20.059 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:20.062 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:20.064 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:50.170 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:50.173 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:24:50.175 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:25:20.300 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:25:20.303 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:25:20.306 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:25:50.499 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:25:50.502 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:25:50.505 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:26:20.580 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:26:20.583 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:26:20.586 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:26:50.733 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:26:50.736 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:26:50.739 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:27:20.812 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:27:20.815 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:27:20.818 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:27:50.976 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:27:50.979 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:27:50.982 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:21.090 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:21.093 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:21.096 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:51.195 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:51.199 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:28:51.202 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:21.308 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:21.311 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:21.317 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:51.447 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:51.451 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:29:51.454 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:30:21.511 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:30:21.514 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:30:21.517 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:30:51.646 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:30:51.649 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:30:51.652 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:31:21.780 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:31:22.449 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:31:22.473 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:31:52.570 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:31:52.573 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:31:52.575 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:32:22.665 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:32:22.668 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:32:22.671 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:32:52.794 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:32:52.798 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:32:52.802 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:33:22.925 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:33:22.928 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:33:22.931 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:33:53.151 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:33:53.154 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:33:53.157 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:34:23.509 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:34:23.512 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:34:23.515 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:34:53.583 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:34:53.586 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:34:53.588 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:35:23.722 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:35:25.408 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:35:25.412 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:35:55.536 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:35:55.540 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:35:55.543 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:36:25.633 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:36:25.637 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:36:25.639 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:36:55.772 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:36:55.775 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:36:55.778 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:37:25.835 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:37:25.839 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:37:25.841 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:37:55.897 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:37:55.900 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:37:55.905 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:38:25.954 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:38:25.957 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:38:25.960 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:38:56.026 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:38:56.029 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:38:56.032 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:39:26.090 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:39:26.094 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:39:26.096 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:39:56.213 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:39:56.216 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:39:56.219 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:26.698 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:26.702 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:26.705 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:57.087 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:57.090 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:40:57.093 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:41:27.238 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:41:27.240 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:41:27.243 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:41:57.302 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:41:57.305 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:41:57.308 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:42:27.365 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:42:27.369 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:42:27.371 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:42:57.463 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:42:57.466 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:42:57.469 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:43:27.596 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:43:27.599 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:43:27.602 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:43:57.659 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:43:57.662 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:43:57.664 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:27.789 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:27.793 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:27.796 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:57.913 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:57.917 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:44:57.919 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:28.216 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:28.219 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:28.222 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:58.289 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:58.292 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:45:58.294 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:28.365 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:28.368 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:28.371 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:58.446 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:58.449 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:46:58.451 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:28.585 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:28.589 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:28.592 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:58.724 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:58.727 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:47:58.730 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:28.854 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:28.858 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:28.860 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:59.002 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:59.006 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:48:59.009 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:49:29.108 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:49:29.120 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:49:29.123 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:49:59.263 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:49:59.266 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:49:59.269 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:50:29.394 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:50:31.411 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:50:31.417 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:51:01.549 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:51:01.552 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:51:01.555 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:51:31.679 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:51:31.683 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:51:31.685 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:01.794 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:01.797 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:01.800 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:31.973 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:31.977 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:52:31.980 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:53:02.038 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:53:02.041 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:53:02.044 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:53:32.160 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:53:32.163 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:53:32.166 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:54:02.213 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:54:02.216 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:54:02.218 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:54:32.271 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:54:32.277 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:54:32.280 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:55:02.403 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:55:02.406 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:55:02.410 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:55:32.539 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:55:32.542 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:55:32.544 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:02.618 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:02.622 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:02.624 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:32.739 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:32.742 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:56:32.745 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:57:02.842 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:57:02.846 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:57:02.848 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:57:32.900 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:57:32.905 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:57:32.908 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:58:03.013 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:58:03.016 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:58:03.018 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T21:58:03.037 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-11-28T21:58:03.039+0000 7f2192366640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45515) UID: 0 2023-11-28T21:58:03.038 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-11-28T21:58:03.039+0000 7f23bc0c2640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45515) UID: 0 2023-11-28T21:58:03.038 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-11-28T21:58:03.039+0000 7faeafb56640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45515) UID: 0 2023-11-28T21:58:03.038 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-11-28T21:58:03.039+0000 7fb33c8a0640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 45515) UID: 0 2023-11-28T22:00:19.604 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:19.608 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:19.611 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:49.683 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:50.827 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:00:50.830 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:01:20.963 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:01:20.966 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:01:20.969 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:01:51.313 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:01:51.317 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:01:51.320 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:21.373 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:21.376 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:21.379 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:51.446 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:51.449 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:02:51.452 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:21.560 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:21.563 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:21.566 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:51.640 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:51.644 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:03:51.646 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:04:21.770 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:04:21.774 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:04:21.776 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:04:51.885 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:04:51.889 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:04:51.892 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:05:22.016 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:05:22.019 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:05:22.022 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:05:52.081 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:05:52.085 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:05:52.087 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:06:22.244 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:06:22.247 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:06:22.249 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:06:52.600 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:06:52.603 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:06:52.606 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:22.713 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:22.717 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:22.719 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:52.833 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:52.836 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:07:52.839 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:22.963 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:22.966 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:22.968 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:53.017 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:53.021 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:08:53.023 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:09:23.081 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:09:23.084 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:09:23.087 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:09:53.329 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:09:53.332 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:09:53.334 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:10:23.389 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:10:23.392 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:10:23.395 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:10:53.519 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:10:53.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:10:53.528 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:11:23.727 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:11:23.731 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:11:23.734 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:11:53.782 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:11:53.786 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:11:53.788 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:12:23.862 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:12:23.865 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:12:23.868 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:12:53.985 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:12:53.988 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:12:53.990 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:13:24.058 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:13:24.062 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:13:24.064 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:13:54.170 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:13:54.173 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:13:54.176 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:14:24.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:14:24.232 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:14:24.235 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:14:54.352 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:14:54.355 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:14:54.358 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:24.665 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:24.668 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:24.671 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:54.775 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:54.778 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:15:54.781 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:16:24.857 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:16:24.860 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:16:24.863 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:16:54.982 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:16:54.985 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:16:54.987 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:25.139 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:25.142 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:25.145 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:55.294 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:55.298 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:17:55.301 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:18:25.374 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:18:25.378 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:18:25.380 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:18:55.447 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:18:55.450 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:18:55.453 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:19:25.511 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:19:25.514 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:19:25.517 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:19:55.775 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:19:55.778 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:19:55.780 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:20:25.855 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:20:25.858 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:20:25.861 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:20:55.978 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:20:55.981 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:20:55.984 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:26.060 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:26.063 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:26.065 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:56.173 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:56.177 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:21:56.180 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:26.554 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:26.558 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:26.560 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:56.669 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:56.672 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:22:56.675 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:27.090 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:27.094 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:27.096 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:57.154 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:57.157 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:23:57.160 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:24:27.280 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:24:27.283 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:24:27.286 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:24:57.494 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:24:57.498 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:24:57.500 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:25:27.547 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:25:27.550 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:25:27.553 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:25:57.635 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:25:57.638 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:25:57.641 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:26:27.795 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:26:27.799 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:26:27.801 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:26:57.892 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:26:57.896 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:26:57.899 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:28.023 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:28.026 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:28.029 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:58.170 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:58.173 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:27:58.176 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:28:28.234 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:28:28.238 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:28:28.240 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:28:58.289 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:28:58.293 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:28:58.295 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:29:28.420 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:29:28.423 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:29:28.425 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:29:58.618 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:29:58.622 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:29:58.624 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:30:28.746 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:30:28.750 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:30:28.753 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:30:58.869 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:30:58.872 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:30:58.875 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:28.959 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:28.963 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:28.965 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:59.099 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:59.103 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:31:59.106 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:32:29.186 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:32:29.190 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:32:29.192 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:32:59.325 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:32:59.328 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:32:59.331 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:32:59.354 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-11-28T22:32:59.349+0000 7fc01b0d4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48533) UID: 0 2023-11-28T22:32:59.354 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-11-28T22:32:59.349+0000 7f96c864f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48533) UID: 0 2023-11-28T22:32:59.357 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-11-28T22:32:59.349+0000 7fb9e217e640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48533) UID: 0 2023-11-28T22:32:59.358 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-11-28T22:32:59.349+0000 7f75dde79640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48533) UID: 0 2023-11-28T22:34:53.994 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:34:53.997 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:34:54.000 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:24.118 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:24.121 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:24.124 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:54.577 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:54.580 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:35:54.583 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:24.657 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:24.660 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:24.663 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:54.734 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:54.737 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:36:54.740 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:37:01.853 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-11-28T22:37:24.872 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:37:24.875 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:37:24.878 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:37:55.030 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:37:55.033 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:37:55.036 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:38:25.088 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:38:25.091 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:38:25.094 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:38:55.452 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:38:55.455 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:38:55.458 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:25.532 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:25.535 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:25.538 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:55.647 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:55.650 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:39:55.652 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:40:25.710 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:40:25.713 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:40:25.716 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:40:55.818 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:40:55.822 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:40:55.824 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:41:25.889 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:41:25.893 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:41:25.896 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:41:55.970 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:41:55.973 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:41:55.976 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:26.077 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:26.080 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:26.083 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:56.193 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:56.197 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:42:56.199 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:26.257 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:26.261 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:26.264 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:56.371 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:56.375 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:43:56.377 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:26.564 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:26.566 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:26.569 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:56.661 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:56.665 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:44:56.667 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:26.774 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:26.778 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:26.780 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:56.989 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:56.992 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:45:56.995 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:27.150 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:27.154 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:27.157 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:57.215 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:57.218 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:46:57.221 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:27.278 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:27.281 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:27.284 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:57.434 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:57.437 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:47:57.440 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:27.833 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:27.836 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:27.838 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:57.929 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:57.932 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:48:57.935 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:28.238 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:28.241 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:28.244 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:58.332 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:58.335 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:49:58.338 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:28.405 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:28.408 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:28.410 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:58.551 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:58.554 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:50:58.556 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:28.683 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:28.687 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:28.689 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:59.014 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:59.017 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:51:59.019 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:52:29.085 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:52:29.088 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:52:29.090 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:52:59.407 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:52:59.410 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:52:59.413 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:53:29.455 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:53:29.458 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:53:29.461 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:53:59.560 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:53:59.564 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:53:59.566 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:54:29.690 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:54:29.693 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:54:29.696 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:00.229 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:03.852 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:03.856 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:33.959 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:33.962 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:55:33.965 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:04.025 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:04.028 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:04.031 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:34.102 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:34.105 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:56:34.108 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:04.175 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:04.179 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:04.182 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:34.323 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:34.326 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:57:34.329 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:04.548 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:04.552 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:04.554 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:34.608 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:34.611 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:58:34.614 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:04.731 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:04.734 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:04.738 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:34.978 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:34.981 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T22:59:34.984 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:05.046 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:05.049 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:05.052 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:35.152 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:35.155 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:00:35.158 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:05.299 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:05.302 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:05.304 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:35.388 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:35.392 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:01:35.394 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:02:05.670 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:02:05.674 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:02:05.677 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:02:35.769 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:02:35.772 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:02:35.774 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:06.082 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:06.085 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:06.088 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:36.136 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:36.139 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:03:36.142 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:04:06.276 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:04:06.279 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:04:06.282 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:04:36.397 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:04:36.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:04:36.403 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:05:06.544 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:05:06.548 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:05:06.551 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:05:36.650 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:05:36.653 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:05:36.656 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:06:06.947 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:06:06.950 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:06:06.953 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:06:37.019 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:06:37.024 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:06:37.026 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:07.092 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:07.095 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:07.097 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:37.813 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:37.816 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:07:37.819 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:07.872 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:07.876 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:07.879 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:38.017 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:38.020 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:08:38.023 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:09:08.772 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:09:08.776 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:09:08.778 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:09:38.835 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:09:38.838 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:09:38.841 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:08.970 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:08.973 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:08.976 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:39.214 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:39.217 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:10:39.219 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:09.289 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:09.292 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:09.294 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:39.366 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:39.369 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:11:39.372 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:12:09.505 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:12:09.509 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:12:09.512 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:12:39.627 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:12:39.630 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:12:39.633 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:13:09.750 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:13:09.754 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:13:09.756 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:13:39.883 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:13:39.886 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:13:39.889 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:14:10.038 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:14:10.042 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:14:10.045 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:14:40.179 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:14:40.182 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:14:40.185 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:10.324 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:10.327 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:10.330 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:40.714 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:40.717 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:15:40.720 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:10.795 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:10.798 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:10.801 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:40.941 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:40.944 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:16:41.029 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:11.228 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:11.231 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:11.233 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:41.291 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:41.295 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:17:41.298 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:18:11.441 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:18:11.444 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:18:11.447 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:18:41.759 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:18:41.762 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:18:41.765 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:19:12.094 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:19:12.097 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:19:12.100 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:19:42.144 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:19:42.147 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:19:42.150 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:20:12.276 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:20:12.279 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:20:12.281 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:20:42.519 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:20:42.522 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:20:42.525 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:12.812 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:12.815 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:12.818 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:42.883 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:42.886 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:21:42.889 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:22:13.441 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:22:13.444 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:22:13.446 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:22:43.499 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:22:43.503 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:22:43.505 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:23:13.617 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:23:13.620 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:23:13.622 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:23:43.830 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:23:43.834 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:23:43.836 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:13.920 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:13.923 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:13.925 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:44.040 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:44.043 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:24:44.046 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:14.104 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:14.108 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:14.110 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:44.194 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:44.197 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:25:44.200 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:26:14.300 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:26:14.304 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:26:14.306 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:26:44.379 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:26:44.382 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:26:44.385 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:27:14.501 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:27:14.504 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:27:14.507 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:27:44.725 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:27:44.729 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:27:44.731 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:28:14.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:28:14.790 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:28:14.793 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:28:44.901 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:28:44.904 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:28:44.907 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:29:15.049 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:29:15.052 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:29:15.055 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:29:45.181 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:29:45.184 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:29:45.187 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:30:15.286 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:30:15.289 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:30:15.292 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:30:45.409 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:30:45.412 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:30:45.415 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:31:15.673 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:31:15.677 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:31:15.680 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:31:45.735 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:31:45.738 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:31:45.741 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:32:16.010 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:32:16.013 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:32:16.016 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:32:46.080 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:32:46.085 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:32:46.088 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:33:16.194 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:33:16.198 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:33:16.201 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:33:46.326 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:33:46.329 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:33:46.332 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:16.447 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:16.450 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:16.453 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:46.494 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:46.497 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:34:46.500 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:16.551 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:17.011 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:17.014 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:47.065 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:47.068 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:35:47.071 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:17.179 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:17.182 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:17.185 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:47.292 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:47.295 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:36:47.298 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:17.373 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:17.376 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:17.379 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:47.436 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:47.439 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:37:47.441 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:17.701 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:17.706 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:17.708 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:47.766 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:47.769 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:38:47.772 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:17.896 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:17.900 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:17.903 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:47.994 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:47.997 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:39:47.999 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:18.158 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:18.161 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:18.164 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:48.297 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:48.300 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:40:48.303 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:18.577 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:18.581 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:18.583 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:48.642 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:48.645 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:41:48.648 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:18.996 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:19.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:19.002 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:49.123 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:49.125 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:42:49.128 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:19.183 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:19.186 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:19.189 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:49.295 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:49.299 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:43:49.302 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:19.380 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:19.384 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:19.387 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:49.528 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:49.531 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:44:49.534 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:19.670 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:19.674 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:19.676 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:49.787 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:49.791 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:45:49.793 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:19.889 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:19.892 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:19.895 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:50.015 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:50.018 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:46:50.021 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:20.259 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:20.262 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:20.264 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:50.363 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:50.367 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:47:50.370 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:20.515 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:20.518 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:20.521 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:36.194 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-11-28T23:48:50.638 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:50.641 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:48:50.643 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:20.909 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:20.912 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:20.914 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:51.035 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:51.041 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:49:51.044 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:50:21.102 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:50:21.106 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:50:21.108 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:50:51.306 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:50:51.309 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:50:51.312 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:51:21.476 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:51:21.479 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:51:21.481 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:51:51.542 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:51:51.546 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:51:51.549 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:21.754 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:21.757 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:21.759 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:51.820 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:51.823 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:52:51.826 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:22.096 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:22.099 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:22.101 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:52.245 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:52.248 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:53:52.251 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:22.305 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:22.309 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:22.311 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:52.412 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:56.469 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:54:56.472 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:26.824 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:26.827 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:26.830 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:56.892 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:56.895 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:55:56.897 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:27.015 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:27.019 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:27.023 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:57.129 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:57.132 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:56:57.135 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:57:27.439 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:57:27.443 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:57:27.445 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:57:57.561 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:57:57.564 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:57:57.567 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:58:27.707 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:58:27.711 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:58:27.714 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:58:57.771 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:58:57.775 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:58:57.778 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:59:27.902 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:59:27.905 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:59:27.908 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:59:58.191 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:59:58.194 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-28T23:59:58.197 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:06.867 INFO:tasks.ceph.mon.c.smithi131.stderr:2023-11-29T00:00:06.862+0000 7f226c322640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46272) UID: 0 2023-11-29T00:00:06.867 INFO:tasks.ceph.mon.c.smithi131.stderr:2023-11-29T00:00:06.862+0000 7f226c322640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-11-29T00:00:06.867 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-29T00:00:06.862+0000 7f4da79a0640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46272) UID: 0 2023-11-29T00:00:06.867 INFO:tasks.ceph.mon.b.smithi131.stderr:2023-11-29T00:00:06.862+0000 7f0ca26bb640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46272) UID: 0 2023-11-29T00:00:06.868 INFO:tasks.ceph.mon.b.smithi131.stderr:2023-11-29T00:00:06.862+0000 7f0ca26bb640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-11-29T00:00:06.868 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-11-29T00:00:06.862+0000 7f2192366640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46272) UID: 0 2023-11-29T00:00:06.868 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-11-29T00:00:06.862+0000 7fb33c8a0640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46272) UID: 0 2023-11-29T00:00:06.869 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-11-29T00:00:06.862+0000 7f23bc0c2640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46272) UID: 0 2023-11-29T00:00:06.869 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-11-29T00:00:06.862+0000 7faeafb56640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46272) UID: 0 2023-11-29T00:00:06.869 INFO:tasks.ceph.mds.b.smithi131.stderr:2023-11-29T00:00:06.862+0000 7f7c1adc2640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 46272) UID: 0 2023-11-29T00:00:06.890 INFO:tasks.ceph.mon.c.smithi131.stderr:2023-11-29T00:00:06.882+0000 7f226c322640 -1 received signal: Hangup from (PID: 46283) UID: 0 2023-11-29T00:00:06.890 INFO:tasks.ceph.mon.c.smithi131.stderr:2023-11-29T00:00:06.882+0000 7f226c322640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-11-29T00:00:06.891 INFO:tasks.ceph.osd.4.smithi131.stderr:2023-11-29T00:00:06.882+0000 7f23bc0c2640 -1 received signal: Hangup from (PID: 46283) UID: 0 2023-11-29T00:00:06.891 INFO:tasks.ceph.osd.6.smithi131.stderr:2023-11-29T00:00:06.882+0000 7faeafb56640 -1 received signal: Hangup from (PID: 46283) UID: 0 2023-11-29T00:00:06.891 INFO:tasks.ceph.mon.b.smithi131.stderr:2023-11-29T00:00:06.882+0000 7f0ca26bb640 -1 received signal: Hangup from (PID: 46283) UID: 0 2023-11-29T00:00:06.891 INFO:tasks.ceph.mon.b.smithi131.stderr:2023-11-29T00:00:06.882+0000 7f0ca26bb640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-11-29T00:00:06.892 INFO:tasks.ceph.mgr.x.smithi131.stderr:2023-11-29T00:00:06.886+0000 7f4da79a0640 -1 received signal: Hangup from (PID: 46283) UID: 0 2023-11-29T00:00:06.892 INFO:tasks.ceph.osd.5.smithi131.stderr:2023-11-29T00:00:06.882+0000 7f2192366640 -1 received signal: Hangup from (PID: 46283) UID: 0 2023-11-29T00:00:06.892 INFO:tasks.ceph.osd.7.smithi131.stderr:2023-11-29T00:00:06.882+0000 7fb33c8a0640 -1 received signal: Hangup from (PID: 46283) UID: 0 2023-11-29T00:00:06.892 INFO:tasks.ceph.mds.b.smithi131.stderr:2023-11-29T00:00:06.882+0000 7f7c1adc2640 -1 received signal: Hangup from (PID: 46283) UID: 0 2023-11-29T00:00:16.358 INFO:tasks.ceph.mon.a.smithi028.stderr:2023-11-29T00:00:16.352+0000 7f9870923640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 49099) UID: 0 2023-11-29T00:00:16.359 INFO:tasks.ceph.mon.a.smithi028.stderr:2023-11-29T00:00:16.352+0000 7f9870923640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2023-11-29T00:00:16.360 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-29T00:00:16.352+0000 7efeafe1f640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 49099) UID: 0 2023-11-29T00:00:16.360 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-11-29T00:00:16.352+0000 7fb9e217e640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 49099) UID: 0 2023-11-29T00:00:16.360 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-11-29T00:00:16.352+0000 7fc01b0d4640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 49099) UID: 0 2023-11-29T00:00:16.361 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-11-29T00:00:16.352+0000 7f96c864f640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 49099) UID: 0 2023-11-29T00:00:16.361 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-11-29T00:00:16.352+0000 7f75dde79640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 49099) UID: 0 2023-11-29T00:00:16.361 INFO:tasks.ceph.mds.a.smithi028.stderr:2023-11-29T00:00:16.352+0000 7f479a9ae640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 49099) UID: 0 2023-11-29T00:00:16.362 INFO:tasks.ceph.mds.c.smithi028.stderr:2023-11-29T00:00:16.352+0000 7f2738088640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 49099) UID: 0 2023-11-29T00:00:16.378 INFO:tasks.ceph.osd.1.smithi028.stderr:2023-11-29T00:00:16.372+0000 7fc01b0d4640 -1 received signal: Hangup from (PID: 49100) UID: 0 2023-11-29T00:00:16.378 INFO:tasks.ceph.mds.a.smithi028.stderr:2023-11-29T00:00:16.372+0000 7f479a9ae640 -1 received signal: Hangup from (PID: 49100) UID: 0 2023-11-29T00:00:16.379 INFO:tasks.ceph.mds.c.smithi028.stderr:2023-11-29T00:00:16.372+0000 7f2738088640 -1 received signal: Hangup from (PID: 49100) UID: 0 2023-11-29T00:00:16.379 INFO:tasks.ceph.osd.0.smithi028.stderr:2023-11-29T00:00:16.372+0000 7fb9e217e640 -1 received signal: Hangup from (PID: 49100) UID: 0 2023-11-29T00:00:16.379 INFO:tasks.ceph.osd.2.smithi028.stderr:2023-11-29T00:00:16.372+0000 7f96c864f640 -1 received signal: Hangup from (PID: 49100) UID: 0 2023-11-29T00:00:16.380 INFO:tasks.ceph.osd.3.smithi028.stderr:2023-11-29T00:00:16.372+0000 7f75dde79640 -1 received signal: Hangup from (PID: 49100) UID: 0 2023-11-29T00:00:16.380 INFO:tasks.ceph.mon.a.smithi028.stderr:2023-11-29T00:00:16.372+0000 7f9870923640 -1 Fail to read '/proc/49100/cmdline' error = (3) No such process 2023-11-29T00:00:16.380 INFO:tasks.ceph.mon.a.smithi028.stderr:2023-11-29T00:00:16.372+0000 7f9870923640 -1 received signal: Hangup from (PID: 49100) UID: 0 2023-11-29T00:00:16.380 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-29T00:00:16.372+0000 7efeafe1f640 -1 Fail to read '/proc/49100/cmdline' error = (3) No such process 2023-11-29T00:00:16.381 INFO:tasks.ceph.mgr.y.smithi028.stderr:2023-11-29T00:00:16.372+0000 7efeafe1f640 -1 received signal: Hangup from (PID: 49100) UID: 0 2023-11-29T00:00:16.381 INFO:tasks.ceph.mon.a.smithi028.stderr:2023-11-29T00:00:16.372+0000 7f9870923640 -1 mon.a@0(leader) e1 *** Got Signal Hangup *** 2023-11-29T00:00:28.254 DEBUG:teuthology.orchestra.run.smithi028:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:28.257 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:28.259 DEBUG:teuthology.orchestra.run.smithi203:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-11-29T00:00:28.267 INFO:teuthology.orchestra.run.smithi028.stderr:error: state file /var/lib/logrotate/status is already locked 2023-11-29T00:00:28.267 INFO:teuthology.orchestra.run.smithi028.stderr:logrotate does not support parallel execution on the same set of logfiles. 2023-11-29T00:00:28.268 DEBUG:teuthology.orchestra.run:got remote process result: 3 2023-11-29T00:00:28.269 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_ceph-c_43dd94c190073cf16cff1e711dd7f5a7b1cbc883/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_5ae09a5cc7064ca2bf994df19f3006b79794789a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi028 with status 3: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-11-29T00:00:28.407 INFO:teuthology.orchestra.run.smithi131.stderr:error: state file /var/lib/logrotate/status is already locked 2023-11-29T00:00:28.407 INFO:teuthology.orchestra.run.smithi131.stderr:logrotate does not support parallel execution on the same set of logfiles. 2023-11-29T07:15:44.054 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-11-29T07:15:44.112 DEBUG:teuthology.task.console_log:Killing console logger for smithi028 2023-11-29T07:15:44.113 DEBUG:teuthology.task.console_log:Killing console logger for smithi131 2023-11-29T07:15:44.113 DEBUG:teuthology.task.console_log:Killing console logger for smithi203 2023-11-29T07:15:44.113 DEBUG:teuthology.exit:Finished running handlers